c04e8415c0
fix(migrations): resolve issue with latest migration and multi-language support
2025-07-18 19:30:51 +00:00
1e9bbceff6
fix(migrations): resolve new broken migration for multiple ocr languages
2025-07-14 20:52:42 +00:00
9d9488954c
feat(lang): update backend to support multiple languages at the same time during OCR
2025-07-14 19:33:43 +00:00
db41b15609
feat(client): show more fields for Documents
2025-07-10 21:02:15 +00:00
ea94dff8ba
fix(stats): create new get_queue_statistics function to avoid conflicts
2025-07-09 00:27:43 +00:00
9846ea67cb
debug(tests): add some debug lines to see why CI is upset
2025-07-08 22:32:32 +00:00
21a655a4b0
fix(migrations): resolve PostgreSQL function type mismatch in get_ocr_queue_stats
2025-07-08 22:30:21 +00:00
c085990ea1
fix(migrations): resolve PostgreSQL function type mismatch in get_ocr_queue_stats
2025-07-08 22:04:24 +00:00
f17b610501
fix(stats): try to fix stats export, again again
2025-07-08 20:16:33 +00:00
05a0355796
fix(tests): fix the crazy metrics collection issue
2025-07-08 16:52:23 +00:00
c0835f436f
feat(webdav): also add some crazy source automatic validation
2025-07-03 05:26:36 +00:00
42c7edd9df
feat(webdav): gracefully recover webdav from stops/crashes
2025-07-03 04:45:25 +00:00
f1fc2a0105
fix(server): resolve issues with the retry ocr tests
2025-07-02 22:47:51 +00:00
bfef816848
fix(server): resolve ocr test functionality failing due to db trigger
2025-07-02 22:38:13 +00:00
dec4551fbd
feat(tests): fix ocr_retry issues in tests
2025-07-02 21:30:36 +00:00
e4faf2cfd2
feat(server/client): implement retry functionality for both successful and failed documents
2025-07-02 00:06:47 +00:00
fdc240fa5b
feat(webdav): track directory etags
...
✅ Core Optimizations Implemented
1. 📊 New Database Schema: Added webdav_directories table to track
directory ETags, file counts, and metadata
2. 🔍 Smart Directory Checking: Before deep scans, check directory
ETags with lightweight Depth: 0 PROPFIND requests
3. ΓÜí Skip Unchanged Directories: If directory ETag matches, skip the
entire deep scan
4. 🗂️ N-Depth Subdirectory Tracking: Recursively track all
subdirectories found during scans
5. 🎯 Individual Subdirectory Checks: When parent unchanged, check
each known subdirectory individually
🚀 Performance Benefits
Before: Every sync = Full Depth: infinity scan of entire directory
treeAfter:
- First sync: Full scan + directory tracking setup
- Subsequent syncs: Quick ETag checks → skip unchanged directories
entirely
- Changed directories: Only scan the specific changed subdirectories
📁 How It Works
1. Initial Request: PROPFIND Depth: 0 on /Documents → get directory
ETag
2. Database Check: Compare with stored ETag for /Documents
3. If Unchanged: Check each known subdirectory (/Documents/2024,
/Documents/Archive) individually
4. If Changed: Full recursive scan + update all directory tracking
data
2025-07-01 21:22:16 +00:00
d9b695f0bd
feat(server/client): add metadata to file view
2025-06-30 19:13:16 +00:00
df254d59e3
feat(server/client): resolve failing tests
2025-06-28 21:21:05 +00:00
34bc207e39
feat(server/client): add failed_documents table to handle failures, and move logic of failures
2025-06-28 20:52:58 +00:00
6dd580fa2f
fix(ocr_status): populate the ocr queue with pending jobs and add easy 'retry' button
2025-06-28 18:08:00 +00:00
ac31573db5
feat(migration): disable OCR consistency trigger for OCR confidence backfill
2025-06-28 17:23:35 +00:00
dc5cb99462
feat(migration): instead of hardcoded guessing, re-enter those documents into the queue
2025-06-28 14:53:45 +00:00
3ad4bbf456
fix(migrations): resolve issue in migration for ocr confidence
2025-06-28 14:51:06 +00:00
7f69cd2e5f
fix(server/client): fix incorrect OCR measurements
2025-06-27 20:23:59 -07:00
10d9a1a661
feat(server): set up oidc system and migrations
2025-06-26 18:52:57 +00:00
afa0565634
feat(server/client): implement feature of ignoring already deleted files, and add failed OCR queue tests
2025-06-24 17:20:33 +00:00
d6b523f3ad
fix(migrations): fix comment referencing old migration name
2025-06-23 21:10:44 +00:00
67191c95b7
feat(migrations): resolve migrations names and remove legacy migrations code
2025-06-23 21:08:43 +00:00
de45300c7a
feat(webdav): move etag parser to own function, create required migration
2025-06-23 19:39:39 +00:00
51e11903d3
feat(ocr_queue): fix completed_today count
2025-06-22 16:04:17 +00:00
a1a7407663
fix(db): more labels migrations
2025-06-19 21:28:13 +00:00
0fccba8875
fix(migrations): de-dupe migrations and fix labels migrations
2025-06-19 19:47:29 +00:00
d510d7974e
fix(db): add labels sql table
2025-06-19 18:58:00 +00:00
4a54b0a8b7
feat(server/client): implement labels for documents
2025-06-18 16:12:42 +00:00
75747016f0
feat(server): add hash for documents
2025-06-17 15:41:42 +00:00
8de1e153a1
feat(server): stop image preprocessing in OCR
2025-06-17 00:35:03 +00:00
e6ab56daa8
feat(server): break up large db.rs file into multiple files, and add more PDF guardrails
2025-06-17 00:25:21 +00:00
0ccceb768a
feat(server): create folders within 'upload' path to manage thumbnails, processed images, etc.
2025-06-16 21:24:46 +00:00
91b16de082
feat(server): create more DB guardrails, and lots of missing tests
2025-06-15 22:14:02 +00:00
42bc72ded4
feat(server/client): add lots of OCR tweaks
2025-06-15 21:24:06 +00:00
59e5356a25
feat(server): create 'sources' concept and move WebDAV settings page to it
2025-06-15 16:12:18 +00:00
08d57c6c36
feat(db): don't use weird pgsql extension to generate uuids, require postgres 13+
2025-06-14 23:14:49 +00:00
9e1acbf1b5
feat(server): fix migration not working
2025-06-14 22:57:43 +00:00
57c118c049
feat(server): implement notifications and webdav
2025-06-14 01:34:56 +00:00
63b322ac7a
feat(server): add role capability, and fix tests
2025-06-13 20:58:36 +00:00
e3f1855711
feat(client/server): add nextcloud/webdav capability, add integration tests
2025-06-13 17:09:05 +00:00
725105d62f
feat(migrations): add missing migrations and fix metrics endpoint
2025-06-13 15:55:30 +00:00
00b2bfe22c
feat(server/client): the /documents endpoint works again, and so does the watch folder...kinda
2025-06-13 15:53:19 +00:00
cd35f877b1
feat(migrations): try to fix the migrations service
2025-06-13 15:14:13 +00:00
perf3ct
aaldebs99