0f3cb12c7a
fix(server): resolve NUMERIC db type and f64 rust type
2025-07-02 02:26:11 +00:00
d6c0f412b5
feat(tests): create unit tests for retry
2025-07-02 02:13:58 +00:00
4e8c96a518
fix(client): resolve incorrect import on documentService
2025-07-02 00:21:36 +00:00
c878a5a860
fix(tests): resolve broken frontend tests due to retry functionality
2025-07-02 00:18:21 +00:00
6af9e5e4a0
fix(tests): resolve using test config in ocr retry tests
2025-07-02 00:14:19 +00:00
e4faf2cfd2
feat(server/client): implement retry functionality for both successful and failed documents
2025-07-02 00:06:47 +00:00
6f16ddc207
Merge pull request #85 from readur/feat/greatly-improve-webdav-1
...
feat(webdav): track directory etags
2025-07-01 15:41:21 -07:00
c766ecc52e
fix(tests): resolve broken test compilation
2025-07-01 22:14:53 +00:00
c242a84326
feat(webdav): also fix the parser to include directories, and add tests
2025-07-01 22:03:06 +00:00
590cad3197
feat(tests): add unit tests for new webdav functionality
2025-07-01 21:39:31 +00:00
aa3d0c3b72
Merge pull request #39 from readur/renovate/vite-7.x
...
chore(deps): update dependency vite to v7
2025-07-01 14:24:22 -07:00
4a7e79540b
Merge pull request #83 from readur/renovate/reqwest-0.x-lockfile
...
fix(deps): update rust crate reqwest to v0.12.22
2025-07-01 14:24:13 -07:00
73e5c20747
Merge pull request #84 from readur/renovate/aws-sdk-rust-monorepo
...
fix(deps): update rust crate aws-config to v1.8.1
2025-07-01 14:24:03 -07:00
fdc240fa5b
feat(webdav): track directory etags
...
✅ Core Optimizations Implemented
1. 📊 New Database Schema: Added webdav_directories table to track
directory ETags, file counts, and metadata
2. 🔍 Smart Directory Checking: Before deep scans, check directory
ETags with lightweight Depth: 0 PROPFIND requests
3. ΓÜí Skip Unchanged Directories: If directory ETag matches, skip the
entire deep scan
4. 🗂️ N-Depth Subdirectory Tracking: Recursively track all
subdirectories found during scans
5. 🎯 Individual Subdirectory Checks: When parent unchanged, check
each known subdirectory individually
🚀 Performance Benefits
Before: Every sync = Full Depth: infinity scan of entire directory
treeAfter:
- First sync: Full scan + directory tracking setup
- Subsequent syncs: Quick ETag checks → skip unchanged directories
entirely
- Changed directories: Only scan the specific changed subdirectories
📁 How It Works
1. Initial Request: PROPFIND Depth: 0 on /Documents → get directory
ETag
2. Database Check: Compare with stored ETag for /Documents
3. If Unchanged: Check each known subdirectory (/Documents/2024,
/Documents/Archive) individually
4. If Changed: Full recursive scan + update all directory tracking
data
2025-07-01 21:22:16 +00:00
9234323f9c
fix(deps): update rust crate aws-config to v1.8.1
2025-07-01 20:56:42 +00:00
1e655be542
Merge pull request #82 from readur/feat/merge-document-management-tabs
...
feat(client): combine the low confidence ocr tab with the bulk cleanup…
2025-07-01 13:55:10 -07:00
a2ea446e16
feat(client): update swagger ui endpoints
2025-07-01 20:54:45 +00:00
d2d7adb0ad
feat(client): update swagger ui endpoints
2025-07-01 19:00:29 +00:00
37f3b3be75
fix(deps): update rust crate reqwest to v0.12.22
2025-07-01 18:55:12 +00:00
680cf5f526
feat(client): combine the low confience ocr tab with the bulk cleanup tab, and move debug menu
2025-07-01 18:52:28 +00:00
a8a6047214
fix(client): try to fix the lint issues on the debug page
2025-07-01 02:25:24 +00:00
1695692729
Merge pull request #81 from readur/feat/debug-page
...
feat(debug/pdf): debug page actually works, add ocrmypdf
2025-06-30 18:09:59 -07:00
8deca105b1
fix(client): try to fix the lint issues on the debug page
2025-07-01 01:05:40 +00:00
f7018575d8
feat(pdf): implement ocrmypdf to extract text from PDFs
2025-07-01 00:56:48 +00:00
59e80a1b92
Merge branch 'main' into feat/debug-page
2025-06-30 17:19:31 -07:00
2a1eeeda50
feat(debug): debug page actually works and does something
2025-07-01 00:15:48 +00:00
f26ab1e367
fix(pdf): resolve PDF wordcount error
2025-07-01 00:10:49 +00:00
799fd88f41
Merge pull request #79 from readur/renovate/playwright-monorepo
...
chore(deps): update dependency @playwright/test to v1.53.2
2025-06-30 16:31:26 -07:00
c8fa0b2ac7
Merge pull request #80 from readur/renovate/reqwest-0.x-lockfile
...
fix(deps): update rust crate reqwest to v0.12.21
2025-06-30 16:31:16 -07:00
75e6594f1a
Merge pull request #76 from readur/feat/wrangle-ignored-files
...
feat(server/client): wrangle ignored files and failed files
2025-06-30 16:31:00 -07:00
dd90e48fd2
feat(server): mark documents with 0 words as failed, and fix webdav unit tests
2025-06-30 22:43:25 +00:00
bf073132a1
fix(tests): fix documents tests
2025-06-30 21:56:21 +00:00
72781aa7b9
fix(tests): update frontend tests for new FailedDocument view
2025-06-30 21:20:34 +00:00
3fca544011
fix(deps): update rust crate reqwest to v0.12.21
2025-06-30 20:13:56 +00:00
ccab01f489
Create codeql.yml
2025-06-30 13:12:28 -07:00
b344b69da7
feat(server): fix serialization issues
2025-06-30 19:40:05 +00:00
d9b695f0bd
feat(server/client): add metadata to file view
2025-06-30 19:13:16 +00:00
4d0af80971
chore(deps): update dependency @playwright/test to v1.53.2
2025-06-30 18:56:41 +00:00
bf98aaab85
feat(client): fix faileddocumentviewer
2025-06-30 00:59:34 +00:00
5f10a8b82c
feat(server): continue to try to wrangle the failed and ignored documents
2025-06-29 23:27:51 +00:00
d46a056cd7
chore(deps): update dependency vite to v7
2025-06-29 22:56:05 +00:00
879425c192
feat(client): rename FailedOcrPage to DocumentManagementPage
2025-06-29 21:48:44 +00:00
cf8b9444ee
feat(client): remove demo statement from frontend
2025-06-29 21:44:11 +00:00
929ea96e6f
Merge pull request #73 from readur/feat/better-failure-handling
...
feat(server/client): add failed_documents table to handle failures, a…
2025-06-28 23:03:23 -07:00
ed3acc0b88
fix(tests): fix ocr endpoint tests due to our endpoint change
2025-06-29 05:35:49 +00:00
68fb776f7b
fix(tests): fix ocr endpoint tests due to our endpoint change
2025-06-28 23:43:04 +00:00
fa7fd86622
fix(tests): fix ocr endpoint tests due to our endpoint change
2025-06-28 23:11:47 +00:00
2797cb4367
fix(tests): fix failing document integration test, again
2025-06-28 22:58:20 +00:00
660117ed9f
fix(tests): fix failing integration tests, again
2025-06-28 22:54:41 +00:00
28a7e4eb45
fix(tests): resolve a whole lot of test issues
2025-06-28 22:50:40 +00:00
perf3ct
renovate[bot]