Commit Graph

633 Commits

Author SHA1 Message Date
perf3ct 42c7edd9df
feat(webdav): gracefully recover webdav from stops/crashes 2025-07-03 04:45:25 +00:00
perf3ct 915fe92993
feat(webdav): also set up deep scanning button and fix unit tests 2025-07-03 04:24:26 +00:00
Jon Fuller 4dbd89b81b
Merge pull request #93 from readur/feat/webdav-smart-scanning-functionality
feat(webdav): smart scanning functionality
2025-07-02 17:34:13 -07:00
perf3ct 252d99fb90
feat(webdav): create test for this new smart scan 2025-07-03 00:32:47 +00:00
perf3ct e23a0e4c63
feat(webdav): directory etag smart checking and all that 2025-07-03 00:26:56 +00:00
perf3ct 0ef233c3cc
fix(tests): resolve compilation error in tests and source scheduler 2025-07-02 23:49:46 +00:00
Jon Fuller 1a6efeacc5
Merge pull request #92 from readur/fix/webdav-subdirectory-fix1
fix(webdav): fix subdirectories not being found
2025-07-02 16:39:36 -07:00
perf3ct 9a84da9a3a
fix(docs): don't need that file 2025-07-02 23:37:59 +00:00
perf3ct edcf2be71b
fix(webdav): resolve issue with webdav subdirectories not being discovered 2025-07-02 23:37:39 +00:00
Jon Fuller 2818db0fe2
Merge pull request #91 from readur/fix/ocr-reset-functionality-fix1
fix(server): resolve ocr test functionality failing due to db trigger
2025-07-02 16:18:04 -07:00
perf3ct 1c131d8fc3
fix(tests): resolve silly new ocr retry tests 2025-07-02 22:51:09 +00:00
perf3ct f1fc2a0105
fix(server): resolve issues with the retry ocr tests 2025-07-02 22:47:51 +00:00
Jon Fuller e25821da82
Merge pull request #90 from readur/renovate/aws-sdk-rust-monorepo
fix(deps): update rust crate aws-sdk-s3 to v1.96.0
2025-07-02 15:45:47 -07:00
perf3ct bfef816848
fix(server): resolve ocr test functionality failing due to db trigger 2025-07-02 22:38:13 +00:00
renovate[bot] c524bbac92
fix(deps): update rust crate aws-sdk-s3 to v1.96.0 2025-07-02 22:07:39 +00:00
Jon Fuller f4519bb3ee
Merge pull request #89 from readur/feat/setup-debug-functionality
feat(debug): setup debug functionality
2025-07-02 15:06:16 -07:00
perf3ct 4f0497ba74
feat(tests): fix ocr_retry issues in tests 2025-07-02 21:48:01 +00:00
perf3ct dec4551fbd
feat(tests): fix ocr_retry issues in tests 2025-07-02 21:30:36 +00:00
perf3ct 86904205ed
feat(tests): fix ocr_retry issues in tests 2025-07-02 19:16:13 +00:00
perf3ct e15aa801c6
feat(tests): fix ocr_retry issues in tests 2025-07-02 18:48:26 +00:00
perf3ct 50e3f42484
feat(client): impelement retry all button on Document Management page 2025-07-02 18:26:22 +00:00
perf3ct dd963d0ecc
feat(server): allow also completed documents to be retried 2025-07-02 18:15:41 +00:00
perf3ct 8ed8701d5b
feat(server): implement DEBUG environment variable 2025-07-02 17:57:57 +00:00
Jon Fuller 09dab5c8c7
Merge pull request #87 from readur/feat/retry-functionality
feat(server/client): implement retry functionality for both successfu…
2025-07-02 09:57:54 -07:00
Jon Fuller f1bec120ea
Merge pull request #78 from readur/renovate/material-ui-monorepo
fix(deps): update material-ui monorepo to v7.2.0
2025-07-02 09:45:41 -07:00
perf3ct 34dc9a38b8
fix(tests): resolve broken integration test for ocr retry, and fix frontend tests 2025-07-02 16:39:41 +00:00
renovate[bot] 32e804043c
fix(deps): update material-ui monorepo to v7.2.0 2025-07-02 16:25:47 +00:00
Jon Fuller 90e186d49c
Merge pull request #88 from readur/renovate/tokio-1.x-lockfile
fix(deps): update rust crate tokio to v1.46.0
2025-07-02 09:24:31 -07:00
renovate[bot] adcc5101bb
fix(deps): update rust crate tokio to v1.46.0 2025-07-02 12:12:50 +00:00
perf3ct dadd1c3c0e
fix(server/client): try to resolve more tests for the new retry functionality 2025-07-02 04:52:44 +00:00
perf3ct 2d702f1c07
fix(server): resolve test for retry issues 2025-07-02 03:22:41 +00:00
perf3ct 0f3cb12c7a
fix(server): resolve NUMERIC db type and f64 rust type 2025-07-02 02:26:11 +00:00
perf3ct d6c0f412b5
feat(tests): create unit tests for retry 2025-07-02 02:13:58 +00:00
perf3ct 4e8c96a518
fix(client): resolve incorrect import on documentService 2025-07-02 00:21:36 +00:00
perf3ct c878a5a860
fix(tests): resolve broken frontend tests due to retry functionality 2025-07-02 00:18:21 +00:00
Jon Fuller 4975549e5f
Merge pull request #86 from readur/renovate/aws-sdk-rust-monorepo
fix(deps): update rust crate aws-sdk-s3 to v1.95.0
2025-07-01 17:14:35 -07:00
perf3ct 6af9e5e4a0
fix(tests): resolve using test config in ocr retry tests 2025-07-02 00:14:19 +00:00
perf3ct e4faf2cfd2
feat(server/client): implement retry functionality for both successful and failed documents 2025-07-02 00:06:47 +00:00
renovate[bot] 57b1d921a6
fix(deps): update rust crate aws-sdk-s3 to v1.95.0 2025-07-01 22:42:54 +00:00
Jon Fuller 6f16ddc207
Merge pull request #85 from readur/feat/greatly-improve-webdav-1
feat(webdav): track directory etags
2025-07-01 15:41:21 -07:00
perf3ct c766ecc52e
fix(tests): resolve broken test compilation 2025-07-01 22:14:53 +00:00
perf3ct c242a84326
feat(webdav): also fix the parser to include directories, and add tests 2025-07-01 22:03:06 +00:00
perf3ct 590cad3197
feat(tests): add unit tests for new webdav functionality 2025-07-01 21:39:31 +00:00
Jon Fuller aa3d0c3b72
Merge pull request #39 from readur/renovate/vite-7.x
chore(deps): update dependency vite to v7
2025-07-01 14:24:22 -07:00
Jon Fuller 4a7e79540b
Merge pull request #83 from readur/renovate/reqwest-0.x-lockfile
fix(deps): update rust crate reqwest to v0.12.22
2025-07-01 14:24:13 -07:00
Jon Fuller 73e5c20747
Merge pull request #84 from readur/renovate/aws-sdk-rust-monorepo
fix(deps): update rust crate aws-config to v1.8.1
2025-07-01 14:24:03 -07:00
perf3ct fdc240fa5b
feat(webdav): track directory etags
✅ Core Optimizations Implemented

  1. 📊 New Database Schema: Added webdav_directories table to track
directory ETags, file counts, and metadata
  2. 🔍 Smart Directory Checking: Before deep scans, check directory
ETags with lightweight Depth: 0 PROPFIND requests
  3. ΓÜí Skip Unchanged Directories: If directory ETag matches, skip the
entire deep scan
  4. 🗂️ N-Depth Subdirectory Tracking: Recursively track all
subdirectories found during scans
  5. 🎯 Individual Subdirectory Checks: When parent unchanged, check
each known subdirectory individually

  🚀 Performance Benefits

  Before: Every sync = Full Depth: infinity scan of entire directory
treeAfter:
  - First sync: Full scan + directory tracking setup
  - Subsequent syncs: Quick ETag checks → skip unchanged directories
entirely
  - Changed directories: Only scan the specific changed subdirectories

  📁 How It Works

  1. Initial Request: PROPFIND Depth: 0 on /Documents → get directory
ETag
  2. Database Check: Compare with stored ETag for /Documents
  3. If Unchanged: Check each known subdirectory (/Documents/2024,
/Documents/Archive) individually
  4. If Changed: Full recursive scan + update all directory tracking
data
2025-07-01 21:22:16 +00:00
renovate[bot] 9234323f9c
fix(deps): update rust crate aws-config to v1.8.1 2025-07-01 20:56:42 +00:00
Jon Fuller 1e655be542
Merge pull request #82 from readur/feat/merge-document-management-tabs
feat(client): combine the low confidence ocr tab with the bulk cleanup…
2025-07-01 13:55:10 -07:00
perf3ct a2ea446e16
feat(client): update swagger ui endpoints 2025-07-01 20:54:45 +00:00