Commit Graph

163 Commits

Author SHA1 Message Date
perfectra1n 9e143649d4 fix(upload): resolve issue with Axum not having config values set 2025-07-12 14:04:54 -07:00
perf3ct e16fd1d420 feat(server): rename queue-failed endpoint 2025-07-11 21:28:23 +00:00
perf3ct b31e1a672d feat(server): gracefully manage requeue requests for the same document 2025-07-11 21:27:12 +00:00
perf3ct 305c6f1fb1 feat(server): show source metadata EVEN better 2025-07-10 21:51:30 +00:00
perf3ct ea43f79a90 feat(server): show source metadata better, and implement tests 2025-07-10 21:40:16 +00:00
perf3ct 4521cc5ac6 feat(client): show new file metadata fields on the client 2025-07-10 21:07:35 +00:00
perf3ct 0465777890 feat(client): show more fields for Documents 2025-07-10 21:02:15 +00:00
perf3ct 96c47af2c0 feat(server/client): make sure that the documents endpoint isn't broken 2025-07-10 19:57:25 +00:00
perf3ct 438e79c441 fix(tests): no way, all the integration tests pass now 2025-07-10 01:38:55 +00:00
perf3ct 29800bdd1f fix(tests): resolve integration test response format 2025-07-09 20:10:36 +00:00
perf3ct 17f486a8b7 fix(server/client): rename document_id to id in DocumentUploadResponse, again 2025-07-09 01:40:50 +00:00
perf3ct 58b8a71404 fix(tests): and resolve missing endpoint 2025-07-08 04:37:33 +00:00
perf3ct a4b9626616 fix(web_upload): resolve issue that caused files that were uploaded via the web, to not be added to the queue 2025-07-07 19:28:08 +00:00
perf3ct b356017484 feat(server): implement better error checking for sources 2025-07-07 19:10:45 +00:00
perf3ct fbd7d561c3 fix(tests): binary and tests at least compile now 2025-07-04 19:07:53 +00:00
perf3ct 545046509f fix(server): fix axum groups 2025-07-04 03:07:28 +00:00
perf3ct 922478d995 fix(server): resolve compilation errors due to splitting up the large files 2025-07-04 03:06:29 +00:00
perf3ct 497b34ce0a fix(server): resolve type issues and functions for compilation issues 2025-07-04 00:53:32 +00:00
perf3ct 0e84993afa fix(server): resolve import issues 2025-07-03 23:58:11 +00:00
perf3ct f862df9a90 feat(dev): break up the large sources.rs file into smaller ones 2025-07-03 23:44:49 +00:00
perf3ct 3a7c8e8bda feat(dev): break up the large documents.rs file, again 2025-07-03 23:33:53 +00:00
perf3ct b9e0e5b905 feat(dev): also break up the large webdav_service.rs file into smaller ones 2025-07-03 19:57:31 +00:00
perf3ct 459b8622bb feat(webdav): also add some crazy source automatic validation 2025-07-03 05:26:36 +00:00
perf3ct 15b1f40cc1 feat(webdav): make sure to have scanned all subdirectories 2025-07-03 05:02:17 +00:00
perf3ct 2297eb8261 feat(webdav): also set up deep scanning button and fix unit tests 2025-07-03 04:24:26 +00:00
perf3ct 6d40feadb3 fix(server): resolve issues with the retry ocr tests 2025-07-02 22:47:51 +00:00
perf3ct ab03b8d73d fix(server): resolve ocr test functionality failing due to db trigger 2025-07-02 22:38:13 +00:00
perf3ct 8cea916abf feat(server): allow also completed documents to be retried 2025-07-02 18:15:41 +00:00
perf3ct 6bdd6f4a56 feat(server): implement DEBUG environment variable 2025-07-02 17:57:57 +00:00
perf3ct 68aa492a96 fix(server): resolve NUMERIC db type and f64 rust type 2025-07-02 02:26:11 +00:00
perf3ct d4b57d2ae0 feat(server/client): implement retry functionality for both successful and failed documents 2025-07-02 00:06:47 +00:00
perf3ct 6a23a407bf feat(client): update swagger ui endpoints 2025-07-01 20:54:45 +00:00
Jon Fuller 2e1a05fc8d Merge branch 'main' into feat/multiple-ocr-languages 2025-07-01 11:53:42 -07:00
perf3ct 231f88f038 feat(debug): debug page actually works and does something 2025-07-01 00:15:48 +00:00
perf3ct 9e43df2fbe feat(server/client): add metadata to file view 2025-06-30 19:13:16 +00:00
perf3ct fef28a33c6 feat(server): continue to try to wrangle the failed and ignored documents 2025-06-29 23:27:51 +00:00
perf3ct 6b6890d529 feat(server/client): support multiple OCR languages 2025-06-29 22:51:06 +00:00
perf3ct 84577806ef feat(server/client): add failed_documents table to handle failures, and move logic of failures 2025-06-28 20:52:58 +00:00
Jon Fuller fce56b660b Merge pull request #72 from readur/feat/better-db-tests
feat(tests): add regression tests and better sql type safety tests
2025-06-28 12:43:52 -07:00
perf3ct f4adafe2bd feat(tests): add regression tests and better sql type safety tests 2025-06-28 19:25:15 +00:00
perf3ct 9be70dc245 feat(swagger): add missing oidc endpoints into swagger ui 2025-06-28 19:19:48 +00:00
perf3ct 099f4853a7 fix(server): resolve incorrect db type 2025-06-28 18:41:48 +00:00
perf3ct fe1deb1e9d fix(server): resolve compilation issues from queue.rs 2025-06-28 18:15:55 +00:00
perf3ct 2d04f0094a fix(ocr_status): populate the ocr queue with pending jobs and add easy 'retry' button 2025-06-28 18:08:00 +00:00
Jon Fuller 5aae560d7e Merge pull request #69 from readur/fix/ocr-confidence-1
fix(server/client): fix incorrect OCR measurements
2025-06-28 09:53:56 -07:00
perfectra1n 582617ab88 fix(server/client): fix incorrect OCR measurements 2025-06-27 20:23:59 -07:00
perf3ct 0b8dbfb8d9 feat(server/client): easily undelete ignored files, if the user wishes to do so 2025-06-28 00:37:49 +00:00
Jon Fuller 929f27eaa9 Merge branch 'main' into feat/delete-low-confidence-documents 2025-06-27 15:17:50 -07:00
perf3ct aacfc96825 feat(server/client): implement button deleting low confidence documents (e.g. documents that have no text) 2025-06-27 22:16:38 +00:00
perf3ct a75fca0c28 feat(client/server): add a new badge for each source that shows the number of documents stored from each source 2025-06-27 21:32:50 +00:00
perf3ct 9a8bf72ff7 feat(server): reorganize components into their own modules and fix imports 2025-06-27 18:27:42 +00:00
Jon Fuller b095cb951f Merge pull request #55 from readur/feat/oidc-setup
feat(server): set up oidc system and migrations
2025-06-27 10:48:28 -07:00
perf3ct 3c5b7c7dfb feat(oidc): fix oidc, tests, and everything in between 2025-06-27 05:03:27 +00:00
perf3ct 51907f81f2 fix(metrics): fix broken prometheus metrics 2025-06-26 22:14:42 +00:00
perf3ct e626f3a131 feat(metrics): add more prometheus metrics, and create grafana dashboard 2025-06-26 21:14:00 +00:00
perf3ct e9496b921e feat(server): set up oidc system and migrations 2025-06-26 18:52:57 +00:00
perf3ct 715b94ec66 feat(swagger): add a ton of docstrings to functions 2025-06-25 23:58:37 +00:00
perf3ct 05a1a07494 fix(server): also fix these broken user isolation SQL statements 2025-06-24 17:43:58 +00:00
perf3ct 363bc2b9ef fix(server): better error responses when creating users 2025-06-24 17:33:59 +00:00
perf3ct 3f3654c3cb fix(server): resolve lack of user isolation 2025-06-24 17:28:28 +00:00
perf3ct a0e75d4619 feat(server/client): implement feature of ignoring already deleted files, and add failed OCR queue tests 2025-06-24 17:20:33 +00:00
perf3ct 1555b8bd4d feat(tests): resolve admin integration test issues 2025-06-22 17:28:45 +00:00
perf3ct 4ec4ecaa8d feat(ci): fix other tests, part 9000 2025-06-21 18:08:34 +00:00
perf3ct 8ae976eda8 feat(tests): resolve failing and ignored tests 2025-06-20 18:37:52 +00:00
perf3ct 2c2d948aa2 fix(documents): remove old code in favor of document ingestion engine 2025-06-20 17:18:00 +00:00
perf3ct eec1072677 Merge branch 'main' into feat/document-deletion 2025-06-20 17:11:26 +00:00
perf3ct c4a9c51b98 feat(ingestion): have everything use the document ingestion engine 2025-06-20 16:53:06 +00:00
perf3ct ac069de5bc feat(ingestion): create ingestion engine to handle document creation, and centralize deduplication logic 2025-06-20 16:24:26 +00:00
aaldebs99 1507532083 feat(everything): Add document deletion 2025-06-20 03:49:16 +00:00
aaldebs99 b24bf2c7d9 Merge branch 'main' into feat/document-labels 2025-06-19 18:40:50 -07:00
aaldebs99 4dd9162415 fix(frontend): label writing and fetching logic 2025-06-20 01:32:32 +00:00
aaldebs99 aeb98acea8 fi(backend): migrate python code to rust lol 2025-06-20 01:32:05 +00:00
perf3ct 7f20e59aa6 feat(tests): resolve issue with 'source' tests 2025-06-19 20:29:35 +00:00
aaldebs99 bfb971adce fix(backend): lables handling 2025-06-19 19:47:49 +00:00
aaldebs99 2d518b40df fix(backend): labels 2025-06-19 18:58:00 +00:00
perf3ct d055e9f350 feat(server/client): implement labels for documents 2025-06-18 16:12:42 +00:00
perf3ct 80d58b0f28 feat(server/client): implement updated FailedOcrPage, duplicate management, and file hashing 2025-06-17 16:17:23 +00:00
perf3ct 58aaedf4a6 feat(server): add hash for documents 2025-06-17 15:41:42 +00:00
perf3ct b2a7faaddb feat(server): create specific endpoint for fetching documents, fix client being served again 2025-06-17 04:05:57 +00:00
perf3ct 7eb036b153 feat(client/server): create endpoint for fetching individual files, and fix client not serving files 2025-06-17 03:38:16 +00:00
perf3ct 479c62a4f1 feat(client/server): advanced search, along with fixing build errors 2025-06-17 02:56:59 +00:00
perf3ct 4dda4d143d feat(client/server): implement a much better search 2025-06-17 02:41:16 +00:00
perf3ct 13e60fa655 feat(server): if there's no sync even running, allow sync to be cancelled 2025-06-16 21:39:41 +00:00
perf3ct af7129da0a feat(server/client): fix thumbnails and quick search 2025-06-16 17:40:53 +00:00
perf3ct fe56ecdb00 feat(server): implement queue system for ocr process as well, to fight resource exhaustion 2025-06-16 01:20:13 +00:00
perf3ct 5b88c92937 feat(server/client): add pagination in client, resolve race condition in server 2025-06-15 21:48:59 +00:00
perf3ct b21f2684bc feat(server/client): add lots of OCR tweaks 2025-06-15 21:24:06 +00:00
perf3ct a39fc807fa feat(server): fix the sync scheduler for sources 2025-06-15 18:05:56 +00:00
perf3ct cebae12363 feat(client): also show settings for s3 and local sources in the client 2025-06-15 18:00:35 +00:00
perf3ct 11c68c3d9f feat(client): also update sources page and the various buttons 2025-06-15 17:06:38 +00:00
perf3ct 317590f9c3 feat(server): create 'sources' concept and move WebDAV settings page to it 2025-06-15 16:12:18 +00:00
perf3ct 8ebffe4aa3 feat(db): try to improve db queue and number of connections 2025-06-15 05:04:48 +00:00
perf3ct a8baa671ec feat(server): I feel like I'm going to have to come back and fix this later 2025-06-15 04:58:22 +00:00
perf3ct 7feec817d0 feat(server): fix recursively scanning the uploads folder, and the quick search bar 2025-06-15 04:37:49 +00:00
perf3ct 0ae562f4c3 feat(server): fix breaking changes in deps, take 2 2025-06-15 04:08:34 +00:00
perf3ct cfc6c85261 feat(server): upgrade all versions and resolve breaking changes 2025-06-15 02:23:35 +00:00
perf3ct d21e51436b feat(server): rewrite nearly everything to be async/follow best practices 2025-06-15 02:06:17 +00:00
perf3ct 9e877e7aa1 feat(server): webdav download and ocr actually works 2025-06-15 01:12:01 +00:00
perf3ct 5b67232266 feat(server): webdav integration nearly done 2025-06-14 16:14:41 +00:00
perf3ct 57c118c049 feat(server): implement notifications and webdav 2025-06-14 01:34:56 +00:00