Commit Graph

199 Commits

Author SHA1 Message Date
perf3ct 472106a0f6
feat(server): normalize etags from webdav to properly check for file changes 2025-06-23 19:03:24 +00:00
perf3ct 6834e11542
fix(tests): also fix unit tests 2025-06-22 21:31:11 +00:00
perf3ct e78a353751
feat(tests): resolve admin integration test issues 2025-06-22 17:28:45 +00:00
perf3ct 1cb5341c4e
feat(ci): fix other tests, part 9000 2025-06-21 18:08:34 +00:00
perf3ct 74c9c87906
fix(deletion): properly handle concurrent deletion requests 2025-06-20 18:40:24 +00:00
perf3ct ecf5a0ea50
feat(tests): resolve failing and ignored tests 2025-06-20 18:37:52 +00:00
perf3ct c1b3832ad1
fix(tests): repair the label tests 2025-06-20 18:10:27 +00:00
perf3ct 7b5914f972
fix(documents): remove old code in favor of document ingestion engine 2025-06-20 17:18:00 +00:00
perf3ct 5aaf90ba20
Merge branch 'main' into feat/document-deletion 2025-06-20 17:11:26 +00:00
perf3ct a58c3abefc
feat(ingestion): have everything use the document ingestion engine 2025-06-20 16:53:06 +00:00
perf3ct df8eeba2c2
feat(ingestion): create ingestion engine to handle document creation, and centralize deduplication logic 2025-06-20 16:24:26 +00:00
aaldebs99 597707f870 feat(tests): add deletion unit tests 2025-06-20 16:09:27 +00:00
aaldebs99 a5ebbd59bd feat(everything): Add document deletion 2025-06-20 03:49:16 +00:00
aaldebs99 ec497a4a08
Merge branch 'main' into feat/document-labels 2025-06-19 18:40:50 -07:00
aaldebs99 3ecc82dfdf fix(frontend): label writing and fetching logic 2025-06-20 01:32:32 +00:00
aaldebs99 e7b47b7d61 fi(backend): migrate python code to rust lol 2025-06-20 01:32:05 +00:00
perf3ct 741fcc2826
feat(tests): resolve issue with 'source' tests 2025-06-19 20:29:35 +00:00
aaldebs99 0e19ba3ea9 fix(backend): lables handling 2025-06-19 19:47:49 +00:00
aaldebs99 5de7f03a3e fix(backend): labels 2025-06-19 18:58:00 +00:00
Jon Fuller ae5a860065
Merge branch 'main' into feat/document-labels 2025-06-19 11:32:03 -07:00
aaldebs99 3cf1b8cd73 fix(server): static file routes 2025-06-19 18:29:52 +00:00
Jon Fuller a335af6fff
Merge branch 'main' into feat/document-labels 2025-06-18 19:07:54 -07:00
aaldebs99 6942da2b20 chore(server): remove unused system user 2025-06-19 00:41:01 +00:00
perf3ct 4a54b0a8b7
feat(server/client): implement labels for documents 2025-06-18 16:12:42 +00:00
perf3ct 4c946ca9cc
feat(tests): resolve last test issues 2025-06-17 22:14:38 +00:00
perf3ct 261d71c5ae
feat(tests): fix the vast majority of both server and client tests 2025-06-17 22:06:12 +00:00
perf3ct 21b868a2e4
feat(tests): add actual images as part of e2e and testing 2025-06-17 21:26:39 +00:00
perf3ct 309a61bcd4
feat(client): update failedOcr page for duplicates 2025-06-17 16:52:45 +00:00
perf3ct bdb136d615
feat(server/client): implement updated FailedOcrPage, duplicate management, and file hashing 2025-06-17 16:17:23 +00:00
perf3ct 75747016f0
feat(server): add hash for documents 2025-06-17 15:41:42 +00:00
perf3ct d84193f444
fix(ocr_queue): don't slam the DB while we wait 2025-06-17 14:45:44 +00:00
perf3ct d7607923be
feat(server): create specific endpoint for fetching documents, fix client being served again 2025-06-17 04:05:57 +00:00
perf3ct f0f90d71de
feat(client/server): create endpoint for fetching individual files, and fix client not serving files 2025-06-17 03:38:16 +00:00
perf3ct 3ae542088b
feat(client/server): advanced search, along with fixing build errors 2025-06-17 02:56:59 +00:00
perf3ct 76529f83be
feat(client/server): implement a much better search 2025-06-17 02:41:16 +00:00
perf3ct 98a4b7479b
feat(server/client): remove webdav feature from user's settings as it's in sources now 2025-06-17 01:57:56 +00:00
perf3ct 8de1e153a1
feat(server): stop image preprocessing in OCR 2025-06-17 00:35:03 +00:00
perf3ct e6ab56daa8
feat(server): break up large db.rs file into multiple files, and add more PDF guardrails 2025-06-17 00:25:21 +00:00
perf3ct 27c38bf0fe
feat(server): try to resume syncs after server restart 2025-06-16 23:21:43 +00:00
perf3ct a47960a059
feat(server): also generate thumbnails for non-images, and resolve failing unit/integration tests 2025-06-16 22:51:29 +00:00
perf3ct abdea3226f
feat(server): put more guardrails around PDF OCR size, and image size OCR 2025-06-16 22:39:00 +00:00
perf3ct b9f2014509
feat(server): if there's no sync even running, allow sync to be cancelled 2025-06-16 21:39:41 +00:00
perf3ct 0ccceb768a
feat(server): create folders within 'upload' path to manage thumbnails, processed images, etc. 2025-06-16 21:24:46 +00:00
perf3ct 6f3aa771c0
feat(server/client): fix thumbnails and quick search 2025-06-16 17:40:53 +00:00
perf3ct d51f2793e9
feat(server/client): update function used to display singular documents 2025-06-16 17:10:55 +00:00
perf3ct e33240a811
feat(server): implement queue system for ocr process as well, to fight resource exhaustion 2025-06-16 01:20:13 +00:00
perf3ct 91b16de082
feat(server): create more DB guardrails, and lots of missing tests 2025-06-15 22:14:02 +00:00
perf3ct a7cf67f90d
feat(server/client): add pagination in client, resolve race condition in server 2025-06-15 21:48:59 +00:00
perf3ct 42bc72ded4
feat(server/client): add lots of OCR tweaks 2025-06-15 21:24:06 +00:00
perf3ct 0cc77ed8ac
feat(server): fix the sync scheduler for sources 2025-06-15 18:05:56 +00:00
perf3ct 6004f3a001
feat(client): also show settings for s3 and local sources in the client 2025-06-15 18:00:35 +00:00
perf3ct ea8ad2c262
feat(server/client): working s3 and local source types 2025-06-15 17:51:04 +00:00
perf3ct df51e61d06
feat(client): also update sources page and the various buttons 2025-06-15 17:06:38 +00:00
perf3ct 41774056c7
feat(async): create dedicated pools + runtime isolation for OCR 2025-06-15 16:47:55 +00:00
perf3ct 853c9b7c2e
feat(async): create dedicated threads for ocr_runtime 2025-06-15 16:38:27 +00:00
perf3ct 0f14b5c8e7
feat(server): upgrade WebDAV settings on Sources page 2025-06-15 16:31:58 +00:00
perf3ct 59e5356a25
feat(server): create 'sources' concept and move WebDAV settings page to it 2025-06-15 16:12:18 +00:00
perf3ct 691c5e6bb8
feat(db): try to improve db queue and number of connections 2025-06-15 05:04:48 +00:00
perf3ct 6898d85981
feat(server): I feel like I'm going to have to come back and fix this later 2025-06-15 04:58:22 +00:00
perf3ct 4aa3d77e40
feat(server): fix recursively scanning the uploads folder, and the quick search bar 2025-06-15 04:37:49 +00:00
perf3ct 99521b4ca0
feat(server): fix breaking changes in deps, take 2 2025-06-15 04:08:34 +00:00
perf3ct f8853ce6a6
feat(server): upgrade all versions and resolve breaking changes 2025-06-15 02:23:35 +00:00
perf3ct e8dd7a788e
feat(server): rewrite nearly everything to be async/follow best practices 2025-06-15 02:06:17 +00:00
perf3ct f2136cbd7b
feat(server): webdav download and ocr actually works 2025-06-15 01:12:01 +00:00
perf3ct 9e1acbf1b5
feat(server): fix migration not working 2025-06-14 22:57:43 +00:00
perf3ct 9fa45f8891 feat(server): implement better ocr failure and guardrails 2025-06-14 22:13:04 +00:00
perf3ct aa45cd06e0 feat(server): webdav integration nearly done 2025-06-14 16:21:28 +00:00
perf3ct 5b67232266 feat(server): webdav integration nearly done 2025-06-14 16:14:41 +00:00
perf3ct 57c118c049 feat(server): implement notifications and webdav 2025-06-14 01:34:56 +00:00
perf3ct f7874f4541 feat(docs): clean up docs and make dev ex easier with variables 2025-06-13 23:21:45 +00:00
perf3ct 63b322ac7a feat(server): add role capability, and fix tests 2025-06-13 20:58:36 +00:00
perf3ct afd01e6075 fix(server): at least the watch folder doesn't blow up now 2025-06-13 20:11:22 +00:00
perf3ct c7a0c25c23 fix(server): update some integration tests and create 'system' user 2025-06-13 19:56:25 +00:00
perf3ct e672613d50 feat(client): refreshing the page no longer returns a 404 2025-06-13 19:22:57 +00:00
perf3ct e3f1855711 feat(client/server): add nextcloud/webdav capability, add integration tests 2025-06-13 17:09:05 +00:00
perf3ct 57c6b370d2 feat(client): convert frontend to ts 2025-06-13 16:16:23 +00:00
perf3ct 725105d62f feat(migrations): add missing migrations and fix metrics endpoint 2025-06-13 15:55:30 +00:00
perf3ct 00b2bfe22c feat(server/client): the /documents endpoint works again, and so does the watch folder...kinda 2025-06-13 15:53:19 +00:00
perf3ct e6e2ba76f5 feat(ocr): fix ocr variables 2025-06-13 15:24:25 +00:00
perf3ct cd35f877b1 feat(migrations): try to fix the migrations service 2025-06-13 15:14:13 +00:00
perf3ct e1e949cf65 feat(migrations): try to fix the migrations service 2025-06-13 14:27:31 +00:00
perf3ct e61db1036e feat(migrations): try to fix the migrations service 2025-06-13 14:19:45 +00:00
perfectra1n 3dcf753ff3 feat(migrations): improve migrations and split large SQL statements into smaller ones 2025-06-12 22:27:04 -07:00
perfectra1n 16a0a6ce5c feat(migrations): improve migrations and split large SQL statements into smaller ones 2025-06-12 22:16:54 -07:00
perfectra1n d61b1c3f4b feat(server): implement ocr enhanced service throughout 2025-06-12 22:12:50 -07:00
perfectra1n d5f419ca18 feat(client/server): update search tests, and upgrade OCR 2025-06-12 22:02:26 -07:00
perfectra1n 1a1f886f04 feat(client/server): update search tests, and upgrade OCR 2025-06-12 22:00:14 -07:00
perfectra1n 1f50004d66 feat(client/server): add swagger-ui, improve search bar 2025-06-12 21:46:41 -07:00
perfectra1n 0abc8f272a feat(client): update the search functionality 2025-06-12 21:31:46 -07:00
perf3ct 52d006d403 feat(unit): fixed the unit tests 2025-06-13 01:32:47 +00:00
perf3ct 0bb84a9b98 feat(server): make environment variables a first class citizen 2025-06-12 23:22:22 +00:00
perf3ct eb70964254 feat(server): improve queue system 2025-06-12 23:15:12 +00:00
perf3ct 90599eed74 feat(server): implement queue system 2025-06-12 20:34:51 +00:00
perf3ct 3ba0dd1c14 feat(server): improve settings page and settings 2025-06-12 18:49:08 +00:00
perfectra1n 5814cfec6d feat(client): add search tests 2025-06-11 22:17:52 -07:00
perfectra1n e03e9daeed feat(client/server): search works again, maybe only works after restart? 2025-06-11 22:10:02 -07:00
perfectra1n aa8af7e018 feat(server/client): also update the tests and settings pages 2025-06-11 21:58:25 -07:00
perf3ct 488003c426 fix(everything): wow, it runs 2025-06-12 00:05:43 +00:00
perf3ct b88774272d Initial commit to setup repo via Fish 2025-06-11 23:04:21 +00:00