175b0f962a
Use off-the-shelf object storage library
...
This library bundles its own reqwest client unfortunately
2024-06-24 14:19:36 -05:00
58529a2eb2
Update reqwest to 0.12
...
This pulls in hyper 1 and http 1, but removes rustls 0.21
2024-05-01 14:46:29 -05:00
4976fcb2eb
Remove unneeded code
2024-03-09 22:53:46 -06:00
aa4582a3f8
Remove unused store method
2024-03-09 15:38:39 -06:00
04dcc9a0c8
Include file extension in identifiers
2024-02-27 20:41:25 -06:00
7c6112e631
ffprobe: read from file, simplify input-file access
2024-02-25 13:05:47 -06:00
16bf18bda4
Remove some Unpin and 'static bounds
2024-02-22 18:05:04 -06:00
3a7d5b7bfb
Re-use try_from_stream where possible
2024-02-22 16:10:34 -06:00
f6087d65be
Use async fn in trait for Store
2024-01-15 15:51:20 -05:00
bfc2410552
Add trace-level logs to every loop (paranoid)
2023-12-28 11:58:38 -06:00
b452a577a7
Add object ID to not found error
2023-12-11 13:05:29 -06:00
d28c1ac628
Upgrade Concurrency: Update docs, configs, limit maxiumum details operations
2023-10-03 17:04:40 -05:00
a4b1ab7dfb
Instrument postgres db calls
2023-09-04 21:51:27 -05:00
8921f57a21
Remove Identifier trait, Replace with Arc<str>
2023-09-02 18:38:02 -05:00
ba3a23ed43
Add error codes
2023-09-01 20:51:01 -05:00
8f50a15b25
Reduce reliance on futures-util
2023-08-23 11:59:42 -05:00
1ee77b19d8
Make Repo object safe. Create migration
2023-08-15 19:19:03 -05:00
35d0c065e9
Start work on 0.5 db format - initial queuerepo changes
2023-08-13 14:12:38 -05:00
4d78ce7689
Fix store delegation for public_url
2023-07-14 15:23:07 -05:00
786f583d98
Add public_url to Store for optional redirects to public object store urls
...
Add details generation to file migration to set the content-type for uploads
2023-07-14 14:53:37 -05:00
9e7376d411
Remove is_missing error, make Identifier and DeleteToken return Option on fetch
2023-07-07 13:17:26 -05:00
7274538b70
Try adding store healthcheck
2023-07-07 12:05:42 -05:00
23e67b9697
Enhance migration handling of missing identifiers
...
Queue a cleanup task for hashes that don't have original file identifiers
Be more specific about what field is missing when a field is missing
2023-07-05 09:52:19 -05:00
c8e84b8914
Greatly improve error information during migration
2023-07-02 21:07:15 -05:00
a1d48cbb42
Share client between object store and request extractor
...
Add config to limit connection pool size
2023-06-23 11:20:20 -05:00
554d852e68
Create unique errors for Repo and Store, separate from UploadError
...
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
2023-06-20 15:59:08 -05:00
9db057fdc5
Add admin endpoint to fetch identifier from an alias
2022-09-25 20:59:57 -05:00
25209e29c0
Make it compile
2022-09-24 17:18:53 -05:00
ff1771e016
More migration work for rusty-s3
2022-09-24 14:18:49 -05:00
c5b107eb4c
clippy
2022-09-11 10:04:37 -05:00
7f49af58fe
Update actix-form-data, impl Store & Repo for Data<T>
2022-09-10 19:29:22 -05:00
6ed592c432
In Progress: process jobs
...
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
37e6b21b55
Fix Range, consolidate errors, test object storage
2022-03-26 20:45:12 -05:00
15b52ba6ec
Get it compiling again
2022-03-26 16:49:23 -05:00
323016f994
Build out migration path
2022-03-25 18:47:50 -05:00
0d153ca239
Make stores take filename into account when saving files
2021-11-16 09:45:16 -06:00
cf50da30ec
Use rust-s3 fork with asyncwrite support
2021-10-31 12:35:11 -05:00
f9f4fc63d6
Optionally support s3-compatible storage (untested)
2021-10-27 23:06:03 -05:00
48557bc2ea
Make pict-rs generic over file storage
2021-10-22 23:48:56 -05:00
