25c717771c
Attempt to implement concurrent hash migrations
2023-07-15 14:37:17 -05:00
7768d4e58e
Add database exports
...
This should help admins running pict-rs on traditional filesystems to
keep valid backups of pict-rs' sled repo
2023-07-08 17:36:01 -05:00
4680f9c3aa
Instrument repo and store build methods
2023-07-08 10:42:03 -05:00
3ccb8ecd8c
Validate alias represents real file before setting not found
2023-07-07 13:33:27 -05:00
9e7376d411
Remove is_missing error, make Identifier and DeleteToken return Option on fetch
2023-07-07 13:17:26 -05:00
e7e4876908
Explicitly handle cases of invalid aliases
2023-07-05 16:46:44 -05:00
23e67b9697
Enhance migration handling of missing identifiers
...
Queue a cleanup task for hashes that don't have original file identifiers
Be more specific about what field is missing when a field is missing
2023-07-05 09:52:19 -05:00
01d3610f46
Add basic progress indication for store migration
2023-06-29 11:39:47 -05:00
554d852e68
Create unique errors for Repo and Store, separate from UploadError
...
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
2023-06-20 15:59:08 -05:00
281ac43dff
Remove cache functionality
2023-02-25 11:34:48 -06:00
0aa3f574a5
Clippy
2023-01-29 11:57:59 -06:00
f6d6d54b88
Update deps
2023-01-29 11:47:28 -06:00
f0f40db8c3
Add healthcheck for db
2023-01-29 11:36:09 -06:00
718f09c43a
Clean tracing, simplify validation, rename InputFormat -> VideoFormat
2022-10-01 21:17:18 -05:00
656b0225af
Clippy
2022-09-27 23:23:06 -05:00
29cab025c6
Improve 0.3 migration code, repo traces
2022-09-27 23:19:52 -05:00
9db057fdc5
Add admin endpoint to fetch identifier from an alias
2022-09-25 20:59:57 -05:00
c5b107eb4c
clippy
2022-09-11 10:04:37 -05:00
7f49af58fe
Update actix-form-data, impl Store & Repo for Data<T>
2022-09-10 19:29:22 -05:00
547934071a
Don't migrate from the old database if it doesn't exist
2022-08-14 11:49:20 -05:00
4ac20546ce
Improve migration from 0.3 formats
2022-04-24 17:10:15 -05:00
b3cbda1337
Add internal endpoint for cleaning variants
2022-04-11 16:56:39 -05:00
05e2cf5e08
Cache on Alias rather than Hash
...
Make sled repo blocking tasks share parent span
2022-04-06 12:14:12 -05:00
865f4ee09c
Caching works:
...
- Insert new bucket for current access time before removing
previous access time record.
- Add instrument to more methods for more precise tracing
2022-04-05 21:47:35 -05:00
6cdae7b318
Add 'cache' endpoint for ingesting ephemeral media
...
By default, cached media should only stick around for 7 days, however
The timeout is reset every time media is accessed, so only obscure
cached media will be flushed from the cache. This '7 days' number is
configurable through the commandline run options as --media-cache-duration
and in the pict-rs.toml file as [media] cache_duration
2022-04-05 20:29:30 -05:00
b0670c2f66
Move migrate to old
2022-04-03 15:07:31 -05:00
409b7d4c54
Remove unused conversions
2022-04-03 12:51:21 -05:00
8734dfbdc7
Add backgrounding routes
...
- Accept backgrounded uploads
- Allow backgrounded processing
Still TODO:
- Endpoint for waiting on/claiming an upload
2022-04-02 20:56:29 -05:00
c4d014597e
Better job recovery
2022-04-02 18:53:03 -05:00
77a400c7ca
Implement UploadRepo
2022-04-02 17:41:00 -05:00
09f53b9ce6
Move away from UploadManager to direct repo & store actions
2022-04-02 16:44:03 -05:00
6ed592c432
In Progress: process jobs
...
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
c0d8e0e8e3
Support multiple queues for job processor
2022-04-01 11:51:46 -05:00
602d1ea935
Begin implementing queue, put cleanups in it
2022-03-29 12:51:16 -05:00
eb5e39c634
Use color-eyre
2022-03-28 20:47:46 -05:00
3792a8923a
Finish redoing config probably
2022-03-27 23:27:07 -05:00
37e6b21b55
Fix Range, consolidate errors, test object storage
2022-03-26 20:45:12 -05:00
15b52ba6ec
Get it compiling again
2022-03-26 16:49:23 -05:00
323016f994
Build out migration path
2022-03-25 18:47:50 -05:00
750ce4782e
Rework configuration
2022-03-24 22:06:29 -05:00
d6567fbbbd
Implement sled repo
2022-03-24 17:09:15 -05:00
a0c99d05eb
Create initial trait representation for database
2022-03-24 13:16:41 -05:00
