2
0
Fork 0
mirror of https://git.asonix.dog/asonix/pict-rs synced 2024-11-10 14:34:57 +00:00
Commit graph

153 commits

Author SHA1 Message Date
4a45aa889c Enable running on bare tokio 2023-10-07 11:48:58 -05:00
735fcd1b49 Remove dependency on actix-web-codegen 2023-09-24 15:52:31 -05:00
745e990fa0 Remove direct dependency on actix-rt and actix-server 2023-09-24 15:45:10 -05:00
ce0df080f4 Add prometheus metrics 2023-07-22 16:47:59 -05:00
a390b21df1 Make running pict-rs fluent 2023-07-22 12:39:39 -05:00
3ca994ee31 Replace global config with passed-around config
This will enable spinning up pict-rs multiple times in the same process with different configurations
2023-07-22 12:31:01 -05:00
2c1a37fb62 Extract pict-rs as library 2022-12-23 12:56:15 -06:00
669b3fb86f Fix webp metadata stripping, more tracing cleanup 2022-10-01 22:47:52 -05:00
718f09c43a Clean tracing, simplify validation, rename InputFormat -> VideoFormat 2022-10-01 21:17:18 -05:00
0307dc5a3b Introduce BytesStream to simplify aggregating, forwarding bytes 2022-10-01 12:06:33 -05:00
8eb2293808 Enable selecting video and audio codecs for uploaded media 2022-09-30 19:38:11 -05:00
656b0225af Clippy 2022-09-27 23:23:06 -05:00
9db057fdc5 Add admin endpoint to fetch identifier from an alias 2022-09-25 20:59:57 -05:00
25209e29c0 Make it compile 2022-09-24 17:18:53 -05:00
ff1771e016 More migration work for rusty-s3 2022-09-24 14:18:49 -05:00
ab7fd9aaf7 Start work on using rusty-s3 instead of rust-s3 2022-09-24 13:39:27 -05:00
7f49af58fe Update actix-form-data, impl Store & Repo for Data<T> 2022-09-10 19:29:22 -05:00
e0543b2c1c Add HEAD endpoints for process, serve 2022-07-17 11:15:43 -05:00
cb9a594f24 Fix content type on already processed images 2022-06-21 11:27:22 -05:00
8ee26ccf4f change some import paths 2022-04-27 20:13:49 -05:00
4ac20546ce Improve migration from 0.3 formats 2022-04-24 17:10:15 -05:00
b3cbda1337 Add internal endpoint for cleaning variants 2022-04-11 16:56:39 -05:00
7436f15267 Dry download client logic 2022-04-08 13:16:22 -05:00
5f19b63166 Extract details processing 2022-04-08 13:03:00 -05:00
31c5a36c77 Better instrument drops, jobs. Properly disarm backgrounded downloads 2022-04-08 12:51:33 -05:00
55d5e43cd2 Consolidate endpoints for downloading media, cached or backgrounded 2022-04-08 12:05:14 -05:00
07c61cbe87 Add download backgrounded 2022-04-07 19:07:30 -05:00
e493e90dd4 Defensive tracing 2022-04-07 12:56:40 -05:00
6cdae7b318 Add 'cache' endpoint for ingesting ephemeral media
By default, cached media should only stick around for 7 days, however
The timeout is reset every time media is accessed, so only obscure
cached media will be flushed from the cache. This '7 days' number is
configurable through the commandline run options as --media-cache-duration
and in the pict-rs.toml file as [media] cache_duration
2022-04-05 20:29:30 -05:00
b0670c2f66 Move migrate to old 2022-04-03 15:07:31 -05:00
29f0774331 Add ability to claim uploads 2022-04-02 21:15:39 -05:00
8734dfbdc7 Add backgrounding routes
- Accept backgrounded uploads
- Allow backgrounded processing

Still TODO:
- Endpoint for waiting on/claiming an upload
2022-04-02 20:56:29 -05:00
c4d014597e Better job recovery 2022-04-02 18:53:03 -05:00
132e395e5c Multiple items:
- Reduce duplicate work in generate job
- Use hash instead of identifier for unique processing
- Move motion ident generation behind concurrent processor lock
2022-04-02 17:40:08 -05:00
09f53b9ce6 Move away from UploadManager to direct repo & store actions 2022-04-02 16:44:03 -05:00
6ed592c432 In Progress: process jobs
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
09281d9ae8 Move stream timeout to all response bodies 2022-03-29 16:48:26 -05:00
5adb3fde89 Move some Stream implementations into 'stream' module 2022-03-29 15:59:17 -05:00
25f4480809 Remove custom stream error mapping types 2022-03-29 14:17:20 -05:00
8226a3571d Enable multi-threaded job processing 2022-03-29 13:18:47 -05:00
602d1ea935 Begin implementing queue, put cleanups in it 2022-03-29 12:51:16 -05:00
e25a4781a8 Remove unneeded variable 2022-03-29 11:09:23 -05:00
99d042f36e Allow disabling gif/mp4 2022-03-29 11:04:56 -05:00
eb5e39c634 Use color-eyre 2022-03-28 20:47:46 -05:00
1662f153ce Numerous changes:
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
2022-03-28 15:34:36 -05:00
3792a8923a Finish redoing config probably 2022-03-27 23:27:07 -05:00
37e6b21b55 Fix Range, consolidate errors, test object storage 2022-03-26 20:45:12 -05:00
15b52ba6ec Get it compiling again 2022-03-26 16:49:23 -05:00
323016f994 Build out migration path 2022-03-25 18:47:50 -05:00
d6567fbbbd Implement sled repo 2022-03-24 17:09:15 -05:00