99aac07714
Mark database fields as sensitive so they dont show up in logs ( #4720 )
...
* Mark database fields as sensitive so they dont show up in logs
* add file
* fix test
* Update crates/apub/src/objects/person.rs
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
* Update crates/apub/src/objects/community.rs
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
* Update crates/apub/src/objects/instance.rs
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2024-05-16 20:41:57 -04:00
723cb549d4
Allow importing partial backup ( fixes #4672 ) ( #4705 )
...
* Allow importing partial backup (fixes #4672 )
* Dont throw error on empty LocalUser::update
* fix tests
2024-05-14 22:37:30 -04:00
dullbananas
c4fc3a8ede
Optimize stuff in attempt to fix high amount of locks, and fix comment_aggregates.child_count ( #4696 )
...
* separate triggers
* auto_explain.log_triggers=on
* Revert "auto_explain.log_triggers=on"
This reverts commit 078b2dbb9b95600da4af
2024-05-09 08:18:55 -04:00
Dessalines
492d8f1b01
Fix communities with broken outboxes, and use PostView. Fixes #4658 ( #4668 )
...
* Fix communities with broken outboxes, and use PostView. Fixes #4658
* Fixing tests.
* Dont pass ref and clone.
2024-04-29 12:22:00 +02:00
dullbananas
d3737d4453
Optimize actor_language.rs ( #4612 )
...
* Remove useless transaction in actor_language.rs
* Update actor_language.rs
* site
* community
* Update actor_language.rs
* Update actor_language.rs
* Update actor_language.rs
* Update actor_language.rs
* Update actor_language.rs
2024-04-27 10:59:58 -04:00
dullbananas
4ba6221e04
Move SQL triggers from migrations into reusable sql file ( #4333 )
...
* stuff
* stuff including batch_upsert function
* stuff
* do things
* stuff
* different timestamps
* stuff
* Revert changes to comment.rs
* Update comment.rs
* Update comment.rs
* Update post_view.rs
* Update utils.rs
* Update up.sql
* Update up.sql
* Update down.sql
* Update up.sql
* Update main.rs
* use anyhow macro
* Create down.sql
* Create up.sql
* Create replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update utils.rs
* Update .woodpecker.yml
* Update sql_format_check.sh
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Create dump_schema.sh
* Update start_dev_db.sh
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* stuff
* Update replaceable_schema.sql
* Update .pg_format
* fmt
* stuff
* stuff (#21 )
* Update replaceable_schema.sql
* Update up.sql
* Update replaceable_schema.sql
* fmt
* update cargo.lock
* stuff
* Update replaceable_schema.sql
* Remove truncate trigger because truncate is already restricted by foreign keys
* Update replaceable_schema.sql
* fix some things
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update .woodpecker.yml
* stuff
* fix TG_OP
* Psql env vars
* try to fix combine_transition_tables parse error
* Revert "try to fix combine_transition_tables parse error"
This reverts commit 75d00a4626a5bcd0834b0066a4b42b
2024-04-17 20:58:44 -04:00
TechVest
b0370ae2fd
chore: fix some comments ( #4637 )
...
Signed-off-by: TechVest <techdashen@qq.com>
2024-04-17 14:35:54 +02:00
Dessalines
6efab9aab1
Creating a LocalImageView, so that front ends have the Person struct. ( #4631 )
...
* Creating a LocalImageView, so that front ends have the Person struct.
* Removing local_user from LocalImageView.
* Add uploader check.
2024-04-16 19:20:44 -04:00
Dessalines
d075acce43
Make all single-fetch database calls return an Option. ( #4617 )
...
- Diesel ordinarily throws an error when no results are returned for a
single fetch, which is a bit confusing. This PR ensures that the
missing value cases are all caught, and wrapped with new LemmyErrors,
rather than diesel errors.
- Fixes #4601
2024-04-16 14:48:15 +02:00
Dessalines
5dea21d531
Convert all Result<..., LemmyError> into LemmyResult<...> Fixes #4613 ( #4614 )
...
* Convert all Result<..., LemmyError> into LemmyResult<...> Fixes #4613
* Fixing clippy.
2024-04-10 10:14:11 -04:00
0203b62a6d
Ignore old federated post edits (ref #4529 ) ( #4586 )
...
* Ignore old federated post edits (ref #4529 )
* use filter on insert
* coalesce(updated, published)
* avoid comment conflict clause
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-04-10 10:03:51 -04:00
1d0a6ac08f
Avoid breaking api change, reduce api cache duration ( #4610 )
...
* Dont mark site.public_key as `serde(skip)` to avoid breaking change (fixes #4605 )
* Reduce cache duration for api
2024-04-09 10:10:20 -04:00
087684658a
Cache result of LocalSite::read to avoid unnecessary db calls ( #4585 )
...
* Cache result of LocalSite::read to avoid unnecessary db calls
* single const for cache duration
* clippy
* revert apub send changes
* clippy
* fmt
2024-04-03 17:38:31 -04:00
dullbananas
007e9b7aab
Optimize Community::set_featured_posts ( #4579 )
...
* Don't lock excess rows in Community::set_featured_posts
* Update community.rs
* Update community.rs
* Update community.rs
* Update community.rs
2024-04-02 11:19:04 -04:00
85ee89f4e8
When uploading new icon/avatar/banner, delete old one ( #4573 )
2024-03-27 09:00:52 -04:00
Dessalines
6bfbb9332d
Adding listMedia endpoint, to view all your local image uploads. ( #4509 )
...
* Adding listMedia endpoint, to view all your local image uploads.
- Fixes #4445
* Fix ts import.
* Forgot to order by published desc
* Adding an endpoint to list all images, for admins only.
* Forgot to add file.
* Add additional test.
* Use better logic for no-limit version.
* Better call sites.
* Adding another test.
* Fix tests.
* Moving list_media to /account action.
* Addressing PR comments.
* Removing pointless comment.
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-03-26 12:06:11 -04:00
Dessalines
7929e77602
Fixing issue with comment replies wrongly marked as read. ( #4567 )
...
* Fixing issue with comment replies wrongly marked as read.
- Fixes #4566
* Elaborating on a comment.
2024-03-26 10:46:37 -04:00
Dessalines
95069d7648
Fixing some clippy and woodpecker lints. ( #4565 )
...
* Fixing some clippy and woodpecker lints.
* Try fixing woodpecker 1.
* Revert "Try fixing woodpecker 1."
This reverts commit 7c2020a08d
2024-03-26 10:17:42 +01:00
846848c4f6
On registration, automatically set content languages from accept-language header ( #4550 )
...
* On registration, automatically set content languages from accept header
* no need to set site language or default language for new user anymore
* fix test
* fix langs
* avoid duplicate writing of new user languages
2024-03-25 16:02:12 -04:00
Dessalines
0f77951e05
Upgrading deps. ( #4537 )
...
* Upgrading deps.
* Addressing PR comments
2024-03-18 10:36:49 +01:00
flamingos-cant
19a1a077c5
Add a blocklist for URLs. ( #4515 )
...
* Add a blocklist for URLs.
* Fix SQL format
* Make clippy happy.
* Use regex for URL matching.
* Escape regex chars in URLs.
* Use post for modification.
* Make URL block regex static and remove API routes.
* Add date fields to table and use transaction.
* Use Cache for blocklist.
* Rename check_links + move list to parameters of process_markdown.
* SQL format.
* Format, again.
* Remove println.
* Add API test.
* Set a shorter lifetime for regex in debug mode.
* Add missing macro.
* Update lemmy-js-client
* Update api_test/pnpm-lock.yaml
* Don't break other tests
* Use different URL for test
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
Co-authored-by: Nutomic <me@nutomic.com>
2024-03-15 07:03:29 -04:00
Dessalines
15f02f00a9
Add a vote_display_mode local_user setting. ( #4450 )
...
* Add a vote_display_mode local_user setting.
- Fixes #4449
* Changing HideDownvotes to Score.
* Adding ScoreAndDownvote display mode.
* Adding upvote and downvote mode.
* Extracting vote_display_mode to another table.
* Fixing fmt.
* Remove published and updated columns.
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-03-13 12:10:58 -04:00
Dessalines
7f9950fe85
Add alt_text for posts. Fixes #1086 ( #4477 )
...
* Add alt_text for posts. Fixes #1086
* Moving alt_text to attachment name.
* Cleaning up mod action line.
* Addressing PR comments
* Addressing PR comments.
* Fixing clones.
2024-03-05 11:34:57 +01:00
Dessalines
7eec8714d7
When site banning a federated user, also remove their content from our local communities. ( #4464 )
...
* When banning a federated user, also remove their content from our local
communities.
- This works by:
- Before a site ban, find all posts and comments to local communities
- Send a federated community ban action for each local comm.
- This also removes their content in the apub receive code.
- Adding back in federated community ban api tests.
- Adding in two more api tests for site bans.
- Fixes #4118
* Add local community ban, and nonlocal person check.
* Ignoring errors.
* Move local check into function.
* Addressing PR comments 2
2024-03-01 13:45:06 -05:00
Dessalines
87b577467b
Adding ability to hide posts. ( #4480 )
...
* Adding ability to hide posts.
- Adds an post/hide API route.
- Adds a `show_hidden` (default false) to `GetPosts`.
- Adds a `hidden` field to `PostView`.
- Removes the single `post_id` from MarkPostAsRead.
- Fixes #1403
* Add a check to make sure hidden field is true.
* Fixing test.
* Add back semicolon
2024-02-29 10:42:34 -05:00
Dessalines
f3d48f2c2c
Adding some recommended fixes from nightly clippy. ( #4473 )
2024-02-26 09:47:10 -05:00
7316dd281a
Correctly synchronize collection of community featured posts ( fixes #3867 ) ( #4475 )
2024-02-26 09:45:23 -05:00
86b44c2a4d
Add site.content_warning, local_site.default_post_listing_mode ( #4393 )
...
* Include local_site.content_warning setting for showing nsfw by default
* Add community setting `only_followers_can_vote`
* clippy
* add auto_expand_images site setting
* cleanup
* add missing api params
* postquery/communityquery changes
* clippy
* change error
* replace auto_expand_images with default_site_post_listing_mode
* change post/community query params
* get rid of only_followers_can_vote
* machete
* fix
* clippy
* revert remaining vote changes
* remove dead code
* remove unused var
* fmt
2024-02-16 07:24:35 -05:00
Dessalines
a3bf2f1cf1
Auto resolve reports on removing a comment or post. Fixes #4390 ( #4402 )
...
* Automatically resolve report when post/comment is removed (#3850 )
* Automatically resolve report when post/comment is removed
* also handle apub removes
* Removing auto-resolve report triggers.
* Dont allow creating reports for deleted / removed items.
* Running pgformat.
* Fixing test.
* Addressing PR comments.
* Forgot comment report.
---------
Co-authored-by: Nutomic <me@nutomic.com>
2024-02-15 08:52:04 -05:00
Dessalines
890565ca14
Deleting denied local_users older than a week. Fixes #4434 ( #4448 )
...
* Deleting denied local_users older than a week. Fixes #4434
* Addressing PR comments.
* Upping rust to 1.76
* Delete the person rows also.
2024-02-15 07:50:53 -05:00
Dessalines
33989f5518
Blocking an instance also hides private messages from their users. ( #4447 )
...
* Blocking an instance also hides private messages from their users.
- Fixes #4444
* Separating private message tests.
2024-02-14 10:49:55 +01:00
0f414a95d5
Local only community ( #4350 )
...
* Add support for local only community (fixes #1576 )
* add filters and tests to db views
* dont federate local only community
* test get apub community http
* tests
* more checks
* wip
* api test
* fix tests
* change community.local_only column to visibility enum
(for private communities)
* sql fmt
* rename vars
* clippy
* fix tests
* update lib
* review
* fix js client version
* update client
2024-01-25 11:04:25 -05:00
e8a52d3a5c
Rewrite images to use local proxy ( #4035 )
...
* Add markdown rule to add rel=nofollow for all links
* Add markdown image rule to add local image proxy (fixes #1036 )
* comments
* rewrite markdown image links working
* add comment
* perform markdown image processing in api/apub receivers
* clippy
* add db table to validate proxied links
* rewrite link fields for avatar, banner etc
* sql fmt
* proxy links received over federation
* add config option
* undo post.url rewriting, move http route definition
* add tests
* proxy images through pictrs
* testing
* cleanup request.rs file
* more cleanup (fixes #2611 )
* include url content type when sending post over apub (fixes #2611 )
* store post url content type in db
* should be media_type
* get rid of cache_remote_thumbnails setting, instead automatically
take thumbnail from federation data if available.
* fix tests
* add setting disable_external_link_previews
* federate post url as image depending on mime type
* change setting again
* machete
* invert
* support custom emoji
* clippy
* update defaults
* add image proxy test, fix test
* fix test
* clippy
* revert accidental changes
* address review
* clippy
* Markdown link rule-dess (#4356 )
* Extracting opengraph_data to its own type.
* A few additions for markdown-link-rule.
---------
Co-authored-by: Nutomic <me@nutomic.com>
* fix setting
* use enum for image proxy setting
* fix test configs
* add config backwards compat
* clippy
* machete
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2024-01-25 09:22:11 -05:00
dullbananas
759f6d8a9a
Better query plan viewing experience ( #4285 )
...
* stuff
* stuff including batch_upsert function
* stuff
* do things
* stuff
* different timestamps
* stuff
* Revert changes to comment.rs
* Update comment.rs
* Update comment.rs
* Update post_view.rs
* Update utils.rs
* Update up.sql
* Update up.sql
* Update down.sql
* Update up.sql
* Update main.rs
* use anyhow macro
* replace get(0) with first()
* as_slice
* Update series.rs
* Update db_perf.sh
* Update and rename crates/db_schema/src/utils/series.rs to crates/db_perf/src/series.rs
* Update utils.rs
* Update main.rs
* Update main.rs
* Update .woodpecker.yml
* fmt main.rs
* Update .woodpecker.yml
* Instance::delete at end
* Update main.rs
* Update Cargo.toml
---------
Co-authored-by: Nutomic <me@nutomic.com>
2024-01-24 10:22:33 -05:00
b58da11fb7
Mark instance as alive after successful activity send ( fixes #4039 ) ( #4377 )
...
* Mark instance as alive after successful activity send (fixes #4039 )
* clippy
* Instance::update
* domain
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2024-01-19 09:40:12 -05:00
ALEX11BR
a5289dd4cf
Use pretty_assertions for assertions ( #4347 )
...
* Use `pretty_assertions` for assertions
* fixed ordering of `use`s
* ci
---------
Co-authored-by: Felix Ableitner <me@nutomic.com>
2024-01-04 04:47:18 -05:00
dullbananas
dcb89f52d6
Don't update comment_aggregates if updating path fails ( #4281 )
2023-12-18 10:31:39 +01:00
Dessalines
719b76a6e7
Create comment in transaction. Fixes #3741 ( #4265 )
...
* Create comment in transaction. Fixes #3741
* Removing if let on comment create.
2023-12-15 11:36:58 +01:00
Dessalines
246e38a45b
Making login case-insensitive. Fixes #4272 ( #4273 )
...
* Making login case-insensitive. Fixes #4272
* Removing redundant lowercase.
2023-12-15 11:34:17 +01:00
Kroese
2d4037ba61
Extend sitemap span ( #4231 )
...
* Extend sitemap span
* Keep cargo_fmt happy
* Add FETCH_LIMIT_SITEMAP
* Use FETCH_LIMIT_SITEMAP
* Keep cargo_fmt happy
* Update utils.rs
* Use SITEMAP_DAYS
* Keep cargo_fmt happy
* Sitemap
* Keep cargo_fmt happy
* Sitemap
* Sitemap
* Increase to 31 days
2023-12-11 11:24:51 +01:00
f786df151f
Include instance blocks in settings export ( #4173 )
2023-11-17 21:59:15 -05:00
dullbananas
8e2cbc9a0f
Remove id column and use different primary key on some tables ( #4093 )
...
* post_saved
* fmt
* remove unique and not null
* put person_id first in primary key and remove index
* use post_saved.find
* change captcha_answer
* remove removal of not null
* comment_aggregates
* comment_like
* comment_saved
* aggregates
* remove "\"
* deduplicate site_aggregates
* person_post_aggregates
* community_moderator
* community_block
* community_person_ban
* custom_emoji_keyword
* federation allow/block list
* federation_queue_state
* instance_block
* local_site_rate_limit, local_user_language, login_token
* person_ban, person_block, person_follower, post_like, post_read, received_activity
* community_follower, community_language, site_language
* fmt
* image_upload
* remove unused newtypes
* remove more indexes
* use .find
* merge
* fix site_aggregates_site function
* fmt
* Primary keys dess (#17 )
* Also order reports by oldest first (ref #4123 ) (#4129 )
* Support signed fetch for federation (fixes #868 ) (#4125 )
* Support signed fetch for federation (fixes #868 )
* taplo
* add federation queue state to get_federated_instances api (#4104 )
* add federation queue state to get_federated_instances api
* feature gate
* move retry sleep function
* move stuff around
* Add UI setting for collapsing bot comments. Fixes #3838 (#4098 )
* Add UI setting for collapsing bot comments. Fixes #3838
* Fixing clippy check.
* Only keep sent and received activities for 7 days (fixes #4113 , fixes #4110 ) (#4131 )
* Only check auth secure on release mode. (#4127 )
* Only check auth secure on release mode.
* Fixing wrong js-client.
* Adding is_debug_mode var.
* Fixing the desktop image on the README. (#4135 )
* Delete dupes and add possibly missing unique constraint on person_aggregates.
* Fixing clippy lints.
---------
Co-authored-by: Nutomic <me@nutomic.com>
Co-authored-by: phiresky <phireskyde+git@gmail.com>
* fmt
* Update community_block.rs
* Update instance_block.rs
* Update person_block.rs
* Update person_block.rs
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
Co-authored-by: Nutomic <me@nutomic.com>
Co-authored-by: phiresky <phireskyde+git@gmail.com>
2023-11-13 08:14:07 -05:00
Dessalines
e00b0c9da2
Dont send comment reply to user who has community blocked. Fixes #3684 ( #4096 )
...
* Dont send comment reply to user who has community blocked. Fixes #3684
* Adding source instance block check.
* Adding api test.
* Addressing PR comments.
2023-11-09 12:03:25 +01:00
phiresky
b9b65c9c18
add federation queue state to get_federated_instances api ( #4104 )
...
* add federation queue state to get_federated_instances api
* feature gate
* move retry sleep function
* move stuff around
2023-11-06 16:07:04 -05:00
6d27bfed08
Handle invalid ban expires values ( fixes #4045 ) ( #4046 )
...
* Handle invalid ban expires values (fixes #4045 )
* Adding a few missing expire time checks. Fixing up time conversions. (#4051 )
* Adding a few missing expire time checks. Fixing up time conversions.
* Increase settings export wait time.
* get rid of RemoveCommunity.expires
* fmt
* tests
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-10-17 13:25:35 -04:00
3a19af5215
Allow marking multiple posts as read in single api call ( fixes #3963 ) ( #4048 )
...
* Allow marking multiple posts as read in single api call (fixes #3963 )
* cleanup
* limit array length
* fix test
* review
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-10-17 12:35:51 -04:00
256ee61908
Ignore activities in remote communities without local followers ( #4006 )
...
* Ignore activities in remote communities without local followers (fixes #3568 )
* x
* comments
* prettier
* fix api test
* fix test
* cleanup
* fix remaining test
* clippy
* decrease delay
2023-10-16 06:03:49 -04:00
9e099726e6
Cleanup checks for community actions ( fixes #2858 , fixes #2868 ) ( #4028 )
...
* Cleanup checks for community actions (fixes #2858 , fixes #2868 )
* allow restoring deleted community
* review changes
* remove unneeded sql
* remove joins
* change mod log check
2023-10-13 09:48:18 -04:00
6d7b38f4de
Implement user data import/export ( #3976 )
...
* Implement endpoints for user data import/export
* add test
* exclude avatar/banner
* increase import url count, add rate limit
* also export/import saved posts
* rate limit
* rename
* saved posts also exist
* rename routes
* fix test
* error handling
* clippy
* limit parallelism
* clippy
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-10-11 16:47:22 +02:00
dc327652a5
Add db table for login tokens which allows for invalidation ( #3818 )
...
* wip
* stuff
* fmt
* fmt 2
* fmt 3
* fix default feature
* use Authorization header
* store ip and user agent for each login
* add list_logins endpoint
* serde(skip) for token
* fix api tests
* A few suggestions for login_token (#3991 )
* A few suggestions.
* Fixing SQL format.
* review
* review
* rename cookie
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-10-09 12:46:12 +02:00
