Commit graph

1570 commits

Author SHA1 Message Date
dullbananas
6b1b29419d
Add custom migration runner, forbid some diesel migration commands, fix old migrations (#4673)
* Update schema.rs

* rename

* stuff

* finish new implementation of schema_setup::run (not including revert, test, etc.)

* fmt

* refactor

* fix sql

* migriation run command

* use trigger on migrations table

* add Options with disable_migrations field for test

* rename to enable_forbid_diesel_cli_trigger

* fix

* fix merge

* diff_checker (partial)

* Revert "diff_checker (partial)"

This reverts commit 6709882e14.

* Revert "Revert "diff_checker (partial)""

This reverts commit d4bdda5d11.

* diff check

* improve schema diff

* timestamp replacement

* ignore column order

* remove fedi_name default

* stuff

* improve diff

* stuff

* attempt parallel pg_dump

* attempt 2

* Revert "attempt 2"

This reverts commit a909d2d643.

* Revert "attempt parallel pg_dump"

This reverts commit 592a127954.

* improve diff check

* finish fixing migrations

* stuff

* use advisory lock

* stuff

* Update lib.rs

* fmt

* fmt

* clippy

* Update diff_check.rs

* Update .woodpecker.yml

* Update lib.rs

* Update lib.rs

* Update lib.rs

* Update .woodpecker.yml

* Update .woodpecker.yml

* Update lib.rs

* re-run ci

* fmt

* fmt

* Update .woodpecker.yml

* Update .woodpecker.yml

* create separate database in ci

* Update .woodpecker.yml

* Update .woodpecker.yml

* Update .woodpecker.yml

* Update .woodpecker.yml

* try to fix env var

* Update diff_check.rs

* Remove condition that's not needed anymore

* clippy

* exclude views and fast tables

* revert some migration changes

* fix

* fmt

* re-attempt checking character after skipped trigger name, and make code less confusing

* fmt

* fix

* rerun ci

* rerun ci

* fix strip_prefix order

* fix weird big Cargo.lock change by running `git checkout upstream/main Cargo.lock` then letting it auto update again

* fix

* remove installation commands that were removed in main branch

* Revert "remove installation commands that were removed in main branch"

This reverts commit fd65234a76.

* move create_database_user woodpecker step to make diff less weird

* fix clippy

* Make diff check work just like before

* Move new migrations to the end

* Revert changes to old migrations

* don't assume that migrations are already sorted

* retry CI

* fix merge

* find migrations dir in debug mode using CARGO_MANIFEST_DIR variable instead of current working directory

* always use embedded migrations

* improve doc comments for migration subcommand

* clippy fix

* move cfg(test) attribute to diff_check.rs

* copy `o` variable instead of calling `o` function

* use chrono::TimeDelta Display implementation to show migration duration
2025-01-08 11:07:32 +01:00
9df10b3dc9 Remove unused param Create/EditSite.enable_nsfw 2025-01-08 10:28:01 +01:00
flamingos-cant
2a89179611
Add markdown-it-footnotes (#5303) 2025-01-07 13:16:30 -05:00
03e876b1e9 Removing comment. 2025-01-05 20:37:34 -05:00
Dessalines
0bfbd74e59
Adding combined person content and person saved tables. (#5251)
* Combined tables try 2

* Finishing up combined report table.

* Fix ts optionals.

* Adding tests, triggers, and history updates for report_combined.

* Adding profile.

* Add cursor pagination to report_combined view (#5244)

* add pagination cursor

* store timestamp instead of id in cursor (partial)

* Revert "store timestamp instead of id in cursor (partial)"

This reverts commit 89359dde4b.

* use paginated query builder

* Fixing migration and paged API.

* Using dullbananas trigger procedure

* Removing pointless list routes, reorganizing tests.

* Fixing column XOR check.

* Forgot to remove list report actions.

* Cleanup.

* Use internal tagging.

* Fixing api tests.

* Adding a few indexes.

* Fixing migration name.

* Fixing unique constraints.

* Addressing PR comments.

* Start working on profile combined

* Adding views and replaceable schema.

* A few changes to profile view.

- Separating the profile fetch from its combined content fetch.
- Starting to separate saved_only into its own combined view.

* Finishing up combined person_saved and person_content.

* Fixing api tests.

* Moving to api-v4 routes.

* Fixing imports.

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update migrations/2024-12-02-181601_add_report_combined_table/up.sql

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update migrations/2024-12-02-181601_add_report_combined_table/up.sql

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Fixing import and fmt.

* Fixing null types in postgres.

* Comment out err.

* Fixing TS issues.

* Using dullbananas trigger procedure

* Addressing PR comments.

* Removing serialization

* Removing serialization

* Fixing duped trigger.

* Remove saved_only test.

* Remove pointless post_tags types.

* Remove pointless index.

* Changing published to saved for person_saved_combined.

---------

Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2025-01-05 12:48:57 -05:00
b46fdab768 Merge branch 'combined_profile' into combined_modlog 2025-01-03 14:45:08 -05:00
5cf0bb834a Merge remote-tracking branch 'origin/main' into combined_profile 2025-01-03 14:33:34 -05:00
41421991d6
Error handling for thumbnail generation (ref #5196) (#5298) 2025-01-03 14:09:24 -05:00
6de73f37ca Rename variable 2025-01-03 15:57:02 +01:00
b6d0ecfcb3 Merge branch 'combined_profile' into combined_modlog 2025-01-03 09:16:54 -05:00
Dessalines
e9d27f2840
Don't send out new user email verifies to admins, if already verified. (#5288)
- Fixes #5272
2025-01-03 11:16:25 +01:00
leoseg
ba779b978f
New parameter read_only for /api/v3/post/list (#5264)
* added option to get only read only posts with unittests

* formatted code

* added index on (person_id, read) on post actions where read is not null

* formatted sql

* Update migrations/2024-12-15-151642_add_index_on_person_id_read_for_read_only_post_actions/up.sql

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Fixxed error in down.sql for migration of index on (person_id,read_only,post_id) on post_actions

* Fixxed error in unittests

* Update crates/db_views/src/post_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

---------

Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2025-01-03 11:08:00 +01:00
Dessalines
c656465e28
Fix contradicting filters. (#5281) 2025-01-03 11:02:20 +01:00
2244fd005d Changing published to saved for person_saved_combined. 2025-01-02 17:08:05 -05:00
918c5e820d Merge remote-tracking branch 'origin/main' into combined_profile 2025-01-02 16:38:02 -05:00
anhcuky
c034229295
reset_password API to always return success (#5284) 2025-01-02 12:37:13 -05:00
dullbananas
b91790e29e
Fix incorrect comment in report_combined_view test (#5297) 2025-01-02 12:35:56 -05:00
dullbananas
b8556fa5cf
Shorten "options" variable name (#5285)
* comment view, post view

* do rename everywhere else

* fix person_view

---------

Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2025-01-01 12:52:20 -05:00
Dessalines
ffc3493abe
Applying some clippy fixes. (#5292) 2025-01-01 12:47:21 -05:00
Richard Schwab
f76322e3f5
Reduce false positives in URL blocklist to reduce scunthorpe problem by matching at word boundaries. (#5282)
This addresses an issue brought up on matrix where blocking rt.com resulted in links to deviantart.com getting blocked.
2024-12-27 12:53:23 -05:00
Dessalines
76034f058d
Cleaning up oauth providers conversion. (#5280)
* Cleaning up oauth providers conversion.

* Use into_iter
2024-12-27 12:52:05 -05:00
bd5210aed0 Merge remote-tracking branch 'origin/main' into combined_profile 2024-12-23 14:59:09 -05:00
7585aac446
Fix startup errors, add unit test for scheduled task errors (fixes #5209) (#5269)
* Fix startup errors, add ci check (fixes #5209)

* normal unit test

* cleanup

* shear

* remove serial

* migration
2024-12-20 19:21:09 -05:00
Dessalines
6015ef045d
Running cargo-features-manager prune. (#5274)
- Context #5273
2024-12-20 23:20:16 +01:00
776c5007a1 Remove pointless post_tags types. 2024-12-19 18:07:59 -05:00
9a0e050ee6 Remove saved_only test. 2024-12-19 18:03:57 -05:00
cfd302dc1d Fixing duped trigger. 2024-12-19 17:58:18 -05:00
a1792bb16e Merge remote-tracking branch 'origin/main' into combined_profile 2024-12-19 17:53:24 -05:00
0b514c5b92 Merge branch 'combined_tables_2' into combined_profile 2024-12-19 17:44:07 -05:00
Dessalines
9d3a0cef56
Adding report_combined table. (#5231)
* Combined tables try 2

* Finishing up combined report table.

* Fix ts optionals.

* Adding tests, triggers, and history updates for report_combined.

* Adding profile.

* Add cursor pagination to report_combined view (#5244)

* add pagination cursor

* store timestamp instead of id in cursor (partial)

* Revert "store timestamp instead of id in cursor (partial)"

This reverts commit 89359dde4b.

* use paginated query builder

* Fixing migration and paged API.

* Using dullbananas trigger procedure

* Removing pointless list routes, reorganizing tests.

* Fixing column XOR check.

* Forgot to remove list report actions.

* Cleanup.

* Use internal tagging.

* Fixing api tests.

* Adding a few indexes.

* Fixing migration name.

* Fixing unique constraints.

* Addressing PR comments.

* Fixing api tests.

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update crates/db_views/src/report_combined_view.rs

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update migrations/2024-12-02-181601_add_report_combined_table/up.sql

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Update migrations/2024-12-02-181601_add_report_combined_table/up.sql

Co-authored-by: dullbananas <dull.bananas0@gmail.com>

* Fixing import and fmt.

* Fixing null types in postgres.

* Comment out err.

* Addressing PR comments.

* Removing serialization

---------

Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2024-12-19 17:22:31 -05:00
154cea9366 Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-19 16:30:15 -05:00
Integral
8b78ddeb68
refactor: avoid using format! when String creation is unnecessary (#5268) 2024-12-19 15:42:01 -05:00
9cb28e797d Finishing up tests. 2024-12-19 09:56:07 -05:00
48283a1ed9 Adding tests for person, post, and community. 2024-12-18 22:57:59 -05:00
389083418c Filters done, working on tests. 2024-12-18 17:47:11 -05:00
phiresky
a2a5cb091a
Community post tags (part 1) (#4997)
* partial post tags implementation

* fixes

* fix lints

* schema fix

* chore: restructure / rename tag tables

* chore: fix post view tests

* format

* lint

* expect used

* chore: update code to maybe final version

* add ts-rs optionals

* remove error context

* clippy
2024-12-18 14:54:35 +01:00
d346890b1f
Increase metadata fetch limit to 1 MB (fixes #5208) (#5266) 2024-12-17 10:01:53 -05:00
4586947910 Adding search combined view, need to write tests yet. 2024-12-16 14:56:48 -05:00
fb1f2ff174 Merge branch 'combined_tables_2' into search_combined 2024-12-13 11:14:29 -05:00
3721067cce Moving db_views_actor and _moderator into db_views.
- This is necessary because the combined views use both, and that
  separation was arbitrary to begin with. db_schema has no such crate
  separation.
2024-12-13 11:13:21 -05:00
b4ce1d9121 Removing serialization 2024-12-13 08:50:14 -05:00
af543cc70b Merge branch 'combined_tables_2' into combined_profile 2024-12-13 08:43:45 -05:00
ae9da4da69 Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-12 19:23:20 -05:00
7c962d63fb Removing serialization 2024-12-12 19:20:31 -05:00
031dc2607e Fix 2024-12-12 19:13:51 -05:00
dada964df7 Starting to work on search combined. 2024-12-12 19:13:31 -05:00
17d2de8691 Merge branch 'combined_modlog' into combined_inbox 2024-12-12 17:29:33 -05:00
942da64f07 Merge remote-tracking branch 'origin/main' into combined_modlog 2024-12-12 17:25:02 -05:00
8d91543a13
Allow admins to view deleted users (fixes #5249) (#5258)
* Allow admins to view deleted users (fixes #5249)

* remove check
2024-12-12 10:06:38 -05:00
6a9f924d20
More test coverage for user deletion (#5259) 2024-12-12 10:03:55 -05:00
1e6b3fbf27 Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-12 09:39:10 -05:00
aa9c1404e5 Fixing clippy. 2024-12-12 09:27:12 -05:00
216d08959b Fixing cargo shear. 2024-12-11 23:02:09 -05:00
ec3dcb7452 Running fmt. 2024-12-11 22:50:34 -05:00
37aa20057c Fixing sql_format. 2024-12-11 22:22:55 -05:00
c8a2652e3f Using assert_length 2024-12-11 22:16:51 -05:00
41cfdca1cf Finishing up inbox. 2024-12-11 22:12:56 -05:00
05f218d53c Most of the bulk work done, need to add tests yet. 2024-12-11 15:06:08 -05:00
f133079f0b Merge branch 'post_body_mentions' into combined_inbox 2024-12-10 14:33:28 -05:00
8a5daeec97
Only accept database connection by uri (#5254)
* Only accept database connection by uri

* lint

* fix docker configs
2024-12-10 10:15:54 -05:00
cdd5f65b79 taplo fmt. 2024-12-09 19:16:46 -05:00
c157b8f0fc Adding tests. 2024-12-09 19:13:25 -05:00
9d36f1f176 Adding the full combined view queries. 2024-12-09 14:34:53 -05:00
6363e7d5db Merge branch 'combined_profile' into combined_modlog 2024-12-09 08:25:09 -05:00
5c2205ae8b Merge remote-tracking branch 'origin/main' into combined_modlog 2024-12-09 08:25:04 -05:00
63b7f726cb Using dullbananas trigger procedure 2024-12-09 08:22:35 -05:00
a320f5a9c5 Merge remote-tracking branch 'origin/main' into combined_profile 2024-12-09 08:15:36 -05:00
a8951efb1a Starting to work on combined views. 2024-12-09 08:15:19 -05:00
Integral
9e17c517fe
refactor: replace static with const for global constants (#5250) 2024-12-09 10:31:07 +01:00
15d1faad72 Adding types, fixing allow and blocklist crud. 2024-12-08 13:30:37 -05:00
58e62d55d9 Fixing TS issues. 2024-12-08 09:27:29 -05:00
40fead2bee Merge branch 'combined_tables_2' into combined_profile 2024-12-08 08:50:07 -05:00
02bd2f6764 Fixing import and fmt. 2024-12-08 08:49:26 -05:00
Dessalines
22d869730d
Update crates/db_views/src/report_combined_view.rs
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2024-12-08 08:42:27 -05:00
Dessalines
dc0ec159df
Update crates/db_views/src/report_combined_view.rs
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2024-12-08 08:42:05 -05:00
Dessalines
165c7f4762
Update crates/db_views/src/report_combined_view.rs
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2024-12-08 08:40:58 -05:00
a4de41ddae Merge branch 'combined_tables_2' into combined_profile 2024-12-07 21:20:25 -05:00
a940ce38ef Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-07 17:54:18 -05:00
5e7b30ac6a
Reorganize api endpoints (fixes #2022) (#5216)
* Reorganize api endpoints (fixes #2022)

* scopes

* move message rate limit

* move rate limit

* apply suggestions

* move my_user to separate endpoint

* remove taglines and custom emojis from siteview

* routes for api v3 and v4

* remove new features from api v3

* js client

* replace occurences of `v3`, fix routes

* replace getSite().my_user with getMyUser()

* update

* update config

* remove web::

* update

* prettier

* lockfile

* v

* fix settings

* move block endpoints

* more changes

* fmt

* update

* change some routes

* lockfile

* Add comment about deprecation
2024-12-07 14:06:33 -07:00
3abc46fad9 Finishing up combined person_saved and person_content. 2024-12-07 15:46:46 -05:00
32b5411abd A few changes to profile view.
- Separating the profile fetch from its combined content fetch.
- Starting to separate saved_only into its own combined view.
2024-12-07 12:38:20 -05:00
1053df1a4b Adding views and replaceable schema. 2024-12-06 09:49:11 -05:00
724856d684 Start working on profile combined 2024-12-06 08:18:08 -05:00
921d53227c Addressing PR comments. 2024-12-04 12:48:41 -05:00
e1affa8696 Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-04 12:39:59 -05:00
flamingos-cant
ff2bbf41ca
Use magic number to detemine file type (#5225)
* Revert "Guess image mime type from file extension (fixes #5196) (#5212)"

This reverts commit 63ea99d38a.

* Use magic numbers to determine file type.

* fmt

* Don't wrap response in an option

* Regen Cargo.lock

* Clean-up + guess mime type from extension if server is unresponsive

* Move some things about.

* Some cleanup.

* Removing comment lines.

---------

Co-authored-by: Dessalines <tyhou13@gmx.com>
2024-12-04 08:29:50 -05:00
34a440a6d7 Fixing migration name. 2024-12-02 18:38:18 -05:00
1f284076ce Adding a few indexes. 2024-12-02 18:35:18 -05:00
4cac67c099 Use internal tagging. 2024-12-02 18:05:38 -05:00
46748210ee Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-02 17:07:03 -05:00
dcf1cfca9b
Return content of removed comments for admins (ref #5232) (#5245)
* Return content of removed comments for admins (ref #5232)

* fmt

* remove dbg
2024-12-02 17:06:39 -05:00
Mikoto
9505d1d205
feat: add PKCE (#5189)
Co-authored-by: Nutomic <me@nutomic.com>
2024-12-02 16:47:03 -05:00
802a8a64e7 Cleanup. 2024-12-02 16:34:23 -05:00
0c854d2d3a Forgot to remove list report actions. 2024-12-02 16:33:45 -05:00
5a8b9def6e Merge remote-tracking branch 'origin/main' into combined_tables_2 2024-12-02 16:27:25 -05:00
1776de2f45 Removing pointless list routes, reorganizing tests. 2024-12-02 16:10:59 -05:00
00beccd272 Using dullbananas trigger procedure 2024-12-02 13:46:51 -05:00
7fdbb58e98 Fixing migration and paged API. 2024-12-02 13:28:26 -05:00
f25d34656f Merge branch 'combined_tables_2' of https://github.com/LemmyNet/lemmy into combined_tables_2 2024-12-02 12:56:19 -05:00
dullbananas
588e1f6c0a
Add cursor pagination to report_combined view (#5244)
* add pagination cursor

* store timestamp instead of id in cursor (partial)

* Revert "store timestamp instead of id in cursor (partial)"

This reverts commit 89359dde4b.

* use paginated query builder
2024-12-02 12:56:14 -05:00