LemmyNet/lemmy-stats-crawler
2
1
Fork 0
Code Issues 3 Pull requests Projects Releases Wiki Activity

Run as cronjob, collect data #4

New issue
Open
opened 2021-03-10 17:11:33 +00:00 by nutomic · 2 comments
nutomic commented 2021-03-10 17:11:33 +00:00
Owner
Copy link

The collected data can be auto-committed to a git repo, and used by different projects.

The collected data can be auto-committed to a git repo, and used by different projects.
dessalines commented 2021-03-24 23:48:05 +00:00
Owner
Copy link

I've set this up as a git repo, and made the update / run scripts, but haven't put it in any cron yet: https://github.com/LemmyNet/lemmy-instance-stats

Question: I noticed that having online users is probably going to add a lot of noise to these commits, and its not very important statistics-wise. I suggest we remove that. Example diff: fae560ed19

Also maybe we should close issues on this one, and only do PRs here. Seems strange to have every other repo's issues on github but this one here.

I've set this up as a git repo, and made the update / run scripts, but haven't put it in any cron yet: https://github.com/LemmyNet/lemmy-instance-stats Question: I noticed that having online users is probably going to add a lot of noise to these commits, and its not very important statistics-wise. I suggest we remove that. Example diff: https://github.com/LemmyNet/lemmy-instance-stats/commit/fae560ed19ca6576fff6e5d2390bb7a9b0edcf6d Also maybe we should close issues on this one, and only do PRs here. Seems strange to have every other repo's issues on github but this one here.
nutomic commented 2021-03-26 13:24:30 +00:00
Author
Owner
Copy link

Online users would work if we run crawls every hour or so. They are fast enough that I dont see any reason against this. I would also expect that other values like number of users would change a lot once we get more instances and more total users.

And I simply dont like using Github for everything, if thats strange I dont care :p

Online users would work if we run crawls every hour or so. They are fast enough that I dont see any reason against this. I would also expect that other values like number of users would change a lot once we get more instances and more total users. And I simply dont like using Github for everything, if thats strange I dont care :p
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
federated-counts
recursive-crawl
lemmy-structs
min-version
parallel-crawl
sort_active_monthly
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: LemmyNet/lemmy-stats-crawler#4
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?