Hi lemmy; I’ve made a program that will download all the post and images for a lemmy community. It downloads them into a html file. This way users don’t have to worry about losing all their post because they can download the whole community themselves.
Demo https://files.catbox.moe/8wgbm4.mp4
I hope someone finds this useful. Someone asked me for it so I provided it.
I put paging back so large communities won’t use up to much memory. I made limit optional and it default at 10 so it will download 10 at a time. I like how you changed it to download all images. It’s all merged. Gonna try to add a basic license tonight too.
i don’t see how that helps since the user has no control over the paging. you’re making a lot of additional requests to get the same data
You dont want to get 1,000 post in one request. Im not even sure lemmy would allow that. Im not sure what you mean by no control. It’s downloading an entire community.
And yes you want to make additional request so it doesn’t timeout.
actually lemmy allows getting any number of posts with one request.
I still don’t think it’s a great idea to get an entire large community at once. Ill play with trying an entire large community like memes later when I get a minute. Either way the way I have it you can still specify a really large limit. Pass in 700 and it will attempt 700 at once. Pass in 50 and it will do it in chunks of 50. In either case it will get the entire community and not stop at the number provided .
edit: Manages to get all 601 post from /c/memes in a few seconds. Which is cool. I’m just gonna make the default page size at like 100 instead of 10.