Few days ago I discovered that any time you follow a fediverse account on a different instance than your one, the server you are on mirrors the original content of any toot/post, and I think this is a huge issue, because then every Fediverse server/instance could quickly get overloaded from contents from other servers! Am I right? I’ve always thought that toots/posts from other instances were just “empty shells” retrieving the content on demand.

@nutomic@lemmy.ml
link
fedilink
135 hilabete

Lemmy only mirrors text, which takes almost no space at all. What does take a lot of space is media, so mirroring that can fill up your disk really fast. Inthat case, it is necessary to delete old, cached media which can easily be automated.

@Edo_Secco@lemmy.ml
creator
link
fedilink
15 hilabete

I was following some Birdsitelive accounts from Mastodon, Admins regularly block every Birdsitelive instances they see being used there.

I once made a tool that indexes every image posted on the fediverse. It ran from Jan 2019 to about August 2019. I don’t remember the exact numbers but including the original full size, the thumbnail, the meta data including the author idkey, profile, and avatar, was sum total under a few gigs. It was indexing something like 2-8 images a second (it was highly variable).

Of course, the fediverse is bigger now. I wonder what it would be.

@drb@midwest.social
link
fedilink
55 hilabete

I assume this might be related to the cache growth seen by Mastodon instances, quickly into the hundreds of GBs. See the discussion here or the post and associated replies here.

@sexy_peach@feddit.de
link
fedilink
55 hilabete

No you are not right. It’s not a problem. Pleroma doesn’t even download the media, Mastodon does but it’s not that much. Each person follows just a few hundred accounts, they don’t produce too much content. The fedivers is pretty large already and it hasn’t become a problem.

poVoq
mod
link
fedilink
3
edit-2
4 hilabete

The problem is quite similar to Matrix, which also mirrors all chats. Several large Matrix servers were shut down because ever growing databases reached hundreds of gigabytes and it became too expensive to operate.

I think the fediverse has the advantage that it does not depend on an over engineered distributed database like Matrix which makes it much harder to delete old stuff, but it does still limited the size and interconnectivity a ActivityPub server can grow to as well.

@sexy_peach@feddit.de
link
fedilink
14 hilabete

The biggest servers actually have an advantage, because the overlap of followed posts between users would be huge. But yeah having lots of images and short videos does result in big amounts of data.

@Edo_Secco@lemmy.ml
creator
link
fedilink
2
edit-2
5 hilabete

I was following some Birdsitelive accounts, Admin of the Mastodon I’m on regularly block every Birdsitelive instances they see being used, they answered me the reason is the overload of content.

@sexy_peach@feddit.de
link
fedilink
15 hilabete

How many users does your instance have?

@Edo_Secco@lemmy.ml
creator
link
fedilink
15 hilabete

It’s mastodon.uno, at now 21300 users

@sexy_peach@feddit.de
link
fedilink
25 hilabete

I don’t think it’s a good reason to block the birdsitelive.

@Edo_Secco@lemmy.ml
creator
link
fedilink
24 hilabete

This is the answer I got from my admin: «toots are stored locally for a simple reason: let’s say a toot goes viral, then hundreds of instances would have to upload the message with photos or video from the unfortunate person’s server, which could collapse. Uploading a copy locally saves a lot of stress on the servers.» What do you think?

@sexy_peach@feddit.de
link
fedilink
14 hilabete

That’s what I said. But that still doesn’t mean every toot ever is stored, just those that are from users that are being followed. Still not a good reason. Do they want you to use their server or not??

@angarabebesi@lemmy.ml
link
fedilink
14 hilabete

Isn’t it much more efficient to link (rather than to mirror) ? What am I missing here?

@Edo_Secco@lemmy.ml
creator
link
fedilink
14 hilabete

This is exactly my same doubt.

This is the answer I got from my admin: «toots are stored locally for a simple reason: let’s say a toot goes viral, then hundreds of instances would have to upload the message with photos or video from the unfortunate person’s server, which could collapse. Uploading a copy locally saves a lot of stress on the servers.»

What do you think?

@angarabebesi@lemmy.ml
link
fedilink
14 hilabete

Makes sense for viral content, but most content isn’t viral.

@bashrc@lemmy.ml
link
fedilink
04 hilabete

Epicyon has a maximum number of remote/federated posts, and above some configurable number will delete or archive the oldest ones (unless they are DMs). This helps to keep the storage space within a finite upper bound and prevent running out of disk space.

Social Media Reimagined

This is a companion to Fediverse Futures on Social Coding to elaborate the Fediverse from high-level, non-technical perspectives, brainstorming our visions and dreams.

We need a more holistic approach to fedi development and evolution. We need product designers, graphics artists, UX / UI / Interaction designers, futurists and visionaries to join the dev folks. Everyone is encouraged to join here and enrich our views on what Fediverse can be with diverse and different viewpoints, and to stimulate brainstorming, creativity, thinking out-of-the-box and crazy, wild ideas.

Some guidelines

  • Choose a descriptive title that speaks for itself.
  • Be substantive in your comments and stay on-topic.
  • Treat others as you want to be treated, respectful.
  • Don’t be overly critical, we are just brainstorming.

Please read the Social Coding Community Participation Guidelines for more information.

Our fedi hashtags

#Peopleverse #FediverseFutures #Web0 #SocialNetworkingReimagined #UnitedInDiversity #Fedivolution2022 #SocialCoding #ActivityPub

  • 0 users online
  • 1 user / day
  • 1 user / week
  • 4 users / month
  • 25 users / 6 months
  • 4 subscribers
  • 77 Posts
  • 412 Comments
  • Modlog