count_dongulus@lemmy.worldtoShowerthoughts@lemmy.world•Underrated benefit of lemmy is like minded people will tend to join the same instances and if I don't want to interact with those groups I can just filter the whole instance.
1·
3 months agoPeople talk about filter bubbles, but there’s a nuance here: on Lemmy, you’re not being served up whatever the platform owners think you should see from an opaque algorithm. You’re going to, by default, see cesspool content. You have to choose to block it.
This won’t work against commercial crawlers. They check page contents with something similar to a simhash and don’t recrawl these pages. They also have limiters like for depth to avoid getting stuck in circular links.
You could generate random content for each new page, but you’ll still eventually hit the depth limit. There are probably other rules related to content quality to limit crawling too.