If I didn’t enjoy the cat & mouse of it, I’d definitely walk away from running a site. Just out of curiosity, I created an hourly graph today showing malicious bot, legitimate bot and human ratio graphs for one of my sites. The malicious hits make up around 80% hourly and human hits are usually well under 10%.
Running web sites makes me not want to - Lowkey Party
Submitted 7 hours ago by mo_lave@reddthat.com to selfhosted@lemmy.world
https://lowkey.party/running-web-sites-makes-me-not-want-to
Comments
schwim@piefed.zip 7 hours ago
Zak@lemmy.world 4 hours ago
I host a few sites and I haven’t had a problem yet. Sure, logs suggest a majority of traffic is bots, but the cheap VPS I’m hosting on hasn’t melted so I haven’t been motivated to do anything about it.
Dave@piefed.nz 4 hours ago
Lemmy is particularly susceptible. Hosting a static site with a limited number of pages is fine. Lemmy needs to check all posts, find the votes, sort them, and compile the page. It does that for practically every page load, and so loading a page once is quite “expensive”.
Then add on to that the almost unlimited pages of content for bots to crawl through, bots just get caught endlessly scraping pages. Even powerful servers struggle, which is why most Lemmy instances have implemented some sort of protection against bots.
frongt@lemmy.zip 1 hour ago
It doesn’t need to. Like any similar site, it can cache a lot of that in databases like redis, or cache the rendered page in part or in whole.
Zak@lemmy.world 4 hours ago
I believe you, but the linked article is not about hosting Lemmy.
ms_lane@lemmy.world 3 hours ago
Why not just use more static pages?
4chan has been ‘static’ forever, the backend builds each page every ~15s, pages served to users are always static. It’s ‘justwerked’ for 20 years now on a shoestring.
dieTasse@feddit.org 7 hours ago
Yeah, internet is no longer the interesting place it used to be. Interesting, intriguing, exciting. Now it’s worse than going to a tax office… the day before taxes… On Christmas… 😂
lntl@lemmy.ml 6 hours ago
I run a DaaS product Trace Jobs that serves job posting data.
My expectations are pretty low and am never disappointed.
hperrin@lemmy.ca 2 hours ago
I host tons of open source projects on forge.sciactive.com
Recently, it was getting absolutely hounded with tons of meaningless requests. I’m assuming they are just results of AI.
So, I put Anubis in front of it. Now images hosted there won’t load on other sites, people have to wait forever to see the code, and the experience on phones is even worse. Just because AI doesn’t respect anything, and the people who run it are too stupid to realize that.
This is why we can’t have nice things.
AHemlocksLie@lemmy.zip 2 hours ago
They’re perfectly capable of realizing it. How do you think it got built that way? They don’t respect anything, either.
hperrin@lemmy.ca 2 hours ago
True.