Comment on Running web sites makes me not want to - Lowkey Party
diaphragmwp@discuss.tchncs.de 6 days ago
I have a simple static site. It’s been up for less than a month. On the cheapest possible VPS, someone gave me. Robots.txt:
User-Agent: * Allow: /
How long do yall think it will take for it to blow up?
possiblylinux127@lemmy.zip 5 days ago
Robots.txt is completely ignored
diaphragmwp@discuss.tchncs.de 5 days ago
Cool. Doesn’t really answer my question, though.