Comment on Running web sites makes me not want to - Lowkey Party
MonkderVierte@lemmy.zip 1 day agoYou can set a trap that isn’t or is forbidden in robots.txt. Anyone who ignores your robots.txt is not friendly.
Comment on Running web sites makes me not want to - Lowkey Party
MonkderVierte@lemmy.zip 1 day agoYou can set a trap that isn’t or is forbidden in robots.txt. Anyone who ignores your robots.txt is not friendly.