The real story here is the insane monopoly power that Cloudflare has. Even updating robots.txt files without your input (though it did require opt-in at some point). One monopoly power trying to fuck over the other one is not the win you think it is.