Deter AI scrapers and bots

Snout allows you to deter AI scrapers. When this mode is enabled from the settings, it will use two methods to deter them.

Robots.txt

Snout will deploy a robots.txt on the which will tell well-behaving scrapers to not index your site. It is borrowed from ai.robots.txt.

Proof of work

Snout will serve a proof-of-work CAPTCHA on the website which can slow down those who choose to ignore the robots.txt.