@[email protected] to Privacy [email protected]English • 2 years agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.commessage-square43fedilinkarrow-up1384cross-posted to: [email protected]
arrow-up1383external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.com@[email protected] to Privacy [email protected]English • 2 years agomessage-square43fedilinkcross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish3•2 years agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.