@[email protected] to Privacy [email protected]English • 11 months agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.commessage-square44fedilinkarrow-up1384cross-posted to: [email protected]
arrow-up1383external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.com@[email protected] to Privacy [email protected]English • 11 months agomessage-square44fedilinkcross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish3•11 months agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.