@[email protected] to Privacy [email protected]English • 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.commessage-square43fedilinkarrow-up1384cross-posted to: [email protected]
arrow-up1383external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.com@[email protected] to Privacy [email protected]English • 1 year agomessage-square43fedilinkcross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish3•1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.