A new tool from Internet infra and cybersecurity company Cloudflare is built to help websites block AI crawlers. As a result of the attention that AI scraping practices have received, more and more websites want to ensure that their material is not hoovered up into someone’s model without compensation. Robots.txt is hardly enough of a dike to hold back the AI flood, in other words.

https://blog.cloudflare.com/declaring-your-aindependence-block-ai-bots-scrapers-and-crawlers-with-a-single-click?utm_source=thisweekinstartups.beehiiv.com&utm_medium=newsletter&utm_campaign=cloudflare-wants-to-help-block-ai-crawlers-as-new-vc-funds-blossom-around-the-world

 #Artificial Intelligence

Artificial Intelligence

A new tool from Internet infra and cybersecurity company Cloudflare is built to help websites block AI crawlers. As a result of the attention that AI scraping practices have received, more and more websites want to ensure that their material is not hoovered up into someone’s model without compensation. Robots.txt is hardly enough of a dike to hold back the AI flood, in other words.  https://blog.cloudflare.com/declaring-your-aindependence-block-ai-bots-scrapers-and-crawlers-with-a-single-click?utm_source=thisweekinstartups.beehiiv.com&utm_medium=newsletter&utm_campaign=cloudflare-wants-to-help-block-ai-crawlers-as-new-vc-funds-blossom-around-the-world   #Artificial Intelligence

Bobby

Cloudflare arms sites against AI model companies: After releasing a tool that helped websites and smaller companies block AI data scraping, the former startup is taking its push to protect content owners a step further. TechCrunch reports that Cloudflare plans to “launch a marketplace in the next year where website owners can sell AI model providers access to scrape” their site. Today it’s an AI auditing tool to see who is scraping you — but there’s more to come.

https://techcrunch.com/2024/09/23/cloudflares-new-marketplace-will-let-websites-charge-ai-bots-for-scraping/

Cloudflare arms sites against AI model companies: After releasing a tool that helped websites and smaller companies block AI data scraping, the former startup is taking its push to protect content owners a step further. TechCrunch reports that Cloudflare plans to “launch a marketplace in the next year where website owners can sell AI model providers access to scrape” their site. Today it’s an AI auditing tool to see who is scraping you — but there’s more to come.  https://techcrunch.com/2024/09/23/cloudflares-new-marketplace-will-let-websites-charge-ai-bots-for-scraping/

Cloudflare announced plans on Monday to launch a marketplace in the next year where website owners can sell AI model providers access to scrape their

Cloudflare's new marketplace will let websites charge AI bots for scraping | TechCrunch

Jerome Cody

Publishers are relying on a decades-old robots.txt file to block AI bots from scraping their content. The problem: newer bots from the likes of Amazon and Meta keep popping up, making it harder to stay ahead.

https://sherwood.news/tech/big-techs-onslaught-of-ai-bots-forces-publishers-to-play-an-impossible-game/?utm_term=wews/?utm_source=snacks_sendgrid&utm_medium=email&utm_campaign=snacks_20240826

Publishers are relying on a decades-old robots.txt file to block AI bots from scraping their content. The problem: newer bots from the likes of Amazon and Meta keep popping up, making it harder to stay ahead.  https://sherwood.news/tech/big-techs-onslaught-of-ai-bots-forces-publishers-to-play-an-impossible-game/?utm_term=wews/?utm_source=snacks_sendgrid&utm_medium=email&utm_campaign=snacks_20240826

Sam Mendoza

Reddit is not happy with data scraping: Reddit has deals with Google and OpenAI, limiting who can ingest and use its data. Keeping other companies from helping themselves has proved to be a “a real pain,” the company’s CEO Steve Huffman said. While many scribblers and doodlers and talkers and singers have complained about AI-related data scraping and use, hearing the same from technology companies may carry more weight. Thanks to Reddit, the complaints are now coming from inside the tech industry.

https://www.theverge.com/2024/7/31/24210565/reddit-microsoft-anthropic-perplexity-pay-ai-search?utm_source=thisweekinstartups.beehiiv.com&utm_medium=newsletter&utm_campaign=meta-beats-the-street-as-open-source-ai-gets-a-boost&_bhlid=6c2f82cafa96684cc7e5811f543fd3023d9404a1

Reddit is not happy with data scraping: Reddit has deals with Google and OpenAI, limiting who can ingest and use its data. Keeping other companies from helping themselves has proved to be a “a real pain,” the company’s CEO Steve Huffman said. While many scribblers and doodlers and talkers and singers have complained about AI-related data scraping and use, hearing the same from technology companies may carry more weight. Thanks to Reddit, the complaints are now coming from inside the tech industry.  https://www.theverge.com/2024/7/31/24210565/reddit-microsoft-anthropic-perplexity-pay-ai-search?utm_source=thisweekinstartups.beehiiv.com&utm_medium=newsletter&utm_campaign=meta-beats-the-street-as-open-source-ai-gets-a-boost&_bhlid=6c2f82cafa96684cc7e5811f543fd3023d9404a1

Reddit says Microsoft’s Bing, Anthropic, and Perplexity have scraped its data without permission. “It has been a real pain in the ass to block these companies.”

Reddit CEO says Microsoft needs to pay to search the site

Wired and Proof News published a report showing over 48,000 popular YouTube channels have had their videos scraped and used for AI training data. Channels scraped include MeBeast, Marques Brownlee, Jacksepticeye, PewDiePie, and many others.

https://www.wired.com/story/youtube-training-data-apple-nvidia-anthropic/?utm_source=substack&utm_medium=email

Wired and Proof News published a report showing over 48,000 popular YouTube channels have had their videos scraped and used for AI training data. Channels scraped include MeBeast, Marques Brownlee, Jacksepticeye, PewDiePie, and many others.  https://www.wired.com/story/youtube-training-data-apple-nvidia-anthropic/?utm_source=substack&utm_medium=email

“It’s theft.” A WIRED investigation found that subtitles from 173,536 YouTube videos, siphoned from more than 48,000 channels, were used by Anthropic, Nvidia, Apple, and Salesforce to train AI.

Bobby

A group of likeminded people in Artificial Intelligence are talking about this.