Member-only story

🎼 🤖 AI May Pirate Music And Movies

Tom Smykowski
3 min readAug 9, 2023

--

We went a long road since Web was born. When search engines became popular, a robots.txt file was introduced. With that file you were able to block search engine crawlers from indexing your website.

Since that said, Google, and other entities didn’t have to have permission to index your website.

There was a great reason why it stood. Because search engines brought people to your website.

In these glorious days of the Web, big tech found a way to earn money, but also offer something useful while making sure none of content creators, artistists, and even serious companies including law firms sued them for using their content.

Driving traffic to a website had a great value for everyone, who’s content was being used by Google and other search engines.

Now, years later, in 2023 I’m reading onlime creators writing that you can use robots.txt file to opt-out from ChatGPT crawlers.

Fantastic, you’d think.

But there’s an important point to make here. Not me, not anyone else sees any value from their website being crawled by ChatGPT and used to train AI models.

I won’t get traffic from ChatGPT, because ChatGPT doesn’t list sources of it’s mashups.

--

--

Tom Smykowski
Tom Smykowski

Written by Tom Smykowski

🚀 Senior/Lead Frontend Engineer | Angular · Vue.js · React | Design Systems, UI/UX | Looking for a new project! 📩 contact@tomasz-smykowski.com

No responses yet