Why does OpenAI use a search bot?

Question

I saw in the logs of my blog that there was two access by an "https://openai.com/bot".It certainly does not bother me, in the same time frame Google came 449 times which I find a great way to waste resources.But what does OpenAI do with a search engine?

chiph · Accepted Answer

That's how it gets trained with data - by searching the internet. It's the subject of a couple of lawsuits over copyright.https://www.nytimes.com/2023/12/27/business/media/new-york-t...

Why does OpenAI use a search bot?

I saw in the logs of my blog that there was two access by an "https://openai.com/bot".
It certainly does not bother me, in the same time frame Google came 449 times which I find a great way to waste resources.
But what does OpenAI do with a search engine?

That's how it gets trained with data - by searching the internet. It's the subject of a couple of lawsuits over copyright.
https://www.nytimes.com/2023/12/27/business/media/new-york-t...