HACKER Q&A
📣 StopHammoTime

Anyone else had problems with ChatGPT returning real looking, fake DOIs?


Anyone else had problems with ChatGPT returning real looking, fake DOIs?


  👤 StopHammoTime Accepted Answer ✓
I'm trying to use ChatGPT as a search engine to see how effective it is at assisting me with things I'm researching. However, I've noticed that multiple times it just makes up journal article titles and pairs them with metadata from actual journal articles. I haven't actually been able to get a DOI that has linked to an actual article yet. When you tell it, it's done something wrong it just makes up completely random DOIs that you can't even find in a search.

I know it's not meant to be trustworthy as a data source, but this seems like ChatGPT is just outright lying to me?

For context, I asked the following questions: 1/ What problem did tools like flightradar24 solve and can you provide me some academic references outlining these 2/ Can you give me DOI references for those three references please

I actually can't find the articles in the listed journals at those locations either so it's not just a metadata match issue. The articles just do not seem to exist at all.

Linked my twitter post with images of the real articles along with the list that ChatGPT supplied to me.