It does return invalid results quite often, but so has google for the last 20 years. And like google when it returns the right answer it’s such a time saver that it is a complete game changer. The ai accuracy can improve and there will be a lot of financial and social pressure to improve them.
I’ve been in tech over 30 years, to me it’s pretty obvious this will be as impactful as Google was, and probably more.
Even as GPT continues to improve, mistakes will never be completely unavoidable. In fact, mistakes can be quite insidious because GPT is so often right, lulling users into a false sense of intelligence. (Especially the current iteration, which can be quite stubborn and confidently wrong even when confronted about mistakes, although this might improve in future models.)
I suspect that much like machines in the field of translation, GPT will help improve and speed up many processes, but still require human oversight.
Will the potential be realized, be cost-effective for the masses, etc? Not so sure.
I've seen it wrong on book details like characters and motivations, even when wikipedia and goodreads shows its wrong. Actually calling me out as clearly wrong until I pasted the wikipedia article. No idea if it reads the wiki articles or just said Sorry.
Its really bad in some areas, programmed to avoid details about communism like motivation, genocide and death totals. Think its avoids placing blame in its design. So history appears to be a weakness.
Asked it write stories, and it cant think outside the box much, its really limited to the input of what you tell it.
Even including stable diffusion, I think artists and writers wont have any major competition.
Document writers will be the first to be replaced. I suspect it can scan code and write documents and git comments well enough. Anything document parsing related will be the best area for instant use.