What is the AI that Ray Kurzweil talks about in Lex Friedman?

Question

I was watching the Lex Friedman with Ray Kurzweil podcast and Ray Kurzweil mentions this AI where it reads 200,000 books and if you ask it a question, it will find you a sentence that best answers your question. He said it came out 6 years ago?I got interested in it and wanted to look into it but couldn&rsquo;t find what it isAnyone know what this AI is?

tiagofreitas87 · Accepted Answer

Found it: https://experiments.withgoogle.com/talk-to-books

tiagofreitas87 · Answer

He specificaly said it was a product that was probably still available on the market. Sounds really interesting and hard to find, I hope something like this comes out based on LLMs that can be easily fine tuned.

alexcnwy · Answer

I suspect it&rsquo;s this model or something similar: https://arxiv.org/abs/1611.01604Question Answering is a rich area of research in NLP - this is a good place to start: https://paperswithcode.com/task/question-answering

brutus1213 · Answer

Most modern language models seem to do that to an extent. Even github's co-pilot sort of does this (with code instead of books). The models can even synthesize, which starts getting really impressive. Check out Flamingo from Google, which is a VLM (vision-language model). There, it can answer questions about the content of new images and even incorporate new information.