Now they have very long context windows, ability to upload and parse through files, custom system prompts, can work with images, remember user history across chats...
So what's the unique value adds in other products that are using chatbots?
My 'hot take' currently is that the core product of chatgpt and similar bots is so good that there's very little value to 'wrapper' apps/products. I'm a heavy tech user and all of my use cases and problems I can solve with the core chatgpt right now.
The only real limitations and problems I can think of are:
- privacy, though there seem to be modes for not using/storing your data, depending on your level of trust of the companies, - reliance on internet, I suppose one day I'd need a local chatbot with gpt4 capabilities somewhere remote, - maybe file uploads (and RAG capabilities) are limited on the core gpt4/claude sites, though I'm not sure this will remain the case for any length of time.
So yeah I'm not sure what unique value 'wrapper' products are providing, but I'd love to see examples and be proven wrong and hopefully learn something new.
Similarly, an AI on a writing platform such as Overleaf can suggest better sentences because it already has the context of the entire essay.
The second important part is actions. ChatGPT can output a table, but an AI agent in my spreadsheet app can directly make changes to the tables. Similarly, the AI agent can summarize an online meeting, and email / slack the team members their respective tasks as discussed.
I am also sure tomorrow there will be another new thing.
I think of a little like Notepad++ for llm's instead of just Notepad.
I use it hourly, in the morning I have a summery of HN from overnight along with news, and reminders.
I host it on Digital Ocean, it uses about 15-20 API's from AI companies but also web search, document and kv stores etc.
Interested in trying it let me know.