GPT-3.5, Bard, Bing is free -- any real advantage? specially considering limited acess for individual users? (even after paying)
Now there is even a waitlist to pay for it. I am hitting the capability wall of free version regularly.
If you are using it, are you not running into 50 per month limit? Is that enough for you? << seems like 50 per month is wrong it is 50 per 3-4 hours, but it seem to change sometime. I can probably hit 50 per 3-4 hours limit trivially when I'm focused. I have been throttled of hackernews/reddit/etc for posting too fast for example.
(UK based if that matters)
PS. I'm using copilot. But I see that it works fine as a autocomplete for Python. I tried using it for C++ but I had to delete chunk of it as I ran into segmentation faults (very easily). It is defenitely good at generating tests tho.
Yes, GPT4 is very noticeably smarter than GPT 3.5 or any of the competitors like LLAMA 2. I rank almost all LLMs at the same level as a high school student, and GPT4 at the level of a graduate student just starting out as a junior employee.
However, I don't need a "junior" assistant, I need more of "me", which GPT4 can't currently emulate.
If I were to hire a flesh & blood human junior tech, that would be with the expectation that the junior would learn with time and pick up the specific techniques and approaches I prefer to use. Currently, GPT models cost an absurd amount of time, effort, and money to customise, and there's little chance that this would result in the equivalent of a trained employee.
These days I don't write much code, and the code that I write I can bang out faster than I can explain what I want to ChatGPT.
I've also found that the act of coding is a part of the learning process. I can't really understand something until I've taken it apart myself and put it back together again.
I keep telling my customers: I can teach it to you, but if I learn it on your behalf, you'll end up knowing nothing yourself.
For me ChatGPT has replaced a lot of Google searches and skimming stackoverflow just to get some details for a small obstacle in my workflow.
Even if answers are not a hundred percent correct all of the time, it saves so much time to get to “good enough”.
I use it to generate shell scripts, SQL queries and general boilerplate like configuration files.
A couple of days ago I went from “I’d like to have a local DNS server running to test one aspect of my code” to a running docker container of CoreDNS with the configuration I needed for my tests in a matter of minutes. The same task would have taken forever had I googled for the information myself and stitched together snippets from the docs until it worked the way I wanted.
I run into the message limit occasionally, but 50 messages per 3 hours is more than enough most of the time.
Note that if you don't pick "Creative Mode" or "Use GPT-4, you get Microsoft's own LLM.
There is a new GPT-4 Turbo available from OpenAI that is ahead of GPT-4 on many benchmarks:
https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...
My guess it that it will soon be incorporated into Bing Chat. So if money is tight, I would stick with Bing Chat (with the appropriate mode turned on). Note that Bing Chat is very different from vanilla Bing Search.
Bard and GPT 3.5 are decidedly inferior to GPT-4. I wouldn't waste my time using them.
Github Copilot is also markedly inferior to GPT-4 in generating code based on instructions.
Sometimes I get a little impatient waiting for Bing Chat to generate an answer. If the question is not too complicated, I have found perplexity.ai (w/o GPT-4) to be low latency and high factuality. In fact when searching for research papers on a topic, I have often found it superior to the alternatives.
ChatGPT Plus is one way of doing so and works fine. There is no 50 per month limit; not idea where you got that from. The limit is 50 per 3 hours, but I've honestly never hit it.
You can also just get an API key and use it that way via a number of different tools, wrappers, and frontends. Depending on your use case, that may be better or worse.
I currently do Java, Spring Boot and Rust development.
ChatGPT is at least 100 times better than Google Search for helping you with Hibernate/JPA stuff, especially related to eager fetching and joins of child entities with child entities with child entities. I recently struggled with an issue where ChatGPT helped me with a solution for using the ILIKE operator in PostgreSQL with Hibernate which doesn't support this operator. I implemented a workaround (https://olavgg.com/show/how-to-use-spring-boot-jpa-criteriab...)
It is crazy how fast I learn about new things that I don't know how to search for and most of the examples ChatGPT spits out do work 100%. If not, you're already 95% there and only need to apply a minor change! The power of ChatGPT makes me at least 100% more productive. I can do twice as much every day as I now have a lot less "blockers" wasting my days. This also makes programming a lot more fun :D
I use ChatGPT for writing letters and emails. It saves me tons of time. I also use it to generate quick emails and other things. I really like it and it's quick and convinient. I'm sure there are alternatives that I could run locally and I would like to avoid the restrictions that I run into every once in a while.
However, I don't think $20 a month is bad for writing letters and I prefer not to use a search engine that's trying to generate links when I'm just trying to write emails.
I generally don't use it for facts, I just tell it the facts in a few sentences and it cleans it up and generates the whole email and it's great.
I would say the nice thing about paying $20 a month is you get a reliable good service and aren't continually switching and second guessing it and they continually upgrade it and add new features.
- Majority of people find it useful at the price point. (only 2 disagree it seems from all the comments here)
- Instead of using chatgpt, directly using OpenAI API might make more financial sense and I might need to write a wrapper on top of their APIs (or use one that is already there)
- Limits are 50 or 40 per 3 hours. API to test that - https://chat.openai.com/public-api/conversation_limit (1 person say they have not hit the limit and there seem to be no limit, I cannot test that unfortunately)
- There is a waitlist for ChatGPT+ So I cannot pay even if I want to. :(
- Almost everyone agree GPT-4 is a lot better. (High school vs Degree level as someone has pointed out)
- There seem to be a cost dashboard with ability to set limits for API.
Though they change the limit based on the current load. It has been very low in the past and I hit the limit once or twice since the availability of ChatGPT plus.
You can check the current limit in this JSON document: https://chat.openai.com/public-api/conversation_limit
You don't need to be logged in.
It is worth it because of better access (no more "were busy now") and Gpt4.
Also in my take, yes chatgpt is worth it if you're working as a full tech stack person and you're often asked to accomplish tasks with unknown to you, but popular software. Then instead of searching through pages and pages of crappy docs (or when such docs do not exist) you can just ask chatgpt and then just verify(because it will be wrong a lot, but you can often get it to verify it's own answers).
For example, let's say you're very familiar with Jenkins and github, but your client asks you to port their cicd pipelines to on site gitlab. Then, considering a lot of stuff for gitlab enterprise are barely documented you'll spend lots of time experimenting. Having chatgpt at hand to speed this up is very beneficial.
Are you using an extension (with an API key) or copy/pasting in the web chat?
I do believe that it might be cheaper for many developers to pay per request using the API platform and use one of the many frontend clones with your API key.
I ran the numbers and it saves me a few hours a week on average, so it really pays for itself. If you don't use it then it doesn't make sense.
I'm a fairly senior developer and I use it quite a lot. I think 3.5 can do most of the things you need most of the time, but 4 and the API's help you save a lot of time. It's not really world changing in that it's still not very good at actually writing code that couldn't be auto-generated before LLM's, but it's just sooooooo much more efficient at doing all that auto-generation than what you had available before, and with the API's it integrates fairly seamlessly into many IDE's. Just remember to deny it access to any code that's actually secret. I work in the energy sector, so we actually has some of that, but 90% of what I've worked on over the decades could've frankly all been open source with not great issues. But again, it'll depend on what you do. If you're in HR, contract management or similar, you'll probably not be able to share much of what you do with it legally.
But like I started out saying, get your company to pay for your subscription if you use it for work. It's a tiny fee compared to a lot of the other money your company already spends on you.
Definitely worth the money. (Never run into the limit)
even at 500$ i would still think about it