HACKER Q&A
📣 amichail
Would ChatGPT semantic token coloring give insight into its replies?
For example, it could highlight important tokens in the context window as it outputs each word in its reply.
👤 minimaxir
Accepted Answer ✓
Those token highlighters work by using the token selection probability, which you can do already with the logprobs parameter to the API.
The old GPT-3 web UI had it and it was removed since it's not as valuable as you would think.