Are there any LLMs specialised in translating Japanese to English?

Question

I'm interested in LLM that I could spin up locally and that gives decent translation results for hiragana/katakana only text. I'm trying to play old Japanese video games using a text hooker, and not having kanji makes translations often incorrect and, in very rare cases, just funny. If translation could be influenced by "setting a scene" before translating, that could be even better.

brucethemoose2 · Accepted Answer

Try llama v1 13B with https://huggingface.co/izumi-lab/llama-13b-japanese-lora-v0-...
There may be even larger llama tunes for Japanese... But huggingface is tricky to search.
I would suggest baking the LORA into a ggml file and then running it with koboldcpp (with opencl offloading) for maximum ease of use.
https://github.com/LostRuins/koboldcpp
You could get even better results using Japanese llama.cpp grammar, but I have not been down that rabbit hole:
https://github.com/ggerganov/llama.cpp/pull/1773