2023 LLM model Translation Survery Results
Results from my 2023 Survey on Translation using different LLM models
In 2023 I made a survey asking netizens to rate the translation of a paragraph of an XianXia novel by different LLM models to see how they fare against the Human translation.
In total about 37 readers conducted the survey (thanks a lot !) and here are the results:
I'll probably do another one for models in 2024 with the same prompt and text, to see how much it has evolved.
survey link: https://form.jotform.com/233077764011048
|
LLMs |
Approval Ratings |
|
Bard |
78.18% |
|
llama-2-70b-chat |
76.36% |
|
Human Translation |
76.36% |
|
Falcon-180B |
65.45% |
|
Vicuna-33B |
58.18% |
|
Qwen-14B |
54.55% |
|
Google Translate |
52.73% |
|
GPT4 |
49.09% |
|
Claude2 |
32.73% |