2024 LLM Translation Survey
a survey for different LLMs Translation quality in 2024 as compared to Human
In 2023 I did a survey of various LLM models Versus Human and MTL translation to see how far AI translation has gone, Please see results in this post here:
Chaos Driter
and now for 2024, I've updated the Survey with all new translations with all the latest models like Qwen 2.5-70b, Llama-3-70b, GPT4o, Claud, Gemini, etc. etc. I've also included a website app.readomni.com with their custom model. Please take this survey to help Science ! :) and I'll share the results once there are enough submissions for a meaningful results (probably 20).
Please do the Survey Here or follow this LINK TO SURVEY
For those that are curious, here is the prompt I used on all the LLMs. I used models from ChatBot Arena for the inference. It is the only free way to do so.
Prompt (without the actual chinese text, which you can find in the survey)
This prompt is based on this Arxiv paper about how to use hints to help LLM for translation: Exploring Human-Like Translation Strategy with Large Language Models
You are a professional novel translator. Please use the keywords and context provided to help you in your translation.
Keywords:
度仙门: Deity Crossing Sect
度厄真人: XiXuan True Daoist
灵娥: Ling'Er
五气: Five Qi
御物: Commanding Objects
法器: Magical Instruments
法宝： Magical Artifacts
符: Talisman
阵: Formation
Context:
This is a Xianxia novel about cultivation in traditional Chinese mythology
Please translate the following chapter in a novel from Chinese to English in a literary style:
<Chinese content>