Mutsuko TOMOKIYO,Kentarou OGURA, Terumasa, EHARA
Evaluation of the output in Japanese to
English MT systems
Abstract:The chief purpose of this work is to establish the criteria for the evaluation of output
phrases in MT systems.
This evaluation is restricted to grammatical side of output phrases of computer-
generated natural language.
We extracted phrasal sentence fragments from the Japanese sentences, for example
"TO-IU-KOTO-DESHO-U-KA" and assigned them multiple translations, for
example"①That means~?" "② Does that mean~?" "③ Do you say ~?" etc.
The Japanese phrases were chosen to reflect the principal grammatical problems to
be realized in English output.
In cases where the Japanese expression "TO-IU-KOTO-DESHO-U-KA" is translated into one of①②③, we judged that this expression was correctly translated.
In our next step, we will be programming this evaluation method in order to
automatically estimate the MT system quality.