Young-Duk Park, Kyung-Ho Loken-Kim, Larel Fais.
An Experiment for Telephone versus Multimedia
Multimodal Interpretation: Methods and
Subject's Behavior
Abstract:We performed an experiment to investigate the user's conversational behavior when
communicating with a multimedia and multimodal interpreting service. The experiment
was carried out for two tasks (asking direction and making hotel reservations) and
participants used two kinds of experimental terminals: a telephone and a multimedia
multimodal terminal. The collected experimental data were the speech of clients, agents,
and interpreters, and the interpreter's computer screen. We analyzed the collected data
from the viewpoint of linguistic and paralinguistic behavior. From the experiment results,
it is clear that the multimedia and multimodal communication is necessary and very useful
to the users in the interpreting telecommunication. However, the multimedia and
multimodal affects the dialogue pattern, and conventional media processing schemes
should be changed in the multimedia interpreting service.