The Multimodal Interaction Activity is an initiative from
W3C
The World Wide Web Consortium (W3C) is the main international standards organization for the World Wide Web. Founded in 1994 and led by Tim Berners-Lee, the consortium is made up of member organizations that maintain full-time staff working to ...
aiming to provide means (mostly
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
) to support
Multimodal interaction
Multimodal interaction provides the user with multiple modes of interacting with a system. A multimodal interface provides several distinct tools for input and output of data.
Introduction
Multimodal human-computer interaction refers to the ...
scenarios on the
Web.
This activity was launched in 2002. The Multimodal Interaction Framework
Working group
A working group, or working party, is a group of experts working together to achieve specified goals. The groups are domain-specific and focus on discussion or activity around a specific subject area. The term can sometimes refer to an interdis ...
has already produced :
* the Multimodal Interaction Framework, providing a general
framework for
multimodal interaction
Multimodal interaction provides the user with multiple modes of interacting with a system. A multimodal interface provides several distinct tools for input and output of data.
Introduction
Multimodal human-computer interaction refers to the ...
, and the kinds of markup languages being considered.
* A set of
use case
In software and systems engineering, the phrase use case is a polyseme with two senses:
# A usage scenario for a piece of software; often used in the plural to suggest situations where a piece of software may be useful.
# A potential scenario ...
s.
* A set of core requirements, which describes the fundamental requirements to address in the future specifications.
The set of devices that are considered are
mobile phone
A mobile phone, cellular phone, cell phone, cellphone, handphone, hand phone or pocket phone, sometimes shortened to simply mobile, cell, or just phone, is a portable telephone that can make and receive calls over a radio frequency link whi ...
s, automotive telematics,
PCs connected on the
Web.
Current work
The following
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
specifications (currently in advanced Working draft state) are already addressing various parts of the Core Requirements :
* ''EMMA (Extensible Multi-Modal Annotations)'': a data exchange format for the interface between input processors and interaction management systems. It will define the means for recognizers to annotate application specific data with information such as confidence scores, time stamps, input mode (e.g. key strokes, speech or pen), alternative recognition hypotheses, and partial recognition results etc.
* ''
InkML'' – an
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
language for digital ink traces: an XML data exchange format for ink entered with an electronic pen or stylus as part of a multimodal system.
* ''Multimodal architecture'': A loosely coupled architecture for the multimodal interaction framework that focuses on providing a general means for components to communicate with each other, plus basic infrastructure for application control and platform services.
*''
Emotion Markup Language'': EmotionML will provide representations of emotions and related states for technological applications.
See also
*
Multimodal Interaction
Multimodal interaction provides the user with multiple modes of interacting with a system. A multimodal interface provides several distinct tools for input and output of data.
Introduction
Multimodal human-computer interaction refers to the ...
*
VoiceXML
VoiceXML (VXML) is a digital document standard for specifying interactive media and voice dialogs between humans and computers. It is used for developing audio and voice response applications, such as banking systems and automated customer service ...
– the
W3C
The World Wide Web Consortium (W3C) is the main international standards organization for the World Wide Web. Founded in 1994 and led by Tim Berners-Lee, the consortium is made up of member organizations that maintain full-time staff working to ...
's standard
XML
Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
format for specifying interactive voice dialogues between a human and a computer.
*
SSML – Speech Synthesis Markup Language
*
CCXML Call Control eXtensible Markup Language (CCXML) is an XML standard designed to provide asynchronous event-based telephony support to VoiceXML. Its current status is a W3C recommendation, adopted May 10, 2011. Whereas VoiceXML is designed to provid ...
– Call Control eXtensible Markup Language
*
SCXML – an XML language that provides a generic state-machine based execution environment
Useful Links
Multimodal Interaction Activity on W3C siteThe W3C Multimodal Architecture, Part 1: Overview and challengeson IBM DeveloperWorks
{{DEFAULTSORT:W3c Mmi
World Wide Web Consortium standards
XML-based standards
Multimodal interaction