A multi modal interface for a visually impaired pupils educational environment

The aim of this paper is to describe a multi modal user interface integrated within an architecture allowing visually impaired pupils and sighted people to work on the same station. This architecture is developed to face the problem of the inclusion of visually impaired pupils in mainstream education. The system is able to display the same original multi-media content converted in different ways on screen, Braille terminal and vocal synthesizers. It accepts various interactions from keyboard, Braille bar and mouse. Both blind and sighted users can manage the same tools, cooperate together on the same content, and thus perform the same activities. Blind pupils may be assisted by sighted teachers or tutors that don’t know how to read Braille characters