When a speaker spontaneously draws, what is the correlation between visual focus movements over the drawing and focus movements in the discourse? How is the listener's internal image constructed from the spoken discourse? We studied these questions empirically by transcribing spoken language data into intonation units and comparing them to events in the drawing. In our analysis, we employed an image oriented semantics. Several visual processes could then be identified in spoken conversation. A number of small markers, which we named attention movers, played a fundamental role in marking the transition between focuses of attention. And, when building his/her internal image, the listener simply superimposes the lexical images of words and int...
Earlier work has shown that speakers naming several objects usually look at each of them before nami...
In multimodal human machine conversation, successfully interpret-ing human attention is critical. Wh...
Speech prosody has traditionally been analyzed in terms of acoustic features. Although visual featur...
In this paper, we concentrate on the reconstruction of the participants' internal images during spok...
While there is a growing body of psycholinguistic experimental research on mappings between language...
We cannot directly uncover the contents of our mind but we can come closer to cognitive processes vi...
Although language usually occurs in an interactive and world-situated context (Clark, 1996), most re...
AbstractTwo experiments explored the mapping between language and mental representations of visual s...
In everyday communication, semantic information is transmitted by both speech and the gestures that ...
Two experiments explored the mapping between language and mental representations of visual scenes. I...
Participants saw a small number of objects in a visual display and performed a visual detection or v...
In his book Visual thinking, Arnheim (1969) writes: ... cognitive operations called thinking are not...
Processing of discourse seems to be far from uniform with much evidence indicating that it can be qu...
In describing images, visual and linguistic processes coordinate with each other and they both proce...
that visual perception can influence and be influenced by concurrent linguistic input has prompted t...
Earlier work has shown that speakers naming several objects usually look at each of them before nami...
In multimodal human machine conversation, successfully interpret-ing human attention is critical. Wh...
Speech prosody has traditionally been analyzed in terms of acoustic features. Although visual featur...
In this paper, we concentrate on the reconstruction of the participants' internal images during spok...
While there is a growing body of psycholinguistic experimental research on mappings between language...
We cannot directly uncover the contents of our mind but we can come closer to cognitive processes vi...
Although language usually occurs in an interactive and world-situated context (Clark, 1996), most re...
AbstractTwo experiments explored the mapping between language and mental representations of visual s...
In everyday communication, semantic information is transmitted by both speech and the gestures that ...
Two experiments explored the mapping between language and mental representations of visual scenes. I...
Participants saw a small number of objects in a visual display and performed a visual detection or v...
In his book Visual thinking, Arnheim (1969) writes: ... cognitive operations called thinking are not...
Processing of discourse seems to be far from uniform with much evidence indicating that it can be qu...
In describing images, visual and linguistic processes coordinate with each other and they both proce...
that visual perception can influence and be influenced by concurrent linguistic input has prompted t...
Earlier work has shown that speakers naming several objects usually look at each of them before nami...
In multimodal human machine conversation, successfully interpret-ing human attention is critical. Wh...
Speech prosody has traditionally been analyzed in terms of acoustic features. Although visual featur...