The video shows the communication robot Robotinho, developed at the University of Freiburg, Germany, showing its skills.
Humanoid Communication Robot Robotinho Gestures Speech Emotional Facial Expressions
For an RMIT seminar, I've put together an example of how communication research may be presented in the near future.
The problem of semantic annotation (labeling) of space can be described as assigning meaningful semantic descriptions (eg "corridor" or "kitchen") to areas in the environment. Typically, semantic labeling is used as a way of augmenting the internal space representation of a robot with additional, more abstract information. This can be used by the robotic agent to enhance communication with a human user or to reason about space. This video presents a real-time experiment with building a multi-layered spatial representation with semantic place information based on multi-modal sensory input (vision and laser range data).
A person with ALS using multiple different methods in order to communicate. Both high tech and low tech communication are important parts of a complete Augmentative Communication System.
ALS AAC Augmentative Communication Amyotrophic lateral sclerosis Lou Gehrig's disease Dasher
Improve team working and enterprise-wide collaboration using a combination of IBM Sametime presence and instant messaging and multi-vendor enterprise telephony and video in an intuitive, unified experience. Multi-modal communication from the desktop helps end users connect, communicate and collaborate to deliver projects without delay. Watch the video highlighting the Avaya ACE IBM Sametime Integration packaged application. For more information, visit ACE on www.avaya.com.
Avaya ACE Aura communications-enable enterprise instant messaging presence multi-vendor multi-modal
The YTTM is a cognitive model of multimodal realtime turntaking that has been tested in numerous two-party dialogue systems. This video shows an extension to the model that allows it to be used to control agents in realtime multimodal dialogue. Up to 12 agents have been tested.
YTTM turntaking dialogue turn taking multiparty multimodal communication realtime interaction humanoid agent cognitive robotics Kristinn R. Thorisson Kris Thorisson Ymir Thorisson cognitive architecture artificial intelligence CADIA Reykjavik University IIIM
This video highlights the tight integration between Microsoft Office Communicator clients and Avaya Aura Communication Manager to provide a seamless, intuitive end user experience for multi-modal communications. Using Avaya Agile Communication Environment (Avaya ACE™), customers who have chosen Microsoft for desktop instant messaging and presence can leverage their existing investment in Avaya Aura equipment, reliability and performance for telephony. This reduces the cost of deployment and provides the customer with an applications enablement platform for communications-enabled business applications. Learn more at www.avaya.com.
An English 103 Multimodal Assignment during the Fall '08 semester at Clemson University. Made by Mike Johnson, Chad Holt, and Chris Schultz.
This is a demonstration of a novel system to support annotation of digital documents using syncrhonized pen, ink, and pointing. The system enables the user to mark up a document, as well as gesture and point, with a pen, while speaking, and have all of this recorded and then mailed with the document. The resut is that recipients got a message that provided natural "over the shoulder" presentation of the sender's comments. What is remarkable is that this work was done in 1989, and yet, while being of significant potential value, this capability is still not available on today's systems. This video was produced in 1989 and was circulated as part of the ACM SIGGRAPH Video Review 45, Copper Gilloth and Bill Buxton, editors.
wang freestyle wang laboratories multi-modal communication pen computing annotation voice messaging rich media
The NAVIgoid consists of master wearable robot (ProInterface with head mounted display) and intelligent mobile robot (mobile platform, stereo cameras, and laser range finders). The novelty of our idea is to engage the user into teleoperation and provide a high level of immersion through proprioceptive telepresence and tactile feedback. The developed interface allows the operator to use their body posture and gestures for controlling the mobile robot and at the same time to feel the remote object through tactile stimuli. Human operator is capable of changing the robot traveling direction in a smooth and natural manner by twisting and bending the trunk. The torso along with the flex sensors acts as joystick. For example, to move the robot forward or backward, the user leans the torso slightly forward or backward, correspondingly. The tactors of ProInterface vibrate to produce the tactile stimuli indicating the direction, distance, shape, and mobility of the moving obstacle (object, human, etc.). The haptic vision allows operator to feel the entire space around the mobile robot and to devote visual faculties to the exploration of the remote dynamic environment. The developed technology potentially can have a big impact on multi-modal communication with remote robot engaging the user to utilize as many senses as possible, namely, vision, hearing, sense of touch, proprioception. Developers: Assistant Professor Dzmitry Tsetserukou, PhD candidate Junichi Sugiyama, Professor Jun <b>...</b>
telexistence telepresence haptic and tactile display robot navigation proprioception wearable robot sense of touch body as joystick mobile robot
This video shows a VISSIM simulation of a forecourt as for a railway station or an airport. Here multiple transport modes appear within a short range and also interact with each other. VISSIM can handle all this in a multi-modal traffic simulation. It includes in one simulation software the ability to simulate individual motorized traffic of any kind, public transport, cyclists, and pedestrians -- and even other vehicles such as rickshaws as well. All these modes of traffic and transportation are not only simulated next to each other, but they can interact. Simply spoken: pedestrians can cross streets, operate traffic lights and board to and alight from buses, trains and trams. This allows for a wide range of applications ranging from signal control optimization to passenger transfer times in stations; from arterial benefit assessment to emergency egress simulation; from BRT to PRT (Bus Rapid Transit to Personal Rapid Transit); and from C2X to LRT (car-to-infrastructure communication to Light Rail Transit). www.ptv-vision.com
PTV PTV Vision VISSIM VISWALK multi-modal traffic simulation traffic simulation traffic planning traffic modeling transportation public transport station airport tram cabstand taxi vehicle railway BRT road rail transfer times bike cyclist crowd simulation underground subway Rail transport
Students need literacy skills to match their knowledge environments. UNESCO (2003) framed its Literacy Decade positioning literacy as a freedom beyond reading and writing, to include capacities for communication and equal participation in the world. This recognizes multiliteracies (New London Group, 1996) and a knowledge paradigm of multi-modal, constantly shifting, non-linear communication, especially in digital form, that has shifted how we understand literacy. Literacy development today must focus on active engagement with the semiotics of narrative; our students can no longer consume information but must actively shape knowledge. To do this, they need a high metacognition of information and narrative conventions, and an awareness of information plurality and malleability to confidently participate in interpreting, selecting and designing meaning. Postmodern picture books are very useful in K-12 literacy and cross-curricula applications. Meta-fictive, hyperlinked, open narratives with multiple interpretations necessarily constructed by the viewer define postmodern picture books (Anstey, 2002; Dresang, 1999; Goldstone, 2004; Serafini, 2005) making them relevant and effective resources for this purpose. Jon Scieszka & Lane Smith's The Stinky Cheese Man, David Weisner's The Three Pigs, Pat Hutchins Rosie's Walk, among others, foreground meaning making processes, and the inter-textual nature of reading and writing. They are also at once appealing to reluctant readers while <b>...</b>
postmodern literacy picture books learning postmodern picture books multiliteracies
Speaker: Bert Bos A look at the upcoming standards by W3C W3C is developing several new Web technologies and modules for existing technologies, many of which have to do with the requirements of new, mobile devices. This talk will look at a few of them. For more information visit: bit.ly To download the video visit: bit.ly
22C3 chaos communication congress private investigations w3c developing web technologies
Developed by Alexis Zerroug and Alvaro Cassinelli at the University of Tokyo, Ishikawa Komuro Lab (Laval 2011 Jury Grand Price). The aim of the "invoked computing" project is to develop a multi-modal AR system able to turn everyday objects into computer interfaces or communication devices on the spot. To "invoke" an application, the user needs just to mimic a specific interaction scenario; miming will prompt the ubiquitous computing environment to "condense" on the real object, by supplementing it with artificial affordances instantiated thanks to common AR techniques. An example: taking a banana and bringing it closer to the ear. The gesture is clear enough: directional microphones and parametric speakers hidden in the room would make the banana function as a real handset on the spot. Another example: to invoke a laptop computer, the user could take a pizza box, open it and "tape" on its surface). We are interested here on developing a multi-modal AR system able to augment objects with video as well as *sound* (in addition to the usual camera and projector pair, we are using parametric speakers. The parametric speakers project a low divergence ultrasound beam that becomes audible (demodulated) when touching a real object. . Hardware: mac mini, led projector, pointgrey camera, IR source, parametric speakers, arduino and servomotors Software: OpenFrameworks, Artoolkit, opencv, arduino For more: www.k2.tu-tokyo.ac.jp
augmented reality invoked computing ubiquitous camera calibration alvaro cassinelli alexis zerroug ishikawa laboratory parametric speakers
the Voice Painter is a multimodal interface for painting with voice. It has been developed at University of Padova (Italy) by the Sound & Music Computing Group. The tracking of the user position is performed with an 8-microphones array. The voice features are mapped into graphical features according to a "phonestetic" mapping function.
voice painter sound music computing microphone array source localization enactive interface audio unipd
Montage of video of GCRT reference design proposal captured from UC 3D visualisaiton software. Scenes have accurate geometry, behavioural animations and simulations. Suited to complex, multi-modal engineered spaces. www.circus3d.com or www.urbancircus.com.au
Urban Circus 3D virtual reality VR interactive intelligent digital computer software technology 4d real-time render video animation simulation visualisation Engine sectors design communication construction engineering transport highway road tunnel intersection transportation transit metro bus rail station public alighting disembarking platform modal interchange Southport Gold coast light rapid route
EON Coliseum is a technology platform built on top of EON Studio that enables building multi-modal virtual communication applications a breeze. Users can enjoy the same convenience of an intuitive drag-and-drop graphical interface in EON Studio to construct collaborative virtual environments. Functions such as displaying live video feeds, Voice-over-IP and external data connection are embedded in EON Coliseum nodes and users can make use of them in conjunction with other node types in EON Studio. Users can select from a wide range of multi-media options with EON Coliseum™ to realize the most demanding presentations.
•Interactive Real time 3d •Artificial reality •Mixed •Augmented •CAVE Cave Automatic Virtual Environment •Computer graphics •Second Life •Simulated
Some scenes from the final demonstration of team NimbRo in the RoboCup@Home competition. The competition took place at Hannover Messe in April 2009. The communication robot Robotinho gave for a guest a tour though the apartment while robot Dynamaid offered the guest a drink that she fetched from the kichen and delivered to the couch.
Humanoid service robot Robotinho Dynamaid intuitive multimodal communication object manipulation
Compilation of tests and demonstrations of team NimbRo in the RoboCup German Open 2009 @ Home competition, which took place at Hannover Messe. The robots Robotinho and Dynamaid show their skills in intuitive multimodal communication with users, robost navigation in indoor environments, and object manipulation.
humanoid robot domestic service robocup @Home nimbro human-robot-interaction communication manipulation
Animation from VR model of Baxter Interchange built for Linking Melbourne Authority, Department of Transport, Victoria. Intelligent 3D/4D virtual design technology. Accurate modelling, animations and simulations for complex, multi-modal engineered spaces. All these videos are captured directly from our simulation software, the Urban Engine™. No pre-rendering has been applied anywhere. www.circus3d.com - Clients enjoy radically accelerated production and design times and unsurpassed quality in intelligent cinematic virtual environments.
Urban Circus 3D virtual design technology reality VR interactive intelligent digital render video animation simulation visualisation Engine communication construction engineering features shadows timeline sequencing characters traffic vehicles applications training induction verification validation audit flythrough walk-through imagery transport highway road tunnel portal overpass intersection bridge vehicle car transportation transit
Intelligent 3D/4D virtual design technology. Accurate modelling, animations and simulations for complex, multi-modal engineered spaces. All these videos are captured directly from our simulation software, the Urban Engine™. No pre-rendering has been applied anywhere. www.circus3d.com - Clients enjoy radically accelerated production and design times and unsurpassed quality in intelligent cinematic virtual environments.
Urban Circus 3D virtual design reality VR interactive intelligent digital computer software technology 4d real-time render video animation simulation visualisation Engine sectors communication construction engineering features shadows timeline sequencing characters traffic vehicles training induction verification validation audit flythrough walk-through imagery
Demonstration of intuitive multimodal communication between visitors of the Science Days in Rust and the humanoid robot Fritz of team NimbRo. Including speech recognition/synthesis, face tracking, eye contact, head motions, emotional facial expressions, and arm gestures.
Intelligent and cinematic 3D virtual design technology with accurate geometry, behavioural animations and simulations for complex, multi-modal engineered spaces. Videos captured directly from our Urban Engine™ software. www.circus3d.com
Urban Circus 3D virtual reality VR interactive digital computer software technology 4d real-time render video animation simulation visualisation Engine sectors design communication construction engineering features shadows timeline sequencing characters traffic vehicles training induction truck car signal lights
Quick example of construction sequencing using the UC Virtual Design Technology Optioneering Feature. Intelligent 3D/4D virtual design technology. Accurate modelling, animations and simulations for complex, multi-modal engineered spaces. All these videos are captured directly from our simulation software, the Urban Engine™. No pre-rendering has been applied anywhere. www.circus3d.com - Clients enjoy radically accelerated production and design times and unsurpassed quality in intelligent cinematic virtual environments.
Urban Circus 3D virtual reality VR interactive intelligent digital computer software technology 4d real-time render video animation simulation visualisation Engine sectors design communication construction engineering training induction verification validation audit transport highway road tunnel portal overpass intersection bridge vehicle car transportation transit
----- This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0
philosophy skeptical relativism multimodal spectral communication
Intelligent and cinematic 3D virtual design technology with accurate geometry, behavioural animations and simulations for complex, multi-modal engineered spaces. Videos captured directly from our Urban Engine™ software. www.circus3d.com
Urban Circus 3D virtual reality VR interactive digital computer software technology 4d real-time render video animation simulation visualisation Engine sectors design communication construction engineering features shadows timeline sequencing characters traffic vehicles training induction
ComBiom, Communication Biometrics: Multimodal, simultaneous biometric authentication with random challenge response (one time password). Be sure it is you. BIOMETRY.com AG
BIOMETRIC AUTHENTICATION FOR SECURE WORLD: combiom Communication Biometrics: Multimodal simultaneous
