EyesWeb is an open software research platform for the design and development of real-time multimodal systems and interfaces.
EyesWeb is an open platform to support the design and development of real-time multimodal systems and interfaces. It supports a wide number of input devices including motion capture systems, various types of professional and low cost videocameras, game interfaces (e.g., Kinect, Wii), multichiannel audio input (e.g. microphones), analog inputs (e.g. for physiological signals). Supported outputs include multichannel audio, video, analog devices, robotic platforms. Various standards are supported, including OSC, MIDI, FreeFrame and VST plugins, ASIO, Motion Capture standards and systems (Qualisys), Matlab. EyesWeb supports real-time synchronized recordings of multimodal channels, and includes a number of software libraries, including the Non-Verbal Expressive Gesture Analysis and the Non-Verbal Social Signals Analysis libs. Users can develop proprietary software libs using the EyesWeb development environment. The EyesWeb software includes a development environment, a distributed run-time system (supporting Windows, Linux, and mobile platforms) to create distributed or networked real-time applications, and an open set of libraries of reusable software components. The development environment supports the design process of multimodal interactive systems, enabling users to build systems by means of a visual programming language, which presents some analogies with computer music languages inspired to analog synthesizers or to software systems like Simulink. EyesWeb is conceived, designed and developed by InfoMus Lab. The EyesWeb project started in 1997, as a natural evolution of the HARP Project. The current release of the open software platform is EyesWeb XMI (eXtended Multimodal Interaction). The EyesWeb software platform has been adopted in EU projects in the 5th, 6th and 7th Framework Programme (ICT), and by thousands of users worldwide for scientific research, education, and industry applications. For example, EyesWeb was selected by INTEL in 2008 for their hardware for "independent living", and was adopted at the New York University Summer Program on "Music, dance and new technologies" (2004 - 2006).
An interactive choreographic performance, stages a dialog between a dancer and her multiple selves, embodied in an autonomous and unpredictable visual and aural creature, which emanates from her psyche as interpreted by optical and body sensors.
By downloading any of the software below you agree with the license agreement.
EyesWeb installers (stable versions):
EyesWeb Software Development Kits (SDK):
Forum is available at the following link
Bugzilla is available at the following link
Our YouTube channel is available at the following link
Research Project at CSC - University of Padova on Preservation of Interactive Multimedia Installations link Multimedia content and EyesWeb patches link The Associazione Carlo De Pirro link University of Miami - Master of Science in Music Engineering Technology - M.Sc. thesis, Matan Ben-Asher: "Toward and Emotionally Intelligent Piano: Real-Time Emotion Detection and Performer Feedback via Kinesthetic Sensing in Piano Performance."link