The list is not sorted according to any algorithm.
- Gestural Audification
(non-funded research project)
Description: Audification is the direct transformation of data values into sound. In our project we have created a new interface (using a webcam and two colored gloves) so that navigation (scrubbing) and manipulation (filtering) of the data-driven sound stream can be done interactively, using bimanual controls. The project emerged from a ConGAS STSM of Stella Pashalidou at Bielefeld University. Contact: Thomas Hermann
Stella Pashalidou
Dirk BeckmannWebsite: project website
- ANVIL
()
Description: Development and extension of a video annotation tool that allows the manual annotation of video on multiple tiers with a user-defined scheme. Extensions include spatiotemporal annotations (storing graphical mark-up of trajectories, distances etc. on the video screen) and import/export interfaces to other tools (e.g. FEELTRACE emotion annotation tool). Contact: Michael Kipp Website: project website
- Research on violin-based interfaces
(Dissertation at the University of Birmingham)
Description: Aim: development of violin-based interfaces and synthesis algorithms that allow traditional trained string players to use their expertise in order to play electronic sounds. Contact: Cornelius Poepel
Website: project website
- hot_strings SIG
(SIG)
Description: >hot_strings SIG< is a group of people who are interested in inventing the instruments of the violin family. This might be developments using gesture tracking systems (virtual instruments), instruments using new material in order to let the acoustic instrument sound different or this might be developments using new speaker systems, pickup systems, signal processing methods or synthesis methods. Every year two meetings are done. Developments are presented and discussed. A mailinglist is online. The members are instrumentalists, violin makers, compsers and researchers. They come from various locations in europe. Members work on projects like instrument development, compositions and concerts together. Contact: Cornelius Poepel
Lenka Zupkova
Website: not available
- Personal Orchestra
(Industry-funded exhibit development projects)
Description: A series of interactive conducting systems since 2000 that use real audio and video data. Includes the first system worldwide to provide interactive conducting of real audio and video recordings. Contact: Prof. Dr. Jan Borchers
Eric Lee
Website: project website
- libSTF
(PhD thesis work, deployed in industry-funded exhibits)
Description: libSTF is a "Semantic Time Framework", a multimedia framework that supports working with changing time bases, for applications such as audio time-stretching in the Personal Orchestra projects. Contact: Prof. Dr. Jan Borchers
Eric Lee
Website: project website
- PhaVoRIT: A Phase Vocoder for Real-Time Interactive Time-Stretching
(Research work, deployed in industry-funded exhibits)
Description: PhaVoRIT is currently the best open-source phase vocoder implementation available that can time-stretch audio data in real time at high quality, suitable for use with orchestral music. It can be used standalone or as plugin to our libSTF framework, and has been used in our Personal Orchestra projects. Contact: Prof. Dr. Jan Borchers
Thorsten Karrer
Eric LeeWebsite: project website
- CLOSED (Closing the Loop of Sound Evaluation and Design)
(IST STREP)
Description: When designing the sonic aspect of an artefact, the designer wants to be able to explore a variety of what-if possibilities at the phenomenological, experiential, and emotional level. The CLOSED project provides a measurement tool that is capable of analyzing sounds in context at the same high level of interpretation used by designers, in a way that is closely linked to the experience of users, thus aiming at boosting the emerging discipline of sound design. It is believed that the objective measurement of functional-aesthetic sound qualities of artefacts is the key component that will allow the effective closure of the iterative loop of sound evaluation and design.
Coordinator:
IRCAM, FR (Institut de Recherche et Coordination Acoustique/Musique)
Partners:
1. Università degli Studi di Verona (VIPS Lab)
2. HGKZ (Hochschule für Gestaltung und Kunst Zürich)
3.TU Berlin, DE (Technischen Universität Berlin)
Contact: Davide Rocchesso
Pietro Polotti
Carlo DrioliWebsite:
- MOPRIM - In search for the motion primitives for a communicative human body language
Description: The general vision is effective Human-Computer-Interaction (HCI), which operates as natural and intuitive as do Human-Human-Interaction. The more specific vision for this project is that visual cues become available for this purpose in a manner similar to that of speech, where speech technology now allows natural languages to play an operational and important role of bi-directional communication for HCI. The visual cues in question relate to human body language (HBL) with gestures etc. The specific vision includes the existence of a basic set of communicative and purposeful body motion primitives, comparable to the phonemes of speech technology, which support analysis as well as synthesis of speech. Both computer vision and graphics animation will be used, in attempting to derive such primitives. It is expected that the ultimate and standard set of HBL primitives may require some iterations and further efforts, but already from this project we hope to make an impact on approaches to human-computer interfaces. Contact: Thomas Moeslund
Website: project website
- HERMES: Human-Expressive Representations of Motion and their Evaluation in Sequences
Description: HERMES is a consortium project which concentrates on how to extract descriptions of people behaviour from videos in a restricted discourse domain, such as pedestrians crossing inner-city roads, approaching or waiting at stops of buses and even humans in indoor worlds like an airport hall, a train station, or a lobby. Contact: Thomas Moeslund
Website: project website
- MusiCards
(University research)
Description: The MusiCards project studies simple formal notation for music structure with additional rhythm and melody specifications, and discuss its application as an educational tool for children. We propose a simple and expressive tool that can be used to encourage explorations of music-related concepts, such as rhythm and polyphonic performance. The MusiCards notation can be implemented in computer simulation, as a table-top game, or a physical movement outdoor version. It is very affordable, extendible and can be easily deployed both in a classroom and at home. Using it children can design, build and perform with their own musical machines. We believe that MusiCards offer a constructive alternative to classical musical education tools. In the outdoor version of MusiCards, children will be pegs in a large musical circuit, composed of floor tiles, singing or playing instruments as they proceed, jumping from tile to tile. The MusiCards will help children understand the structure, rhythm and melody of the music by moving and singing in the physical space. Contact: Andrea Valente
Kristoffer Jensen
Website: project website
- BrainTuning - Tuning the Brain for Music
Description: BrainTuning is about music in the brain. Music appreciation and music-induced emotions are common every-day phenomena to most of us. Certain pieces of music are loved by many, hated by others, and insignificant to many. Many of us love to play instruments and singing brings a whole other level to speaking. Many think of music as a certain way to communicate or express one's emotions. Music is a diverse and fascinating domain influencing our society in various ways. Neuroscience provides new ways to investigate how music and music-induced emotions are processed in the brain. Many questions that could not be answered previously, can now be addressed using new approaches and the new methods available. The BrainTuning project is investigating the musical brain by combining the efforts and expertise of six research groups in Europe and Canada during the years 2006–2009. Contact: Roberto Bresin
Mari Tervaniemi
Website: project website
