elia basso : work Atom feed | about elia basso

thumbnail screenshot

Aqua Mentis

Aqua Mentis is a multimedia installation, an interactive environment created to analyze and experiment in what way sounds and noises create the mental representation, the idea of the environment in which we are plunged or believe to be plunged

The target is to create a situation in which sounds and noises are the most important factors in the mental environment representation, is to create a habitat sphere trough the noises. But the produced sounds and noises not directly correspond to the real world perceived trough the other senses, such as sight, touch or smell, indeed are often in opposition. This is the most peculiar and particular aspect of the work.

The mechanism is very simple but really effective: a microphone is placed in a box on the floor of a room or of a circumstantiate place, in this way it is able to detect every ground vibrations. On the other hand the microphone is connected to a computer (for most sensibility and best results it is better to use and intermediate amplifying system) which receives the sound signals. When the visitors walk trough the environment, every step produces a vibration on the floor and a little step noise: this vibration ad this noise are detected by the microphone and sent to the program running on a computer. The signal is analyzed and, if exceed a certain threshold, the program produces the noise of a step on a water surface, the volume of which is proportional to the vibration intensity. For a most realistic effect the step noise is chosen every time randomly from a pool of four sequences.
At the same time the program diffuses continuously some noise of water drip to create the atmosphere similar to cove or dungeon environment. To complete the effect the space must be dark, lighted only by the projection of some water ripple effect on the wall and ceiling. In the next version of the program this water glares will be interactive too, moving at every step of the users that produce a sound.

In this way the visitors walk on a water surface that are not able to see, or in a different place from that suggested by the hearing. It create a strange decoupled effect, an estrangement sensation, perhaps a synesthetic atmosphere, because what tell a sense is different from what is perceived by the others, in a continuous play of deceits, refutations and contradictions.

In the same way it is possible to simulate other type of surface, such as snow or gravel, also at the same time in the same place, but the water surface effect is the most impressive.

The maximum immersion degree in this new environmental sphere is reachable covering the floor whit fog or smoke. In this way the user isn?t immediately able to see the real consistency of the floor he/she is walking on.

This interactive environment is realized in a very low cost and basic way: we use only one microphone, an amplifying system and a self written computer application that run with no particular system requirements. Best result are reachable using more than one microphone for most sensibility, more speakers placed right or best quality sound sequences.

This interactive environment is realized in a very low cost and basic way: we use only one microphone, an amplifying system ad a self written computer application that run with no particular system requirements (We have tried on a PII 500 Mhz with no problems). The vibration of the floor produced by the visitors steps are detected by the microphone and transformed by the computer application in a sound of a step on a different surface, in this case a water surface. The program in a very simple one written in ActionScript 1.0 and realized with Macromedia Flash MX to be truly platform independent, in fact can run also trough a web browser for an on-line application. The application have also three sliding knob to control the microphone gain, the overall volume and the step threshold. This knobs is useful for a perfect tune in the selected installation place. A video projector must be used for a most realistic immersion effect, to create the visible water ripple glares. This is the first basic version of the work that is up to now a work in progress. In the next version we implement a more realistic environmental sound routine and a more interactive visible feedback, such as interactive water ripple effect to project in the room.
collection:2004 | date added:2004-09-07 | enter project

elia basso : about

I finished the graduated school in October 2003 and I obtain a degree in computer and programming engineering. Now I work for a new created society that develop multimedia product for entertainment and education (cultural edutainment) and in particular studies ad realizes virtual and cooperative multi-channel world. I have worked as laboratory tutor at Polytechnic of Milan for a programming course. In the first months of the year Idearium.org, the Italian Interaction Design Network, has published a work of mine about the virtual cooperative world for hospitalized child.

I study the new possibility of the low-cost mixed reality system as the last multimedia channel to live the reality (and virtuality).