How would the rain that fell in your city all September sound? And a photograph of the forest where you love to walk? Can the movement of a hand become a melody even before the fingers touch the keys?
In the musical space of GAYA ONE, there now sounds a world we are accustomed to observe, measure and feel. Its changes become material for creativity: numbers turn into notes, images into timbres, and gestures control the sound.
For this, a musician needs an instrument, attention and a personal way of connecting what is seen with what is heard.
When rain becomes a score
This week Manifest Audio presented Sonification Tools v3 — an updated set of musical instruments for sonification. Publications about the release appeared on 14 October 2026; the capabilities of the new version are described on the developer's official website.
Behind the unusual word lies a simple idea: data can be translated into sound.
Let us take the amount of precipitation over several weeks. In a table this is a sequence of numbers: a dry day, light rain, a downpour, sun again.
A musician can link these values to the pitch of notes. Then rainy days will raise the melody, and dry ones will lower it. Another link can be chosen: let the amount of precipitation determine the volume, the duration of the sound or the density of the rhythm.
These are possible ways of setting it up. There is no single ready-made "rain melody" here: the character of the piece is born from the meeting of data and an artistic decision.
Thus an ordinary table becomes a score — it preserves the pattern of real events, to which a person gives an audible form.
A photograph that can be heard
The new version works with numerical series, text, images, audio, video and data streams from external devices. Depending on the chosen instrument, they can form sequences of notes, control effects or become the basis of the synthesized sound itself.
Imagine a photograph of a tree: a bright sky between the branches, a dark trunk, many transitions and repetitions.
For the eye this is a landscape. For the program it is also a set of values that can be used in musical work. The image receives a second creative life: its structure participates in the creation of a timbre or a sound pattern.
Two musicians can take the same photograph and produce completely different works. One will hear in it expanse and softness, the other will single out the contrasts and build a rhythm on them.
The photograph remains a shared starting point. Beyond that, interpretation begins.
Gesture enters the music
Especially interesting is the ability to receive data from sensors in real time.
Movement transmitted by a compatible device can control musical parameters. The performer sets up the connection — and the gesture influences how the sound develops.
Such a performance has a particular physicality. Music can be directed by a turn, a tilt, a change of position — as if laying a path for it through space.
The concrete result depends on the sensor, the software settings and the performer's intention. It is precisely this freedom that makes the system interesting: the musician creates not only a work, but also their own way of playing.
What is new in the third version
Sonification has existed for a long time. The novelty of Sonification Tools v3 lies in the fact that the developer has expanded the possibilities of its use within familiar music programs.
Three main instruments solve different tasks:
- Data Path turns data into sequences of notes and rhythmic patterns.
- Data Synth uses them to create and modify synthesized sound.
- Data FX allows data to control sound processing.
The new version supports common plugin formats, so it can be used in various music environments. The built-in selection of sources allows data to be found directly inside the instruments, while one's own materials can be loaded for further experiments.
For a reader far from studio technology, the main point here is simpler: the musician has more ways to let the surrounding world into the process of composition.
Whose voice do we hear?
There is an important and beautiful subtlety here.
By turning weather readings into melody, we create a musical translation of measurements. A recording of rain would preserve the noise of the drops, whereas sonification lets us hear the pattern of its changes over time.
Between the source and the sound there is always the author's decision: which values to choose, what to map them to, what tempo and timbre to use.
That is why such a work brings together a real phenomenon, the way it is measured, and the musician's imagination.
The developer himself, Noah Pred, describes sonification as the possibility of building creativity in dialogue with surrounding processes — weather, ecosystems, movement and personal history.
A world you can compose with
What is especially delightful about this technology is its invitation to pay attention.
The pattern of rains, the curve of a line in a photograph, the movement of a body — anything can become the beginning of a musical conversation. And the familiar suddenly opens up from a new side: what we once walked past turns out to be a source of form, rhythm and unexpected beauty.
A person takes part in this sounding world with all their experience. They notice connections, choose, try, listen — and create what did not exist before.
Perhaps the next melody will begin with the rain outside the window. And it will continue with the way you, specifically, hear it.
