Sonification: How Everyday Physical Activity “Sounds”?

Main Article Content

Alexei V. Krasnoskulov

Abstract

The sonification of physical activity, including the everyday variety, is an intensively
developing sphere of scholarly research. The present project is concentrated on a complex
way of using algorithmic music with the availability of the subject-wise and the compositional
structures – musification. The basis is comprised of means of parametric sonification of data –
the most broadly used technique, transforming the multidimensional space of the data in sound.
The various meanings of physical activities obtained with the use of the Xiaomi Mi Band activity
during the process of studies of sonification as a practical and creative domain of science and
art made it possible to carry out a few experiments carrying the aim of sounding out the data of
the fitness bracelet in such a way as to depict the everyday activities of several users within the
limits of the resulting musical composition. Various means of transformation of the meanings
of the fitness bracelet into musical parameters were examined within the frameworks of this
research work. Approbation was made of several variants of parametrical mappings transforming
the four-dimensional space of the meanings of the tracker of activities into a multidimensional
space of musical parameters – from the different variants of the four-dimensional to the sixdimensional.
The latter approach turned out to be the most convincing from the perspective of
the aims set forth in the present project.

Keywords: sonification, parametrical mapping, interactivity, sonar reflection of information.

Article Details

How to Cite
Krasnoskulov, A. V. (2019). Sonification: How Everyday Physical Activity “Sounds”?. Music Scholarship / Problemy Muzykal’noj Nauki, (2), 111–119. https://doi.org/10.17674/1997-0854.2019.2.111-119
Section
Information Technology and Music
Author Biography

Alexei V. Krasnoskulov, Rostov State S. V. Rachmaninoff Conservatory

Ph.D., Professor at the Department of Special Piano, Professor
at the Department of Sound Engineering and Information Technologies

References

1. Krasnoskulov A. V. Muzyka i dopolnennaya realnost': na puti k budushchemu [Music and Reality: on the Path to the Future]. Yuzhno-Rossiyskiy muzykal'nyy al'manakh [South-Russian Musical Anthology]. 2018. No. 4, pp. 80–86.
2. Barrass S., Schaffert N., Barrass T. Probing Preferences between Six Designs of Interactive Sonifications for Recreational Sports, Health and Fitness. Proceedings of ISon 2010, 3rd Interactive Sonification Workshop. 2010, pp. 23–29.
3. Beilharz K., Ferguson S., Song H. J., Cabrera D. An Interactive Approach For Teaching Information Sonification. Proceedings of the 12th International Conference on Auditory Display. 2006, pp. 164–171.
4. Brown L. M., Brewster S. A., Ramloll R., Burton M., Riedel B. Design Guidelines for Audio Presentation of Graphs and Tables. The 9th International Conference on Auditory Display. 2003, pp. 284–287.
5. Dubus G. Interactive Sonification of Motion: Design, Implementation and Control of Expressive Auditory Feedback with Mobile Devices: Doctoral Thesis. KTH School of Computer Science and Communication. Stockholm, Sweden, 2013. 33 p.
6. Flowers J. H. Thirteen Years of Reflection on Auditory Graphing: Promises, Pitfalls, and Potential New Directions. Proceedings of the First Symposium on Auditory Graphs. 2005, pp. 406–409.
7. Neuhoff J. G., Kramer G., Wayand J. Pitch and Loudness Interact in Auditory Displays: Can the Data Get Lost in the Map? Journal of Experimental Psychology. 2002. Vol. 8. No. 1, pp. 17–25.
8. Schaffert N., Mattes K., Effenberg A. O. A Sound Design for the Purposes of Movement Optimisation in Elite Sport (Using the Example of Rowing). Proceedings of the 15th International Conference on Auditory Display. 2009, pp. 72–75.
9. The Sonification Handbook. Comp. by T. Hermann usw. Berlin, Germany: Logos Publishing House, 2011. 586 p.
10. Walker B., Kramer G. Ecological Psychoacoustics and Auditory Displays: Hearing, Grouping, and Meaning Making. Ecological Psychoacoustics. 2004, pp. 150–175.