{"id":19084,"date":"2021-11-19T16:02:32","date_gmt":"2021-11-19T21:02:32","guid":{"rendered":"https:\/\/splice.com\/blog\/?p=19084"},"modified":"2023-06-13T15:20:42","modified_gmt":"2023-06-13T19:20:42","slug":"exploring-data-sonification","status":"publish","type":"post","link":"https:\/\/splice.com\/blog\/exploring-data-sonification\/","title":{"rendered":"Exploring the world of data sonification"},"content":{"rendered":"\n<p style=\"font-size:15px\" class=\"has-text-align-center\"><strong>Illustration:<\/strong> <a href=\"https:\/\/jeremyaleung.com\/\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"Jeremy Leung (opens in a new tab)\"><strong>Jeremy Leung<\/strong><\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Just like how we use text and images to better understand a set of data, sonification uses sound to represent information in new and useful ways.<\/h2>\n\n\n\n<p>While our eyes are great at quickly interpreting graphs, text, and pictures (a.k.a. visualizations), our sense of hearing is no slouch either. <a rel=\"noreferrer noopener\" aria-label=\"The human body\u2019s ability (opens in a new tab)\" href=\"https:\/\/splice.com\/blog\/psychoacoustics-101\/\" target=\"_blank\">The human body\u2019s ability<\/a> to detect changes in the location, pitch, intensity, and timing of incoming sound means that hearing can be just as valuable as sight when it comes to understanding data. In this article, let\u2019s explore the history of data sonification and how it\u2019s being used at the forefront of research.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">The Geiger counter<\/h2>\n\n\n\n<p>Any effective sonification approach needs three things: (1) an input that takes in data, (2) a specific technique or way to transform that data into non-speech sound, and (3) a human at the other end who can listen to and interpret that sound. One of the earliest and probably most recognizable uses of a data sonification technique brings us all the way back to 1908 with the Geiger counter. This device contains a small amount of gas that reacts when it comes into contact with radiation and generates ions. The creation of each ion generates a small amount of electricity which the device converts into audible clicks you can hear through a speaker. The more clicks, the more ions being created and the more radioactive the location is\u2014pretty helpful I\u2019d say!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Seismology and geophysics<\/h2>\n\n\n\n<p>While the Geiger counter creates sound from electrical signals, there are many other kinds of data that can undergo sonification. For example, vibrations under the earth\u2019s surface can be measured by a device called a seismometer as a continuous waveform over time\u2014the only difference is that, unlike a musical recording, these frequencies are way too low to be heard. However, transposing the whole waveform by speeding it up not only makes the frequencies audible, but also compresses the time axis so we can hear them over a shorter period of time! This method allows us to <a rel=\"noreferrer noopener\" aria-label=\"observe major seismic events like the 2011 Tohoku earthquake in a totally new way (opens in a new tab)\" href=\"https:\/\/www.youtube.com\/watch?v=3PJxUPvz9Oo\" target=\"_blank\">observe major seismic events in an entirely new way<\/a> by speeding up the measurements by a factor of over a thousand.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Brain scans<\/h2>\n\n\n\n<p>Things can get even more complex than the two examples above once we get into <strong>parameter-based sonification,<\/strong> in which the final sound output relies on multiple streams of data that each control a particular sonic variable. Electroencephalograms (or EEGs for short) measure electrical activity in the brain over time and are commonly used in scientific research and medical diagnostics. The intensity, brain location, and rhythmic nature of these signals are valuable and can each be mapped differently through data sonification.<\/p>\n\n\n\n<p>For example, electrodes at different brain locations can each map to a particular pitch or spot in the stereo field, and moments of relative signal intensity (when things spike up or down) can trigger a sound event. Our powerful ears then do the rest, identifying spots in time when the sounds take on a certain rhythm that could correspond to abnormal brain activity. Recent studies have even shown benefits to using <a rel=\"noreferrer noopener\" aria-label=\"a sound-based approach (opens in a new tab)\" href=\"https:\/\/www.mdedge.com\/neurology\/epilepsyresourcecenter\/article\/164726\/epilepsy-seizures\/sonified-eeg-could-be\" target=\"_blank\">a sound-based approach<\/a> over a more traditional visual one when it comes to quickly identifying epileptic seizures using EEG data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Image as sound<\/h2>\n\n\n\n<p>We can bridge the gap between sight and hearing even more by taking two-dimensional images and giving them a sonic representation. Image sonification involves creating systems that assign visual properties like color and saturation to musical parameters like pitches and chords, and triggers those events as someone \u201cmoves\u201d through an image in real time (using a mouse cursor or by dragging a finger across a touch screen, for example). You can also apply similar methods to captured video as a way to provide sonic feedback of your surroundings and detect potential obstacles. When it comes to enhancing the experience of visual and physical environments for the visually-impaired, research has found that <a rel=\"noreferrer noopener\" aria-label=\"these kinds of sonification approaches (opens in a new tab)\" href=\"https:\/\/www.researchgate.net\/publication\/220947281_EdgeSonic_Image_feature_sonification_for_the_visually_impaired\" target=\"_blank\">these kinds of sonification approaches<\/a> could hold <a rel=\"noreferrer noopener\" aria-label=\"real benefits. (opens in a new tab)\" href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7309097\/\" target=\"_blank\">real benefits.<\/a><\/p>\n\n\n\n<p>While visually representing information is obviously not going anywhere, there\u2019s also no doubt that sonification can often provide a whole new (and often valuable) perspective on things! Do you know of any other types of data sonification? Let us know in the comments below.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"has-text-align-center\">Explore royalty-free one-shots, loops, FX, MIDI, and presets from leading artists, producers, and sound designers:<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button aligncenter\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/splice.com\/sounds\" target=\"_blank\" rel=\"noreferrer noopener\">Join Splice today<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Learn about how data sonification allows us to use sound to represent information at the forefront of research today.<\/p>\n","protected":false},"author":28,"featured_media":19089,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[1696],"tags":[1721,1712],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Exploring the world of data sonification - Blog | Splice<\/title>\n<meta name=\"description\" content=\"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Exploring the world of data sonification - Blog | Splice\" \/>\n<meta property=\"og:description\" content=\"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog | Splice\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Splice\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-19T21:02:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-13T19:20:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost-1024x640.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"640\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Matteo Malinverno\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@splice\" \/>\n<meta name=\"twitter:site\" content=\"@splice\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Matteo Malinverno\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\"},\"author\":{\"name\":\"Matteo Malinverno\",\"@id\":\"https:\/\/splice.com\/blog\/#\/schema\/person\/43123e87ce32298439fa5bbdd471e89d\"},\"headline\":\"Exploring the world of data sonification\",\"datePublished\":\"2021-11-19T21:02:32+00:00\",\"dateModified\":\"2023-06-13T19:20:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\"},\"wordCount\":707,\"publisher\":{\"@id\":\"https:\/\/splice.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg\",\"keywords\":[\"audio technology\",\"psychoacoustics\"],\"articleSection\":[\"Tips &amp; Tutorials\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\",\"url\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\",\"name\":\"Exploring the world of data sonification - Blog | Splice\",\"isPartOf\":{\"@id\":\"https:\/\/splice.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg\",\"datePublished\":\"2021-11-19T21:02:32+00:00\",\"dateModified\":\"2023-06-13T19:20:42+00:00\",\"description\":\"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.\",\"breadcrumb\":{\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/splice.com\/blog\/exploring-data-sonification\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage\",\"url\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg\",\"contentUrl\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg\",\"width\":1920,\"height\":1200,\"caption\":\"exploring-data-sonification-featured-image\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/splice.com\/blog\/exploring-data-sonification\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/splice.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Exploring the world of data sonification\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/splice.com\/blog\/#website\",\"url\":\"https:\/\/splice.com\/blog\/\",\"name\":\"Splice Blog\",\"description\":\"An inside look at making music\",\"publisher\":{\"@id\":\"https:\/\/splice.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/splice.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/splice.com\/blog\/#organization\",\"name\":\"Splice\",\"alternateName\":\"Splice Sounds\",\"url\":\"https:\/\/splice.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/splice.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2023\/09\/Splice-logo-black-background.png\",\"contentUrl\":\"https:\/\/splice.com\/blog\/wp-content\/uploads\/2023\/09\/Splice-logo-black-background.png\",\"width\":2928,\"height\":1540,\"caption\":\"Splice\"},\"image\":{\"@id\":\"https:\/\/splice.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Splice\",\"https:\/\/x.com\/splice\",\"https:\/\/www.instagram.com\/splice\/\",\"https:\/\/www.youtube.com\/@splice\",\"https:\/\/discord.com\/invite\/splice\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/splice.com\/blog\/#\/schema\/person\/43123e87ce32298439fa5bbdd471e89d\",\"name\":\"Matteo Malinverno\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/splice.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6210453a06683c0f3f11a7040fba7ede?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6210453a06683c0f3f11a7040fba7ede?s=96&d=mm&r=g\",\"caption\":\"Matteo Malinverno\"},\"description\":\"Matteo Malinverno is a New York-based music producer currently working on the Content team at Splice.\",\"url\":\"https:\/\/splice.com\/blog\/author\/matteo\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Exploring the world of data sonification - Blog | Splice","description":"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/splice.com\/blog\/exploring-data-sonification\/","og_locale":"en_US","og_type":"article","og_title":"Exploring the world of data sonification - Blog | Splice","og_description":"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.","og_url":"https:\/\/splice.com\/blog\/exploring-data-sonification\/","og_site_name":"Blog | Splice","article_publisher":"https:\/\/www.facebook.com\/Splice","article_published_time":"2021-11-19T21:02:32+00:00","article_modified_time":"2023-06-13T19:20:42+00:00","og_image":[{"width":1024,"height":640,"url":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost-1024x640.jpg","type":"image\/jpeg"}],"author":"Matteo Malinverno","twitter_card":"summary_large_image","twitter_creator":"@splice","twitter_site":"@splice","twitter_misc":{"Written by":"Matteo Malinverno","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#article","isPartOf":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/"},"author":{"name":"Matteo Malinverno","@id":"https:\/\/splice.com\/blog\/#\/schema\/person\/43123e87ce32298439fa5bbdd471e89d"},"headline":"Exploring the world of data sonification","datePublished":"2021-11-19T21:02:32+00:00","dateModified":"2023-06-13T19:20:42+00:00","mainEntityOfPage":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/"},"wordCount":707,"publisher":{"@id":"https:\/\/splice.com\/blog\/#organization"},"image":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage"},"thumbnailUrl":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg","keywords":["audio technology","psychoacoustics"],"articleSection":["Tips &amp; Tutorials"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/","url":"https:\/\/splice.com\/blog\/exploring-data-sonification\/","name":"Exploring the world of data sonification - Blog | Splice","isPartOf":{"@id":"https:\/\/splice.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage"},"image":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage"},"thumbnailUrl":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg","datePublished":"2021-11-19T21:02:32+00:00","dateModified":"2023-06-13T19:20:42+00:00","description":"Let\u2019s explore the history of data sonification and how it uses sound to represent information at the forefront of research today.","breadcrumb":{"@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/splice.com\/blog\/exploring-data-sonification\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#primaryimage","url":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg","contentUrl":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2021\/11\/Data_Sonification_BlogPost.jpg","width":1920,"height":1200,"caption":"exploring-data-sonification-featured-image"},{"@type":"BreadcrumbList","@id":"https:\/\/splice.com\/blog\/exploring-data-sonification\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/splice.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Exploring the world of data sonification"}]},{"@type":"WebSite","@id":"https:\/\/splice.com\/blog\/#website","url":"https:\/\/splice.com\/blog\/","name":"Splice Blog","description":"An inside look at making music","publisher":{"@id":"https:\/\/splice.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/splice.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/splice.com\/blog\/#organization","name":"Splice","alternateName":"Splice Sounds","url":"https:\/\/splice.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/splice.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2023\/09\/Splice-logo-black-background.png","contentUrl":"https:\/\/splice.com\/blog\/wp-content\/uploads\/2023\/09\/Splice-logo-black-background.png","width":2928,"height":1540,"caption":"Splice"},"image":{"@id":"https:\/\/splice.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Splice","https:\/\/x.com\/splice","https:\/\/www.instagram.com\/splice\/","https:\/\/www.youtube.com\/@splice","https:\/\/discord.com\/invite\/splice"]},{"@type":"Person","@id":"https:\/\/splice.com\/blog\/#\/schema\/person\/43123e87ce32298439fa5bbdd471e89d","name":"Matteo Malinverno","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/splice.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6210453a06683c0f3f11a7040fba7ede?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6210453a06683c0f3f11a7040fba7ede?s=96&d=mm&r=g","caption":"Matteo Malinverno"},"description":"Matteo Malinverno is a New York-based music producer currently working on the Content team at Splice.","url":"https:\/\/splice.com\/blog\/author\/matteo\/"}]}},"_links":{"self":[{"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/posts\/19084"}],"collection":[{"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/users\/28"}],"replies":[{"embeddable":true,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/comments?post=19084"}],"version-history":[{"count":10,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/posts\/19084\/revisions"}],"predecessor-version":[{"id":27222,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/posts\/19084\/revisions\/27222"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/media\/19089"}],"wp:attachment":[{"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/media?parent=19084"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/categories?post=19084"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/splice.com\/blog\/wp-json\/wp\/v2\/tags?post=19084"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}