Sound Research

Background

In developing the Screen-to-Soundscape project, our aim was to create an auditory experience that was not only functional but also engaging and intuitive for blind and visually impaired users. Central to this endeavor was the design of sound cues that would guide users through the digital landscape, enhancing their understanding and interaction with information presented on a webpage. These sounds were crafted to coexist harmoniously within the soundscape, each with a distinct personality and role in conveying the introduction, transition, or passing of information. Through this report, we outline the process, theory, and insights gained from our sound research and how it informed the overall design and functionality of the Screen-to-Soundscape prototype.

Developing Sound Cues for Information Flow

The primary goal of our sound design was to create cues that were kind to one another when played simultaneously yet retained distinct identities to convey various types of information effectively. These sounds needed to function in both the foreground and background, providing informative cues about different groupings of content while supporting the broader auditory experience. We recognized that the relationship between sounds was crucial; they had to be both distinguishable and cohesive to maintain a fluid and intuitive soundscape.

To achieve this, the length and timing of the sounds were carefully considered. Certain sounds were designed to bleed into vocalized text, while others were introduced just before text was vocalized, providing a preparatory signal that new information was forthcoming. This layering approach allowed us to create a dynamic and responsive auditory environment where sounds provided context, transitions, and emphasis on critical information.

Integrating Theories of Space and Scale

While developing these sound cues, our team drew inspiration from the text "Scale and Multiple Psychologies of Space" by Daniel R. Montello, which Alyssa had shared with the group. Montello's work provided valuable insights into how humans experience scale and space, offering a theoretical framework that helped guide the design of our soundscapes. The text breaks down space into four distinct categories: immediate (figural) space, vista space, environmental space, and geographical space, each of which is nested within the other.

We used these spatial concepts to inform how we translated two-dimensional websites into four-dimensional soundscapes. The definitions of these spatial categories helped us understand how to create sound cues that mirrored the ways individuals navigate physical spaces:

Immediate (Figural) Space: Represents small spaces perceived without movement, like objects or pictures. In our sound design, this translated into quick, concise sound cues that highlighted immediate, static information on a webpage.

Vista Space: Represents larger spaces seen from a single vantage point, such as rooms or valleys. For this, we used sound cues that were slightly more prolonged and had more depth, allowing users to grasp a sense of layout and the arrangement of information from one 'position.'

Environmental Space: Involves spaces that require movement to be fully perceived, such as buildings or cities. To convey this, we created more expansive soundscapes that evolved as users navigated through different sections of a webpage, providing auditory feedback that indicated movement and changes in context.

Geographical Space: Refers to vast spaces understood through maps, like countries or planets. These sounds were the most complex and layered, guiding users through extensive sections of information and allowing them to grasp the overarching structure of the webpage.

By implementing these spatial concepts into our sound design, we ensured that the auditory experience was intuitive and reflective of how users naturally understand and explore physical spaces.

Creating a Harmonious and Informative Soundscape

One of the most significant challenges was ensuring that the sounds were both informative and aesthetically pleasing when played together. We approached this by carefully considering the tone, pitch, and rhythm of each sound cue, ensuring that they did not clash or compete for attention but instead worked together to create a cohesive auditory environment.

The sounds were designed to serve as navigational aids, helping users identify the introduction of new information, changes in content, or transitions between different sections of a webpage. For example, a short, high-pitched sound might indicate the appearance of a new paragraph, while a longer, more mellow tone could signal the end of a section. This layered approach allowed the sounds to provide users with both micro and macro-level information about the digital content, enhancing their overall understanding and navigation experience.

Adapting to User Feedback and Real-World Scenarios

Throughout the development process, we engaged in co-creation sessions with blind and visually impaired users to gain valuable feedback on how these sound cues were experienced in practice. Their insights guided adjustments to the soundscape, such as refining the timing and layering of sounds to prevent auditory overload and ensuring that essential cues were clear and easily distinguishable.

For instance, users noted the importance of having a clear sense of boundaries within the soundscape, especially when navigating complex websites. In response, we introduced boundary sounds that indicated the edges of the webpage or a specific section, helping users maintain their orientation within the digital space. This iterative process ensured that our sound design remained user-centered and responsive to real-world needs.

Conclusion

By integrating carefully designed sound cues and drawing inspiration from Daniel R. Montello’s concept of psychological spaces, we were able to transform two-dimensional web content into a rich, four-dimensional auditory experience. This approach allowed us to map digital information into layers of sound that correspond to different spatial scales—immediate, vista, environmental, and geographical. By doing so, we have laid the groundwork for a more accessible and immersive navigation experience, where users can perceive and explore digital content through an auditory interface that reflects the complexity and richness of real-world spaces. As we continue to refine and develop the Screen-to-Soundscape project, this foundational sound research will be crucial in guiding the creation of a more intuitive, responsive, and inclusive digital experience for blind and visually impaired users.