That’s a shame since audio user interfaces could enable use in situations where you can’t look at the device. Audio can also power wholly new categories of devices and UIs, as we have seen recently at Hipui.

However, the really interesting aspect that has been widely neglected is the marriage of visual and auditory menus (yes, as in multimodality). Many benefits can be achieved by integrating these two modalities into one interface, even if they are used in separate usage situations. The user can learn the menu logic by using the familiar visual UI. When eyes-free operation is needed the auditory menu is already familiar and can be used instantly. The ability to continue using the device even when eyes are occupied with more important tasks is, well, a hot potato. Many countries (including US) are legislating hands-free laws to tackle the increasing text-and-crash statistics. But hey, it’s not actually a hands-free problem: It’s certainly an eyes-free problem! In addition, touchscreens are a barrier for visually impaired users and thus new multi-modal UI concepts could make visual menus easily accessible eyes-free by using audio feedback.

In some cases an audio interface can even be more effective than its visual counterparts. Finally the big consumer electronic companies have realized this potential. For example, Apple introduced the new iPod Shuffle, which gives auditory feedback to users using synthesized speech (well actually iTunes does the heavy lifting). A similar device without any visual display is inexpensive to manufacture and has low energy consumption. When will we see the first screenless devices with rich gestural input and auditory menus?

There is lot of work to be done before auditory menus (in particular when their content is not familiar to the user) are intuitive, easy and fast.

Our Funkyplayer iPhone app is based on early research that introduced new interaction and browsing techniques, which enable better control of more sophisticated devices and their features. Funkyplayer was designed to demonstrate the potential of multi-modal UIs in mobile devices. Although it is designed in the terms of audio it is still pleasing and usable with visual feedback. Funkyplayer is an example that complex tasks can be performed with auditory menus. Similar design can be adapted to mobile phones, publicly available touchscreens, remote controls or automotive infotainment systems.

See you @ CES 2010 in a few days!

We are happy to announce that Funkyplayer is now in Apple App store! It’s free, so go and grab it.

Can you imagine controlling your music player with no buttons or display? Funkyplayer demonstrates revolutionary Hipui user interface technology that enables you to use your devices completely in a new way. It combines 3D auditory menus with nice looking visual menus that can be controlled either by using gestures or touchscreen.

Feel free to try it out and tell us what you think!