Multimodal interfaces

Multimodality is not a new concept. The analog world is full of multimodal interfaces. In other words, interfaces that appeal to more than one human sensory organ. Pressing a simple switch already appeals to three of the five existing senses: Feeling, hearing and seeing. That sounds very banal and obvious at first. However, if you look at the digital world, it becomes clear why, despite such a trivial definition, “multimodal interfaces” are a trend.

A person is wearing a head mounted device - possibly a brain computer interface.
© Facebook Reality Labs

Multimodal interfaces make the world simpler and safer

Let's stick with the simple analog example of a switch. As soon as it is pressed, users perceive haptic feedback, a click. The haptic stimulus can be interpreted most quickly by the user’s brain. It is immediately followed by the sound of the click, that is, the auditory stimulus. Users assign it to the same action as the haptic feedback. The last feedback comes after a delay in the form of the visual confirmation of the flipped switch.

Picture of the Nintendo Switch being used by a person for an archery game.
© Nintendo

Why is this trend relevant to us?

With the establishment of graphical user interfaces and – to a greater extent – the introduction of touchscreens, the flow of information has largely shifted to the visual level. This means that information requires more time to be processed by users, and the range of information and signal intensity is severely limited. A signal can be perceived as much more intense via haptics than via purely visual information.

Curious? Read more now.

Here you can download the complete UXMA Trend Report 2021 free of charge and benefit from other exciting articles! Please note that the UXMA Trend Report 2021 is exclusively available in German.

Insights

Ready to start something big together?