Gesture control

Gesture control: a new era of in-car interaction

Imagine changing a track, adjusting the volume or answering a call with a simple hand movement, without ever touching a button or a screen. This is the promise of gesture control, a cutting-edge technology that transforms our cars' cabins into an interactive and intelligent space. As part of next-generation human-machine interfaces (HMIs), it aims to make driving safer, more intuitive and resolutely more modern.

How does gesture control work?

The principle of gesture control relies on motion recognition via sophisticated sensors. Most often, a 3D or infrared camera, discreetly integrated into the overhead console or the rearview mirror, monitors a well-defined interaction zone, generally above the center console. When the driver or passenger makes a gesture in this zone, the camera captures the movement. Image analysis software then processes the data in real time to identify the gesture from a library of pre-programmed commands. If the gesture is recognized, the system sends an instruction to the corresponding vehicle function (infotainment system, climate control, etc.). This technology is designed to be responsive and accurate, while also being capable of distinguishing an intentional gesture from an incidental movement.

What functions can be controlled by gestures?

While the possibilities are vast, automakers are currently focusing on the most frequent controls to maximize the relevance of this technology. Here are the functions most commonly associated with gesture control:

• Volume management: Rotating the index finger clockwise to turn up the volume, and vice versa to turn it down.
• Answering and rejecting calls: Pointing a finger at the screen to accept an incoming call, or swiping the hand sideways to reject it.
• Menu navigation: Swiping the hand from left to right or right to left to switch between menus.
• GPS navigation control: Pointing two fingers at the screen to launch navigation to a favorite destination or to interact with the 360° map.
• Customizable functions: Some systems, such as BMW's, allow a specific gesture (for example, the "V" sign with two fingers) to be assigned to a custom function, such as "navigate home".

The benefits of gesture control

The integration of gesture control offers several notable benefits. The primary one is the improvement of safety: the driver can interact with the multimedia system without taking their eyes off the road to look for a button or target an icon on a touchscreen. This reduction in distraction is a major asset. Secondly, it provides operational comfort and an enhanced user experience, perceived as more natural and futuristic. Finally, for cleanliness enthusiasts, it is an ideal solution to limit unsightly fingerprints on the large touchscreens equipping modern vehicles.

Which manufacturers offer this technology?

Gesture control was first popularized by German premium brands. BMW was a pioneer with its "Gesture Control" system introduced on the 7 Series in 2015. Since then, the technology has become more widespread and is available on many models in the brand's lineup. Mercedes-Benz has also integrated a form of gesture control into its MBUX (Mercedes-Benz User Experience) system, where it complements voice and touch controls. Volkswagen offers it on certain high-end models, such as the Golf 8 or Arteon, allowing users to navigate infotainment menus, for instance. Audi also integrates it into its most recent virtual cockpits, often in combination with other interaction modes. Although still predominantly present in the premium segment, this technology is gradually tending to trickle down to lower vehicle segments.