Gemini to Leverage Volvo’s External Cameras for Parking Sign Recognition

Gemini is set to enhance its capabilities with improved sight and mobility. At the recent I/O conference, it was revealed that the AI assistant will utilize external cameras in the upcoming EX60 SUV to help drivers understand and interpret their surroundings. This advancement is made possible by Volvo integrating Google’s Android Automotive as its vehicle operating system.

The initial application for this technology will allow Gemini to translate complex parking signs, but Google envisions a range of future uses. The AI could potentially recognize road signs, interpret lane markings, or provide information about nearby landmarks and restaurants. It aims to inform drivers about parking durations, necessary permits, and other restrictions.

“In the future, Gemini will make your drive more helpful by allowing you to learn more about your surroundings while on the road,” stated Patrick Brady, VP of Android Automotive at Google.

This feature relies not only on Gemini but also on the EX60’s computing power from Qualcomm’s Snapdragon system-on-a-chip, along with its over-the-air software capabilities.

The ability to interpret parking signs could prove to be genuinely useful—if it works accurately. Testing will be crucial to determine if the system performs as Google claims. In areas like New York City, where parking signs can be notoriously confusing, there’s a risk that Gemini might misinterpret a sign, leading to costly tickets or even vehicle impoundment. Google must ensure this feature is reliable; otherwise, drivers may choose to disable it.

With enhanced sight capabilities, Google Maps will also improve navigation. Volvo will be among the first to implement Google Maps’ new Immersive Navigation feature, which presents routes in 3D with enhanced graphics that closely mimic the real world. By utilizing external cameras, Google Maps will provide more conversational directions, such as “go past this light and take the next left at the library.”

Correction May 19: A previous version of this story incorrectly attributed the EX60’s AI-powered features to Nvidia computing power. The features run on Qualcomm’s Snapdragon system-on-a-chip.