Decrypt’s arts, fashion and entertainment hub.
Discover SCENE
German automaker Mercedes-Benz has finalized an update to its in-car virtual assistant, which features a NFT gallery and an AI voice assistant with ’emotional profiles’.
The company showcased its updated MBUX Virtual Assistant at the 2024 edition of the Consumer Electronics Show (CES) in Las Vegas. Powered by generative AI, the virtual assistant runs on the next-generation Mercedez-Benz Operating System (MB.OS), developed in-house by the automaker.
Billed as the ‘most human-like interface with a Mercedes-Benz yet’, the updated MBUX Virtual Assistant uses a large language model (LLM) to communicate with the driver using one of four ’emotional profiles’, Markus Schäfer, chief technology officer at Mercedes-Benz, said in an interview with PCMag. The virtual assistant can switch between natural, predictive, personal and empathetic modes, he explained.
“Thanks to advances in artificial intelligence, the Mercedes-Benz of tomorrow will know its driver like never before,” said Schäfer. “It will enhance and complement the lives of our customers, in their cars and in other areas as well.”
The MBUX Assistant learns the driver’s preferences, such as automatically switching on his preferred radio station during the morning commute to work, or activating seat massagers and dimmed lights during nighttime journeys.
Mercedes-Benz announced in June 2023 that it would integrate OpenAI’s ChatGPT chatbot into its Mercedes-Benz User Experience (MBUX) voice assistant. However, Schäfer noted that the final product will not “necessarily” be limited to using ChatGPT, noting that Mercedes-Benz could swap it for other chatbots “if we see options that are better for the customer.” This could include, for example, using alternative LLMs to provide better localization in different regions.
Drivers can opt out of the program and the virtual assistant only learns from individual cars, with the data not shared between drivers, Schäfer added.
The updated MBUX Virtual Assistant will launch in early 2025.
NFT gallery in the car
Mercedes-Benz is also updating its navigation and in-car entertainment (ICE) systems. The latter will include an in-car music experience, MBUX Sound Drive, developed by artist Will.i.am, which allows music to “respond to the way the acr is controlled”.
Mercedes-Benz MBUX Collectibles app. Image: Mercedes-Benz
A new MBUX Collectibles in-car app allows drivers to show their non-fungible token (NFT) collection on the vehicle ‘s dashboard, including the brand ‘s own NXT NFTs on the Ethereum blockchain. The company made headlines last year when the decline of the NXT Icons NFT collection caused its website to crash.
Mercedes-Benz also uses blockchain technology for less frivolous applications; in 2020, the company announced it was conducting a pilot project to track the amount of CO2 emissions in its cobalt supply chain using blockchain, in partnership with traceability start-up Circulor.