VW Group – Real-time HMI Prototyping Framework
Led the development of a scalable 3D HMI prototyping framework adopted across VW Group, integrating AI and multimodal interaction to accelerate next-generation mobility experiences.
Technical Lead & Project Manager
Technical lead and project manager for cross-functional team of 12+ developers and designers
Budget Oversight
Successfully managed €1.5M project budget across 18-month development cycle
Strategic Alignment
Ensured outcomes aligned with long-term HMI innovation roadmaps across multiple VW subsidiaries.
Project Media
An early neutral prototype used to demonstrate proof-of-concept functionality. (Final production frameworks were significantly more advanced and remain confidential under NDA.)
Project Overview
The Challenge
Traditional HMI development cycles at Volkswagen Group were too slow for the rapidly evolving mobility landscape. Introducing new technologies such as 3D interaction, AI, and autonomous driving required external contractors and produced fragmented prototypes that were often short-lived and difficult to maintain.
The challenge was to build a unified, scalable framework for rapid HMI prototyping — one that streamlined workflows, integrated seamlessly with automotive systems, and supported real-time simulation and user testing.
The Solution
We created a scalable HMI prototyping framework that unified the fragmented and slow processes of automotive UX development. The framework provided a common platform where designers, engineers, and researchers could collaboratively build and validate in-car experiences.
Unlike traditional one-off prototypes, this system was designed for longevity and adaptability. It supported a wide range of use cases — from ADAS interactions to autonomous driving scenarios, GenAI, voice interaction and 3D interfaces.
Technical Approach
3D HMI Prototyping in Unity 3D
Built immersive 3D environments where developers and designers could connect HMI concepts directly to simulated vehicle states and sensor data (e.g., ADAS inputs, door states, street signs etc).
Automotive UI Component Library
• Created a library of reusable UI elements optimized for in-car displays (ADAS, CID, FID), enabling rapid interface assembly and consistent design language.
Seating Buck Integration
Plug-and-play with existing simulation tools and seating bucks, allowing real-time testing of HMI concepts without expensive contractor/technical support.
AI & Multimodal Interaction Layer
Integrated voice, LLM-driven dialogue, and multimodal inputs to explore next-generation in-car interaction paradigms, where users can interact with the HMI, Car functionality and to have GenerativeAI experience, including customisation of the interface.
Visual Scenario Builder with Node-RED
We created a Node-RED based tool that enabled researchers and non-technical stakeholders to design and run studies without writing code or building UI mockups.
Version Control & Asset Management
Git-based versioning with automotive compliance tracking. With more than 100 features, 6 major releases and complex branching.
Results & Impact
Reduced design iteration cycles from 4 weeks to 4 days — a 90% improvement in speed, enabling rapid prototyping and validation across ADAS, CID, and FID use cases.
Cross-functional development team with mix of full time employees, external contractors and interns/working students.
Delivered the framework ~70% cheaper and 50% faster than standard simulation projects in Volkswagen Group