USDOT

Simulating experience of accessible autonomous cars

U.S. DOT Inclusive Design Challenge seeks to improve passenger vehicle accessibility. As one of the 10 semifinalists, our team created the smartphone-based interface for controlling autonomous vehicles and validated its usability with an online simulator.

I was responsible for managing a team of 3 members to build an online simulator. I lead the design sprints and collaborate with the development team for implementation.

Role

Product Design Lead

Team

Product designers, User researchers, Simulator developers, Mobile app developers

Duration

September 2021 ~ March 2022

Achievement

Built online user testing environment for remote user testing sessions

Background

How can we give people with disabilities independence while using an autonomous vehicle?

Funded by the U.S. Department of Transportation (USDOT), the project aims to create a design system to improve the level of accessibility for autonomous vehicles. Our team has built an autonomous ridesharing app (Unigo) that leverages smartphone accessibility systems. With Unigo, people with visual, hearing and motor impairments can have full control over the autonomous car and travel independently.

Four Unigo app screens for booking and riding an accessible autonomous car
Unigo is an autonomous ridesharing service for accessibility
Project timeline highlighting the validation phase, where the online simulator was built
I joined the team to initiate the "validation" phase by creating an online simulator

How might we test the usability of ridesharing experience without vehicles?

Constructing UT environment

As the user testing is planned to be conducted remotely, we've decided to build a web-based simulator that can display real-time input from Unigo. Also, to mimic the journey of Unigo, we've divided it into two situations - inside and outside the vehicle - and depicted them with animation and UIs respectively.

Simulating autonomous car riding experience through screens

Diagram of how the simulator's parts connect: the mobile app, the test website and the simulated vehicle
Components of the simulator

Tasks

I have collaborated with the user testing team to identify the tasks to test with interviewees. From the 4 sections that the journey of Unigo consists of - ordering a ride, onboarding, during the ride, and drop off - we've specified the features that contain different usability issues.

Testing 13 features

Usability test tasks grouped by stage: ordering, boarding, during and leaving the ride
Tasks
Spreadsheet of features with status and priority, used to plan sprints
Facilitating sprints based on priorities

Accessibility Design

Our goal is to make the simulator satisfy Level AA standard of Web Content Accessibility Guidelines (WCAG). To set a clear design guide of our own, I specified the key accessibility norms consulting WCAG 2.1. We took the guide into account consistently during the design process.

More contrast
More accessible

Design rule: a contrast ratio of at least 4.5 to 1 Design rule: pair icons with text labels
Colors with good contrast
Video captions
Design rule: the Atkinson Hyperlegible typeface Design rule: a clear label for every section
Font with great readability
Grouping and Labeling

Information Architecture

As the simulator intends to react to the interviewees' input on Unigo, its IA should be more concise than that of the mobile app. I constructed the IA by sorting out essential information and grouping them in a way that helps people to comprehend the simulator (e.g. what did they select and what's the result of the interaction.)

Information architecture of the app

To display both context and the result of the input simultaneously, we've decided to use the sidebar UI. It not only helped us to present hierarchical content clearly but also place information in logical order so that screen reader users could easily navigate the content.

Sidebar

Annotated layout: a sidebar with the rider profile, driving mode and climate controls beside the main panel
Wireframe of modular controls stacked in the sidebar over a map
Sidebar is good at displaying information hierarchy
Module type could be distracting due to the back layer

Colors

Maintaining a good color contrast was one of our fundamental rules in building an accessible simulator. We've started designing in grayscale to focus on the value of colors over hue or saturation.

Checking colour contrast against the AA standard with the A11y Figma plugin
A11y Figma plugin was used to meet AA standard

One concern in regards to colors was choosing the theme of UI. To remain consistent with the mobile app, dark theme should have been applied on the controls menu. However, our final decision was light theme, as it ensured a good contrast between the design elements and the background which increased visibility.

Seat control screen in the light theme
Seat control screen in the dark theme
Light Theme
Dark Theme

Feedback

Visual feedback should be the most striking element while controlling the inside of the car. To maximize its visibility, close-up images were selected for each control and located at the center of the screen.

Headrest control screens before and after feedback

One challenge we've faced was that using animation causes significant delays when developed. Thus, we've used static visual cues that implies the directionality of the controls.

Fan direction shown as airflow toward the seat
Fan speed shown as airflow across the car's cabin
Fan direction
Fan speed

For screen reader users, we've labeled the visual feedback. The terms were carefully chosen to be concise so that people can quickly distinguish what state they are at.

Lighting control with on-screen labels for the control, its state and its seat
Video call demo of the wheelchair user flow with developers
Demo session of wheelchair user flow with developers
Final Design
All users
Windows
Lighting
Window control: the back-left window rolled down 25%
Lighting control: the front-right light switched on
Non-wheelchair users
Temperature control: 68°F for all seats
Temperature
Fan speed
Fan speed control: level 1 for all seats
Fan direction control: airflow pointed up for all seats
Fan direction
Seat warmer
Seat warmer control: level 3 for all seats
Headrest control: the back-right headrest at its lowest height
Headrest
Seat position
Seat position control: the front-right seat slid forward 75%
Seat recline control: the front-right seat at level 3
Seat recline
Wheelchair users
Wheelchair user flow, temperature control: 70°F for all seats
Temperature
Fan speed
Wheelchair user flow, fan speed control: level 3
Wheelchair user flow, fan direction control: airflow pointed up at the wheelchair
Fan direction

Reflection

Having an accessibility mindset from the beginning, I learned how to have clear communication with users. By putting myself into diverse users' shoes, I was able to understand how different users receive the information. This made me realize that accessibility is not about designing edge cases but delivering values to the users.

Crafting details to make experience more accessible