Process starts here ↓
The TLDR ↓
We analyzed Google Maps' main flows to understand its UI, design hierarchy, and interactions.
Our low-fi wireframes aimed to understand the optimal flows and cues for the feature.
We were able to move quickly to high-fidelity prototypes since we were working with an established design system.
Crafting the flow of receiving an alert.
Design • Ideation • Evaluation
Google Maps Design System
Our Design Components
We used the Google Maps design system to inform our own sub-system for this feature.
We tried to keep in mind that users may not want alerts at all times. So, our flow relied on the user switching on the button. This would also alleviate some privacy concerns.
Our codesign session alerted us to the important of "Contact 911". Many DHH users choose not to speak, so calling 911 is not an option. By providing them with both call and text, we include this population better.
During the cognitive walkthrough, evaluators provided real-time feedback while completing tasks with our prototype, highlighting positive impressions like its integration with Google’s style but also pointing out small UI inconsistencies. The heuristic evaluation revealed an average score of 4.225, indicating an overall effective experience.
We didn't receive many responses on the survey. We are looking for another opportunity to test with these users!
Maps for journey
Alarm/Alert visualized for user
Dismiss
Contact 911
Switch on feature through button
User views alert
User dismisses alert
User contacts 911
for help
Alarm/Alert occurs
Evaluations
We conducted a Cognitive Walkthrough and Heuristic Evaluation with experts to assess our prototype.
We attempted in-person usability testing with DHH individuals but we didn't have the budget for interpreters.
We created a survey instead, which was distributed by accessibility professors across the US.
Our teardown focused on finding interaction patterns, understanding the information architecture, and how a feature could be integrated easily.
Users want consistency, control, and improved navigation.
We prioritized the stories of interviewees, actively listening to their experiences.
We found that while DHH issues span multiple topics, a key concern is the lack of visual information about environmental sounds.
Affinity mapping helped us identify patterns in the data.
Research • Interviews
The literature highlights challenges DHH individuals face in public spaces, especially with navigation and accessibility. While some solutions exist, most focus on specific use cases, leaving a gap in comprehensive public transportation navigation tools.
We interviewed:
3 Deaf individuals
1 Hard of Hearing individual
2 DHH researchers
1 accessibility designer
Deaf
Participant
VRS
Interpreter
Accessibility Expert
MY CONTRIBUTION
My background in linguistics gave me great talking points with ASL speakers. My research on Language Deprivation Syndrome helped speakers open up, since they were able to see our curiosity.
We sketched out a few key possibilities for our system. Have a look!
The solution could have many solutions.
We brainstormed 100+ design concepts to explore all possibilities.
A codesign session with an expert helped us narrow down to a final idea.
Our interviewee highlighted the importance of haptic feedback, user-controlled audio features, and visual symbols for intuitive alerts, suggesting 5-7 key cues for different scenarios. She also mentioned that the system should be integrated with an app people feel comfortable with.
Alert Friends
Travel With Connections
Travel With Connections
Universal Public Transport Updates
Opportunity
Most existing solutions are research-oriented, so are difficult to use in daily life.
Deaf and Hard of Hearing (DHH) individuals often face challenges navigating public spaces.
DHH individuals struggle in public spaces due to limited visual cues and audio-based information. Better visual systems and inclusive communication can enhance accessibility in cities like Atlanta.
Problem
A system to enhance public transport journeys by visualizing key environmental sounds directly within Google Maps.
Solution
Introduction to feature.
Showcasing feature capabilities through cards, following Google Maps' flow and design system.
Visualization of alert-related information.
Converting audio cues to visual cues, describing events when needed.
Verification through hearing individuals.
Hearing individuals can confirm events, similar to accident reporting.
PAPER NOMINATED FOR CHI 2025!
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Not Now
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
84.5%
USABILITY IN HEURISTIC EVALUATION
Google Maps feature enhancing auditory awareness for Deaf and Hard of Hearing individuals on public transport journeys.
Context
Design Project
Aug - Dec 2024
Team
Disha / Rachit / Natalie / Tim
Responsibilities
User Interviews
Co-Design
Competitive Analysis
Sketching
Concept Validation
Prototyping
Tools
Figma
FigJam
Qualtrics
Deaf Accessibility for Google Maps
Outcomes • Evaluation
Reflections • Future Steps
Introduction cards to learn about feature.
Text and iconography to relay audio information.
History of notifications to recheck events.
A way to verify events through hearing individuals.
Toggle feature
on and off in Accessibility Settings.
It's pretty common in interviews to just plough ahead with questions. I think what worked for us was our community-focused approach, allowing the participants to speak about their experiences first, and then asking questions.
It would be great to see how accurate current AI systems are for this problem. And if they are not fully accurate (which is very likely), how can we design for the edge cases?
Also, we would love to conduct some in-person evaluation sessions with DHH individuals. We didn't have the budget this time, but looking forward to it soon.
We wanted to create our independent app for this project. But we soon realized that users would never download any extra technology for this. Users trusted Google Maps, and nesting the feature in this would fulfill the project goals better.
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
You’re in control
Change your preferences anytime in settings. Click to learn more about Privacy and Accessibility at Google.
Try it Out
Not Now
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Track noise levels
The button bars will turn blue according to your surrounding noise level.
Next
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Available at your fingertips
Simply press the audio detection button to enable or disable the feature.
Next
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Stay aware as you travel
Get notified about critical sounds and see live transcriptions of speaker announcements.
Next
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Not Now
Start
Exit
7:30
32
Fire Alarm Detected
Dismiss
Contact 911?
Speaker Detected
Please evacuate the building using staircases 2 and 3. Please exit through the front door. Avoid the back side of the building.
Live Transcription
Dismiss
Contact 911?
Start
Exit
7:30
32
Fire Alarm Detected
Dismiss
Contact 911?
Please follow evacuation instructions
Start
Exit
7:30
32
7:30
32
Audio History
Fire alarm detected
2 min ago
Bus detected
46 min ago
Subway detected
1 hr ago, 6:23 PM
Announcement shared
2 hrs ago, 5:15 PM
Subway detected
2 hrs ago, 4:49 PM
Accessibility settings
7:30
32
Accessible places
Show wheelchair-accessible features like entrance, seating, restrooms, and parking more prominently when viewing a place
⚠ Accessibility info may differ from real-world conditions
Background audio detection
Show background audio noise levels and auto detect critical sounds when using public transportation mode.
⚠ Accessibility info may differ from real-world conditions.
Start
Exit
7:30
32
Thank you for your feedback!
Updated 1 minutes ago
Fire alarm detected
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
Read our paper here!
And now we are going to CHI 2025!
A system that visualizes key environmental sounds to enhance public transport journeys.
It's important to let people tell their stories.
Integrating our system with a familiar system reduced friction for our users.
In the future, we need to spend more time testing the technical elements of the system.
We are honored and excited to inform you that were have been selected for the ACM Computer-Human Interaction conference on Human Factors in Computing Systems 2025 in the Student Design Competition.
I am incredibly grateful for my team, advisors, and the amazing DHH community that kindly brought us into their world for this work.
Looking forward to talking about Deaf culture on the world stage!
Always up for a coffee (no sweetener).
Let's connect!
This is the end of the case study!
Thank you for reading!
What we achieved ↓