We analyzed Google Maps' main flows to understand its UI, design hierarchy, and interactions.
We analyzed Google Maps' main flows to understand its UI, design hierarchy, and interactions.
We analyzed Google Maps' main flows to understand its UI, design hierarchy, and interactions.
Our low-fi wireframes aimed to understand the optimal flows and cues for the feature.
Our low-fi wireframes aimed to understand the optimal flows and cues for the feature.
Our low-fi wireframes aimed to understand the optimal flows and cues for the feature.
We were able to move quickly to high-fidelity prototypes since we were working with an established design system.
We were able to move quickly to high-fidelity prototypes since we were working with an established design system.
We were able to move quickly to high-fidelity prototypes since we were working with an established design system.
Crafting the flow of receiving an alert.
Crafting the flow of receiving an alert.
Crafting the flow of receiving an alert.
Design • Ideation • Evaluation
Design • Ideation • Evaluation
Design • Ideation • Evaluation
Google Maps Design System
Google Maps Design System
Google Maps Design System
Our Design Components
Our Design Components
Our Design Components
We used the Google Maps design system to inform our own sub-system for this feature.
We used the Google Maps design system to inform our own sub-system for this feature.
We used the Google Maps design system to inform our own sub-system for this feature.
We tried to keep in mind that users may not want alerts at all times. So, our flow relied on the user switching on the button. This would also alleviate some privacy concerns.
We tried to keep in mind that users may not want alerts at all times. So, our flow relied on the user switching on the button. This would also alleviate some privacy concerns.
We tried to keep in mind that users may not want alerts at all times. So, our flow relied on the user switching on the button. This would also alleviate some privacy concerns.
Our codesign session alerted us to the important of "Contact 911". Many DHH users choose not to speak, so calling 911 is not an option. By providing them with both call and text, we include this population better.
Our codesign session alerted us to the important of "Contact 911". Many DHH users choose not to speak, so calling 911 is not an option. By providing them with both call and text, we include this population better.
Our codesign session alerted us to the important of "Contact 911". Many DHH users choose not to speak, so calling 911 is not an option. By providing them with both call and text, we include this population better.
During the cognitive walkthrough, evaluators provided real-time feedback while completing tasks with our prototype, highlighting positive impressions like its integration with Google’s style but also pointing out small UI inconsistencies. The heuristic evaluation revealed an average score of 4.225, indicating an overall effective experience.
During the cognitive walkthrough, evaluators provided real-time feedback while completing tasks with our prototype, highlighting positive impressions like its integration with Google’s style but also pointing out small UI inconsistencies. The heuristic evaluation revealed an average score of 4.225, indicating an overall effective experience.
During the cognitive walkthrough, evaluators provided real-time feedback while completing tasks with our prototype, highlighting positive impressions like its integration with Google’s style but also pointing out small UI inconsistencies. The heuristic evaluation revealed an average score of 4.225, indicating an overall effective experience.
We didn't receive many responses on the survey. We are looking for another opportunity to test with these users!
We didn't receive many responses on the survey. We are looking for another opportunity to test with these users!
We didn't receive many responses on the survey. We are looking for another opportunity to test with these users!
Maps for journey
Maps for journey
Maps for journey
Alarm/Alert visualized for user
Alarm/Alert visualized for user
Alarm/Alert visualized for user
Dismiss
Dismiss
Dismiss
Contact 911
Contact 911
Contact 911
Switch on feature through button
Switch on feature through button
Switch on feature through button
User views alert
User views alert
User views alert
User dismisses alert
User dismisses alert
User dismisses alert
User contacts 911
for help
User contacts 911
for help
User contacts 911
for help
Alarm/Alert occurs
Alarm/Alert occurs
Alarm/Alert occurs
Evaluations
Evaluations
Evaluations
We conducted a Cognitive Walkthrough and Heuristic Evaluation with experts to assess our prototype.
We conducted a Cognitive Walkthrough and Heuristic Evaluation with experts to assess our prototype.
We conducted a Cognitive Walkthrough and Heuristic Evaluation with experts to assess our prototype.
We attempted in-person usability testing with DHH individuals but we didn't have the budget for interpreters.
We attempted in-person usability testing with DHH individuals but we didn't have the budget for interpreters.
We attempted in-person usability testing with DHH individuals but we didn't have the budget for interpreters.
We created a survey instead, which was distributed by accessibility professors across the US.
We created a survey instead, which was distributed by accessibility professors across the US.
We created a survey instead, which was distributed by accessibility professors across the US.
Our teardown focused on finding interaction patterns, understanding the information architecture, and how a feature could be integrated easily.
Our teardown focused on finding interaction patterns, understanding the information architecture, and how a feature could be integrated easily.
Our teardown focused on finding interaction patterns, understanding the information architecture, and how a feature could be integrated easily.
Users want consistency, control, and improved navigation.
Users want consistency, control, and improved navigation.
Users want consistency, control, and improved navigation.
We prioritized the stories of interviewees, actively listening to their experiences.
We prioritized the stories of interviewees, actively listening to their experiences.
We prioritized the stories of interviewees, actively listening to their experiences.
We found that while DHH issues span multiple topics, a key concern is the lack of visual information about environmental sounds.
We found that while DHH issues span multiple topics, a key concern is the lack of visual information about environmental sounds.
We found that while DHH issues span multiple topics, a key concern is the lack of visual information about environmental sounds.
Affinity mapping helped us identify patterns in the data.
Affinity mapping helped us identify patterns in the data.
Affinity mapping helped us identify patterns in the data.
Research • Interviews
Research • Interviews
Research • Interviews
The literature highlights challenges DHH individuals face in public spaces, especially with navigation and accessibility. While some solutions exist, most focus on specific use cases, leaving a gap in comprehensive public transportation navigation tools.
The literature highlights challenges DHH individuals face in public spaces, especially with navigation and accessibility. While some solutions exist, most focus on specific use cases, leaving a gap in comprehensive public transportation navigation tools.
The literature highlights challenges DHH individuals face in public spaces, especially with navigation and accessibility. While some solutions exist, most focus on specific use cases, leaving a gap in comprehensive public transportation navigation tools.
We interviewed:
3 Deaf individuals
1 Hard of Hearing individual
2 DHH researchers
1 accessibility designer
We interviewed:
3 Deaf individuals
1 Hard of Hearing individual
2 DHH researchers
1 accessibility designer
We interviewed:
3 Deaf individuals
1 Hard of Hearing individual
2 DHH researchers
1 accessibility designer
Deaf
Participant
Deaf
Participant
Deaf
Participant
VRS
Interpreter
VRS
Interpreter
VRS
Interpreter
Accessibility Expert
Accessibility Expert
Accessibility Expert
MY CONTRIBUTION
MY CONTRIBUTION
MY CONTRIBUTION
My background in linguistics gave me great talking points with ASL speakers. My research on Language Deprivation Syndrome helped speakers open up, since they were able to see our curiosity.
My background in linguistics gave me great talking points with ASL speakers. My research on Language Deprivation Syndrome helped speakers open up, since they were able to see our curiosity.
My background in linguistics gave me great talking points with ASL speakers. My research on Language Deprivation Syndrome helped speakers open up, since they were able to see our curiosity.
We sketched out a few key possibilities for our system. Have a look!
We sketched out a few key possibilities for our system. Have a look!
We sketched out a few key possibilities for our system. Have a look!
The solution could have many solutions.
We brainstormed 100+ design concepts to explore all possibilities.
The solution could have many solutions.
We brainstormed 100+ design concepts to explore all possibilities.
The solution could have many solutions.
We brainstormed 100+ design concepts to explore all possibilities.
A codesign session with an expert helped us narrow down to a final idea.
A codesign session with an expert helped us narrow down to a final idea.
A codesign session with an expert helped us narrow down to a final idea.
Our interviewee highlighted the importance of haptic feedback, user-controlled audio features, and visual symbols for intuitive alerts, suggesting 5-7 key cues for different scenarios. She also mentioned that the system should be integrated with an app people feel comfortable with.
Our interviewee highlighted the importance of haptic feedback, user-controlled audio features, and visual symbols for intuitive alerts, suggesting 5-7 key cues for different scenarios. She also mentioned that the system should be integrated with an app people feel comfortable with.
Our interviewee highlighted the importance of haptic feedback, user-controlled audio features, and visual symbols for intuitive alerts, suggesting 5-7 key cues for different scenarios. She also mentioned that the system should be integrated with an app people feel comfortable with.
Alert Friends
Alert Friends
Alert Friends
Travel With Connections
Travel With Connections
Travel With Connections
Travel With Connections
Travel With Connections
Travel With Connections
Universal Public Transport Updates
Universal Public Transport Updates
Universal Public Transport Updates
Opportunity
Opportunity
Opportunity
Most existing solutions are research-oriented, so are difficult to use in daily life.
Most existing solutions are research-oriented, so are difficult to use in daily life.
Most existing solutions are research-oriented, so are difficult to use in daily life.
Deaf and Hard of Hearing (DHH) individuals often face challenges navigating public spaces.
Deaf and Hard of Hearing (DHH) individuals often face challenges navigating public spaces.
Deaf and Hard of Hearing (DHH) individuals often face challenges navigating public spaces.
DHH individuals struggle in public spaces due to limited visual cues and audio-based information. Better visual systems and inclusive communication can enhance accessibility in cities like Atlanta.
DHH individuals struggle in public spaces due to limited visual cues and audio-based information. Better visual systems and inclusive communication can enhance accessibility in cities like Atlanta.
DHH individuals struggle in public spaces due to limited visual cues and audio-based information. Better visual systems and inclusive communication can enhance accessibility in cities like Atlanta.
Problem
Problem
Problem
A system to enhance public transport journeys by visualizing key environmental sounds directly within Google Maps.
A system to enhance public transport journeys by visualizing key environmental sounds directly within Google Maps.
A system to enhance public transport journeys by visualizing key environmental sounds directly within Google Maps.
Solution
Solution
Solution
Introduction to feature.
Showcasing feature capabilities through cards, following Google Maps' flow and design system.
Introduction to feature.
Showcasing feature capabilities through cards, following Google Maps' flow and design system.
Introduction to feature.
Showcasing feature capabilities through cards, following Google Maps' flow and design system.
Visualization of alert-related information.
Converting audio cues to visual cues, describing events when needed.
Visualization of alert-related information.
Converting audio cues to visual cues, describing events when needed.
Visualization of alert-related information.
Converting audio cues to visual cues, describing events when needed.
Verification through hearing individuals.
Hearing individuals can confirm events, similar to accident reporting.
Verification through hearing individuals.
Hearing individuals can confirm events, similar to accident reporting.
Verification through hearing individuals.
Hearing individuals can confirm events, similar to accident reporting.
PAPER NOMINATED FOR CHI 2025!
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Not Now
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
PAPER NOMINATED FOR CHI 2025!
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Not Now
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
PAPER NOMINATED FOR CHI 2025!
Work
Gas
Restaurants
Groceries
Search
Latest in the area
Explore
Go
Saved
Contribute
Updates
7:30
32
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Not Now
Start
Exit
7:30
32
?
Is a fire alarm ringing near you?
YES
NO
NOT SURE
Updated 1 minutes ago
Fire alarm detected
84.5%
USABILITY IN HEURISTIC EVALUATION
84.5%
USABILITY IN HEURISTIC EVALUATION
84.5%
USABILITY IN HEURISTIC EVALUATION
Google Maps feature enhancing auditory awareness for Deaf and Hard of Hearing individuals on public transport journeys.
Google Maps feature enhancing auditory awareness for Deaf and Hard of Hearing individuals on public transport journeys.
Google Maps feature enhancing auditory awareness for Deaf and Hard of Hearing individuals on public transport journeys.
Context
Context
Context
Design Project
Aug - Dec 2024
Design Project
Aug - Dec 2024
Design Project
Aug - Dec 2024
Team
Team
Team
Disha / Rachit / Natalie / Tim
Disha / Rachit / Natalie / Tim
Disha / Rachit / Natalie / Tim
Responsibilities
Responsibilities
Responsibilities
User Interviews
Co-Design
Competitive Analysis
Sketching
Concept Validation
Prototyping
User Interviews
Co-Design
Competitive Analysis
Sketching
Concept Validation
Prototyping
User Interviews
Co-Design
Competitive Analysis
Sketching
Concept Validation
Prototyping
Tools
Tools
Tools
Figma
FigJam
Qualtrics
Figma
FigJam
Qualtrics
Figma
FigJam
Qualtrics
Deaf Accessibility for Google Maps
Deaf Accessibility for Google Maps
Deaf Accessibility for Google Maps
Outcomes • Evaluation
Outcomes • Evaluation
Outcomes • Evaluation
Reflections • Future Steps
Reflections • Future Steps
Reflections • Future Steps
Introduction cards to learn about feature.
Introduction cards to learn about feature.
Text and iconography to relay audio information.
Text and iconography to relay audio information.
History of notifications to recheck events.
History of notifications to recheck events.
A way to verify events through hearing individuals.
A way to verify events through hearing individuals.
Toggle feature
on and off in Accessibility Settings.
Toggle feature
on and off in Accessibility Settings.
It's pretty common in interviews to just plough ahead with questions. I think what worked for us was our community-focused approach, allowing the participants to speak about their experiences first, and then asking questions.
It's pretty common in interviews to just plough ahead with questions. I think what worked for us was our community-focused approach, allowing the participants to speak about their experiences first, and then asking questions.
It's pretty common in interviews to just plough ahead with questions. I think what worked for us was our community-focused approach, allowing the participants to speak about their experiences first, and then asking questions.
It would be great to see how accurate current AI systems are for this problem. And if they are not fully accurate (which is very likely), how can we design for the edge cases?
Also, we would love to conduct some in-person evaluation sessions with DHH individuals. We didn't have the budget this time, but looking forward to it soon.
It would be great to see how accurate current AI systems are for this problem. And if they are not fully accurate (which is very likely), how can we design for the edge cases?
Also, we would love to conduct some in-person evaluation sessions with DHH individuals. We didn't have the budget this time, but looking forward to it soon.
It would be great to see how accurate current AI systems are for this problem. And if they are not fully accurate (which is very likely), how can we design for the edge cases?
Also, we would love to conduct some in-person evaluation sessions with DHH individuals. We didn't have the budget this time, but looking forward to it soon.
We wanted to create our independent app for this project. But we soon realized that users would never download any extra technology for this. Users trusted Google Maps, and nesting the feature in this would fulfill the project goals better.
We wanted to create our independent app for this project. But we soon realized that users would never download any extra technology for this. Users trusted Google Maps, and nesting the feature in this would fulfill the project goals better.
We wanted to create our independent app for this project. But we soon realized that users would never download any extra technology for this. Users trusted Google Maps, and nesting the feature in this would fulfill the project goals better.
Work
Work
Gas
Gas
Restaurants
Restaurants
Groceries
Groceries
Search
Search
Latest in the area
Latest in the area
Explore
Explore
Go
Go
Saved
Saved
Contribute
Contribute
Updates
Updates
7:30
7:30
32
32
You’re in control
You’re in control
Change your preferences anytime in settings. Click to learn more about Privacy and Accessibility at Google.
Change your preferences anytime in settings. Click to learn more about Privacy and Accessibility at Google.
Try it Out
Try it Out
Not Now
Not Now
Work
Work
Gas
Gas
Restaurants
Restaurants
Groceries
Groceries
Search
Search
Latest in the area
Latest in the area
Explore
Explore
Go
Go
Saved
Saved
Contribute
Contribute
Updates
Updates
7:30
7:30
32
32
Track noise levels
Track noise levels
The button bars will turn blue according to your surrounding noise level.
The button bars will turn blue according to your surrounding noise level.
Next
Next
Work
Work
Gas
Gas
Restaurants
Restaurants
Groceries
Groceries
Search
Search
Latest in the area
Latest in the area
Explore
Explore
Go
Go
Saved
Saved
Contribute
Contribute
Updates
Updates
7:30
7:30
32
32
Available at your fingertips
Available at your fingertips
Simply press the audio detection button to enable or disable the feature.
Simply press the audio detection button to enable or disable the feature.
Next
Next
Work
Work
Gas
Gas
Restaurants
Restaurants
Groceries
Groceries
Search
Search
Latest in the area
Latest in the area
Explore
Explore
Go
Go
Saved
Saved
Contribute
Contribute
Updates
Updates
7:30
7:30
32
32
Stay aware as you travel
Stay aware as you travel
Get notified about critical sounds and see live transcriptions of speaker announcements.
Get notified about critical sounds and see live transcriptions of speaker announcements.
Next
Next
Work
Work
Gas
Gas
Restaurants
Restaurants
Groceries
Groceries
Search
Search
Latest in the area
Latest in the area
Explore
Explore
Go
Go
Saved
Saved
Contribute
Contribute
Updates
Updates
7:30
7:30
32
32
Audio-detection Assistant
Audio-detection Assistant
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
New accessibility feature can detect external audio and notify you in real time as you use public transportation.
Learn more
Learn more
Not Now
Not Now
Start
Start
Exit
Exit
7:30
7:30
32
32
Fire Alarm Detected
Fire Alarm Detected
Dismiss
Dismiss
Contact 911?
Contact 911?
Speaker Detected
Speaker Detected
Please evacuate the building using staircases 2 and 3. Please exit through the front door. Avoid the back side of the building.
Please evacuate the building using staircases 2 and 3. Please exit through the front door. Avoid the back side of the building.
Live Transcription
Live Transcription
Dismiss
Dismiss
Contact 911?
Contact 911?
Start
Start
Exit
Exit
7:30
7:30
32
32
Fire Alarm Detected
Fire Alarm Detected
Dismiss
Dismiss
Contact 911?
Contact 911?
Please follow evacuation instructions
Please follow evacuation instructions
Start
Start
Exit
Exit
7:30
7:30
32
32
7:30
32
Audio History
7:30
32
Audio History
Fire alarm detected
Fire alarm detected
2 min ago
2 min ago
Bus detected
Bus detected
46 min ago
46 min ago
Subway detected
Subway detected
1 hr ago, 6:23 PM
1 hr ago, 6:23 PM
Announcement shared
Announcement shared
2 hrs ago, 5:15 PM
2 hrs ago, 5:15 PM
Subway detected
Subway detected
2 hrs ago, 4:49 PM
2 hrs ago, 4:49 PM
Accessibility settings
Accessibility settings
7:30
7:30
32
32
Accessible places
Accessible places
Show wheelchair-accessible features like entrance, seating, restrooms, and parking more prominently when viewing a place
⚠ Accessibility info may differ from real-world conditions
Show wheelchair-accessible features like entrance, seating, restrooms, and parking more prominently when viewing a place
⚠ Accessibility info may differ from real-world conditions
Background audio detection
Background audio detection
Show background audio noise levels and auto detect critical sounds when using public transportation mode.
⚠ Accessibility info may differ from real-world conditions.
Show background audio noise levels and auto detect critical sounds when using public transportation mode.
⚠ Accessibility info may differ from real-world conditions.
Start
Start
Exit
Exit
7:30
7:30
32
32
Thank you for your feedback!
Thank you for your feedback!
Updated 1 minutes ago
Updated 1 minutes ago
Fire alarm detected
Fire alarm detected
Start
Start
Exit
Exit
7:30
7:30
32
32
?
?
Is a fire alarm ringing near you?
Is a fire alarm ringing near you?
YES
YES
NO
NO
NOT SURE
NOT SURE
Updated 1 minutes ago
Updated 1 minutes ago
Fire alarm detected
Fire alarm detected
Start
Start
Exit
Exit
7:30
7:30
32
32
?
?
Is a fire alarm ringing near you?
Is a fire alarm ringing near you?
YES
YES
NO
NO
NOT SURE
NOT SURE
Updated 1 minutes ago
Updated 1 minutes ago
Fire alarm detected
Fire alarm detected
Read our paper here!
Read our paper here!
Read our paper here!
And now we are going to CHI 2025!
And now we are going to CHI 2025!
And now we are going to CHI 2025!
A system that visualizes key environmental sounds to enhance public transport journeys.
A system that visualizes key environmental sounds to enhance public transport journeys.
It's important to let people tell their stories.
It's important to let people tell their stories.
It's important to let people tell their stories.
Integrating our system with a familiar system reduced friction for our users.
Integrating our system with a familiar system reduced friction for our users.
Integrating our system with a familiar system reduced friction for our users.
In the future, we need to spend more time testing the technical elements of the system.
In the future, we need to spend more time testing the technical elements of the system.
In the future, we need to spend more time testing the technical elements of the system.
We are honored and excited to inform you that were have been selected for the ACM Computer-Human Interaction conference on Human Factors in Computing Systems 2025 in the Student Design Competition.
We are honored and excited to inform you that were have been selected for the ACM Computer-Human Interaction conference on Human Factors in Computing Systems 2025 in the Student Design Competition.
We are honored and excited to inform you that were have been selected for the ACM Computer-Human Interaction conference on Human Factors in Computing Systems 2025 in the Student Design Competition.
I am incredibly grateful for my team, advisors, and the amazing DHH community that kindly brought us into their world for this work.
Looking forward to talking about Deaf culture on the world stage!
I am incredibly grateful for my team, advisors, and the amazing DHH community that kindly brought us into their world for this work.
Looking forward to talking about Deaf culture on the world stage!
I am incredibly grateful for my team, advisors, and the amazing DHH community that kindly brought us into their world for this work.
Looking forward to talking about Deaf culture on the world stage!
The TLDR ↓
Process starts here ↓
What we achieved ↓
This is the end of the case study!
Thank you for reading!
This is the end of the case study!
Thank you for reading!
This is the end of the case study!
Thank you for reading!
© DISHA SIKARIA 2025
© DISHA SIKARIA 2025
© DISHA SIKARIA 2025