My Role

UX Researcher

Timeline

February - May 2024
(12 weeks)

Tools

Google Keep, FigJam, Zoom

TL;DR

Project Overview

Contribution

Impact

Learning

problem

Blind and low-vision (BLV) individuals experience unique daily challenges during knowledge acquisition.  

This encompasses learning new skills (e.g., code, sports, dance) or performing everyday activities (e.g., cooking, cleaning, traveling). The complexity of these tasks arises from their inability to rely on visual information. 

project goal

Understand how head-worn devices (HWDs) such as smart glasses can support daily knowledge acquisition for BLV individuals. 

Research Questions
Questions to be answered through research
KEY insights
methodologies

We conducted semi-structured interviews with completely or legally blind participants (N = 9) recruited through the National Federation of Blind (NFB), American Council for Blind (ACB) email lists, and Veterans Affairs (VA). Thematic analysis was then used to analyze the interview transcripts.

Interview Questions
Some questions we discussed with our participants
Thematic Analysis Board
findings overview
detailed findings

1. Navigation Challenges

“There's times when I wanna go train my dog [in] places, but I'm unsure because I am not familiar with the place. and my dog is new, you know, so I'm training her so it's like new for both of us.” — P3
“[My legs] are scarred. I literally come back​ and kick that door that's open, like I'm trying to kick a field goal, cause I don't see it.” — P9
“Anybody that's going blind is eventually gonna lose the use of both their hands when they're in public” — P9

2. Physical Activities & Materials Challenges

“One thing I do miss about being at in-person [dance] workshops is like [...] people can kind of correct the little tiny things such as “bend your arm” or “oh wait, not that far” or “stay, hold it there” you know things like that, like the little intricacies of motion.” — P3
"Up to 70% of communication can be non-verbal. People that are sighted have deciding advantages over me when we’re discussing things. They can see me. I can’t see them.” — P4
“[...] for a lot of visual tasks such as filing out paperwork, you need someone to help you read and interpret the information. I need someone to show me where to fill information in and or essentially fill it out for me” — P6

3. Digital Screens Challenges

“This CAD software. The person on a YouTube video will say, Oh, in order to enlarge this, you just move them as you click here on the file menu. And he’s doing about 3 to 5 things when he’s explaining one thing . . . I have to go over those videos 10 times before I even start to grasp what’s going on. It’s all due to visual impairment.” — P8
“There’s a lot of instances where my screen reader has basically glitched and gone away for like a bit. And then I have to figure out a way to get back.” — P1
“I tried using the apps to get help with the soda machine but never got anybody. To rely on someone else [...] it is important to rely on yourself and be independent.” — P8

4. Portable & Hands-free Form Factor is Preferred

“I don't expect it to be really big. I don't expect it to be human size. I think you know something that is around the size of a bigger insect that is able to maneuver the place and maybe climb on things and stuff like that [...]  I definitely want it to be more of a handsfree experience where I just direct it to go to different places without having to pick it up”  — P5
“I hope they wouldn't make me look like someone in space or look like a pair of workshield glasses. I hope they look like normal regular glasses similar to Ray Bans.” — P7

5. Real-time Voice Interaction & Feedback as Primary Modality

“Totally voice, totally voice, like how I interact with my phone if I say ‘Hey, Siri’.” — P2
“To take a picture, I can say photo, I can say camera, and when I go to the camera it should be able to tell me if the face is aligned on the camera or tell me how to go left or right with the glasses to get whatever I'm trying to take a picture centered. Then I should be able to tap it and take the picture with the glasses” — P7
“I feel like for myself, [gestures] would be kind of distracting to have.” — P1

6. Seamless Integration with Existing Devices

"[…] particularly if I was using the device to read things to me. I might want to be able to copy the text and put it places. So yeah, integration with smartphone would be important to me." — P3
"I think eventually, for wearable. There needs to be a way for people to create these different apps, whether it's for golf, whether it's for finding things, whether it's for detection of any kind that people can then use" — P9

7. Expectations for HWDs for BLVs

“You would not need that screen which, just like all the rest, takes up space and power.” — P4
“[will] probably go more places [with HWDs] because I could use it to hopefully navigate, or at least tell what was in front of me in a grander sense than my cane [and dog] can do.” — P3
“[About using kitchen appliances] [...] just to be able to see what was on the touch screen and to be able to determine if the device is almost at temperature would have been helpful.” — P3
“If you do have a screen on your computer or laptop, [HWDs] can help you navigate or like, give you guidance on what to do, or some shortcut keys.” — P1

8. Concerns for HWDs for BLVs

“When there is a barrier by the time you realize that there is a barrier, you would have already collided with that barrier. I think it still has to improve quite a bit.” — P2
“I'm not really ready to invest in one of those yet, because they're they are really pricey. And …even though it's slightly less convenient, I feel like the apps that I have on my phone are enough for me to get by with.” — P5
 “[…] subscription for their services in order for them to work, even though it’s paired with your phone [...] and their subscription was very high [in price].” — P9
“[know] where my data is being stored” — P3
“I'm not really fond of headphones. I believe in hearing, you know, outside sound, so headphone becomes a barrier in that sense. So, any device that you know does not have headphone usage as a prerequisite. I'm all good for it.” — P2
"I don't personally like wearing glasses. So for me, I feel like it would just be another like just an accessory that I wouldn't want on my head when I'm cooking like I want to stay focused on what I'm trying to do with my non-visual skills." — P1

conclusion

This work was presented to Microsoft Mixed Reality User Research. In this research, we suggested a new way of viewing "learning" as to increase perceptions of immediate surroundings. This broadens the scope of learning activities to things like navigation, which was often not considered a form of learning but a separate activity. This re-categorization of activities can hopefully benefit future works in exploring BLVs' needs.

The current research also establishes HWDs as a probable form factor for BLV assistive technologies. Key features highlighted in this study could provide groundwork for more prototype attempts in the near future. We encourage future research to recruit a more diverse group of participants, including those with more experiences using HWDs, gather a larger data set (e.g., survey), and conduct usability tests of existing/prototyped HWDs to holistically understand BLV needs.

learnings