Accessible Way to Take a Selfie Using TalkBack and Android Nougat 7.1.

February 4, 2017 7:05 pm

Subscribe: Apple Podcasts | Android | RSS | More

In this episode, James Oates shows off a new accessibility feature which allows anyone using an Android phone running Nougat 7.1 or higher. If you open the camera app, and you have Talkback 5.1 or higher running, Talkback will automatically give feedback concerning how many people are in the frame, if the faces are centered, and what percentage of the screen is occupied by the face or faces. This is a great way for a person who is blind to take selfies and capture important moments.
James also shows us how to give the photo a description, and share it to social media, cloud drive services, or by email.

YOU MIGHT ALSO LIKE New MacBooks, iPads, Magic Keyboard at WWDC, Apple Regulatory Filing Suggests

About James Oates

James Oates officially joined the Cool Blind Tech podcast team in the summer of 2014. James is an advocate of accessible technology across all platforms, with an emphasis on Windows. As a former K-12 educator, James brings his passion for teaching to the CBT audience in an effort to help listeners realize their potential and explore new avenues of empowerment through technology. Blind since childhood, James currently lives in Florida.
You can follow him on Twitter, @BLIND_MATRIX

Now Available In Narrator! AI-tagged Image Descriptions

Podcast: Download

Subscribe: Apple Podcasts | Android | RSS | More

If there was a word which is to define the era that dominates this early 21st century, it no doubt would be the cloud. Everything has moved to incorporating some cloud-based feature or another. Whilst screen reading has done OCR and other image recognition prior, this too was relegated to locally performed magic, rather than anything that used the cloud to process data. The rise of huge AI clusters which now can process trillions of calculations a second has created a better opportunity for so much more to be off-loaded to these systems.

For Microsoft, this is called Cognitive services and it is a platform any developer can leverage to create AI-generated content for an image.

Once you combine this with a screen reader, things get very interesting. Such has happened in the latest Windows 10 insider build, 16226 Could a screen reader some day suggest labels for controls through an intelligent API which can interpret the icons? Could a computer describe a powerPoint presentation, typically full of rectangles and decorations?

To be clear, Apple is also doing this in iOS 11, though the image processing they use is all on-hardware, not cloud-based. Microsoft is first to announce this to the public, and users will be able to compare it to that of iOS 11 once the public beta of it is released. Narrator is noteable for being able to generate full-sentence descriptions of images, rather than just a few words or phrases which explain its content, as done on iOS and Facebook. The insider program is open to anyone, and submitting feedback is highly encouraged if you venture into this world. As well as having lots of patience, and perhaps not a main computer that you install it on but a virtual machine or spare.

YOU MIGHT ALSO LIKE New Features in Android O First Developer Preview.

Do you see ways in which you would use this technology for yourself to help understand the web or apps better? Feel free to let us know in the comments.

About James Oates

Reader Interactions

Footer

Follow Us