show video detail

Testing OpenGlass with Visually Impaired Users
- Published_at:2013-08-02
- Category:Science & Technology
- Channel:Brandyn White
- tags:
- description: Two visually impaired users test OpenGlass' Question-Answering and Memento (real-time annotation of scenes/objects). Prior to what is shown, they had an hour of initial testing and hadn't used Glass previously. (Question-Answer) The user takes a picture and asks a question. These get sent to cloud workers (mechanical turk) and twitter users who answer it. The answer received is read aloud to the user through Glass. Note: the voice that you hear is what the user hears, though it is slightly muffled because it is a bone conductive speaker (best heard through headphones, captions at the bottom of the screen note important user feedback). For more detail about our annotation approach see these videos http://www.youtube.com/watch?v=4v8Mm5JotrY and https://www.youtube.com/watch?v=mHWejjTwOMY. (Memento) A native app streams real-time video frames to a cluster, which performs image matching against a dataset of images and annotations created by a sighted user. Annotations associated with matching images are sent back to Glass and read aloud to the user. Best viewed in 1080p HD. This is part of the http://openglass.us project and uses http://picar.us for online annotation and rectification. Developed and demoed by Brandyn White (http://brandynwhite.com) and Andrew Miller. The answers were provided by us for demonstration purposes. Annotation with Picarus is compatible with Mechanical Turk/Twitter. We'd like to thank our users for giving us great feedback and helping us test OpenGlass, Shaun Kane (UMBC) for letting us disrupt his lab for a day, and Jeffrey Bigham (CMU) for arranging the meeting.
ranked in date | views | likes | Comments | ranked in country (#position) |
---|---|---|---|---|
2013-08-04 | 6,683 | 64 | 11 |
(![]() ![]() |
2013-08-05 | 18,846 | 160 | 19 |
(![]() ![]() |
2013-08-06 | 32,778 | 221 | 23 |
(![]() ![]() |
2013-08-07 | 41,991 | 276 | 28 |
(![]() ![]() |
2013-08-08 | 47,244 | 307 | 29 |
(![]() ![]() |
2013-08-10 | 52,290 | 328 | 32 |
(![]() ![]() |