Blind and Human: Exploring More Usable Audio CAPTCHA Designs

Authors: 

Valerie Fanelle, Sepideh Karimi, Aditi Shah, Bharath Subramanian, and Sauvik Das, Georgia Institute of Technology

Awarded Distinguished Paper!

Abstract: 

For people with visual impairments (PVIs), audio CAPTCHAs are accessible alternatives to standard visual CAPTCHAs. However, current audio CAPTCHA designs are slower to complete and less accurate than their visual counterparts. We designed and evaluated four novel audio CAPTCHAs that we hypothesized would increase accuracy and speed. To evaluate our designs along these measures, we ran a three-session, within-subjects experiment with 67 PVIs from around the world --- the majority being from the U.S. and India. Thirty three participants completed all three sessions, each separated by one week. These participants completed a total of 39 distinct audio CAPTCHA challenges across our prototype designs and the control, all presented in random order. Most importantly, all four of our new designs were significantly more accurate and faster than the control condition, and were rated as preferable over the control. A post-hoc security evaluation suggested that our designs had different strengths and weaknesses vis-a-vis two adversaries: a random guessing adversary and a NLP adversary. Ultimately, our results suggest that the best design to use is dependent on use-context.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {255648,
author = {Valerie Fanelle and Sepideh Karimi and Aditi Shah and Bharath Subramanian and Sauvik Das},
title = {Blind and Human: Exploring More Usable Audio {CAPTCHA} Designs},
booktitle = {Sixteenth Symposium on Usable Privacy and Security ({SOUPS} 2020)},
year = {2020},
isbn = {978-1-939133-16-8},
pages = {111--125},
url = {https://www.usenix.org/conference/soups2020/presentation/fanelle},
publisher = {{USENIX} Association},
month = aug,
}

Presentation Video