Evaluating the Usability of Differential Privacy Tools with Data Practitioners

Authors: 

Ivoline C. Ngong, Brad Stenger, Joseph P. Near, and Yuanyuan Feng, University of Vermont

Abstract: 

Differential privacy (DP) has become the gold standard in privacy-preserving data analytics, but implementing it in realworld datasets and systems remains challenging. Recently developed DP tools aim to make DP implementation easier, but limited research has investigated these DP tools’ usability. Through a usability study with 24 US data practitioners with varying prior DP knowledge, we evaluated the usability of four open-source Python-based DP tools: DiffPrivLib, Tumult Analytics, PipelineDP, and OpenDP. Our study results suggest that these DP tools moderately support data practitioners’ DP understanding and implementation; that Application Programming Interface (API) design and documentation are vital for successful DP implementation and user satisfaction. We provide evidence-based recommendations to improve DP tools’ usability to broaden DP adoption.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {298880,
author = {Ivoline C. Ngong and Brad Stenger and Joseph P. Near and Yuanyuan Feng},
title = {Evaluating the Usability of Differential Privacy Tools with Data Practitioners},
booktitle = {Twentieth Symposium on Usable Privacy and Security (SOUPS 2024)},
year = {2024},
isbn = {978-1-939133-42-7},
address = {Philadelphia, PA},
pages = {21--40},
url = {https://www.usenix.org/conference/soups2024/presentation/ngong},
publisher = {USENIX Association},
month = aug
}

Presentation Video