Manifold: A Model-Agnostic Visual Debugging Tool for Machine Learning at Uber

Lezhi Li, Yunfeng Bai, and Yang Wang, Uber Inc.

Abstract: 

Interpretation and diagnosis of machine learning models have gained renewed interest in recent years with breakthroughs in new approaches. We present Manifold, Uber’s in-house model-agnostic visualization tool for ML performance diagnosis and model debugging. Manifold utilizes visual analysis techniques to support interpretation, debugging, and comparison of machine learning models in a more transparent and interactive manner. We demonstrate current applications of the Manifold on the classification and regression tasks at Uber and discuss other potential machine learning use scenarios where Manifold can be applied.

Yang Wang, Uber Inc.

Yang Wang is a Sr. Research Engineer leading the Machine Learning Visualization team at Uber. His research interests lie in Human-Computer Interaction and High-Performance Computing, specifically, methodologies and systems to model the Interpretability and Actionability of AI-aided decision-making processes. At Uber, Yang and team build ML infrastructures, publish & tech-transfer research papers, and work across business units to help Data Scientists, Engineers, and City-Ops accelerate their model iteration process. Besides his industrial job, Yang also provides academic services to multiple HCI and Machine Learning venues.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@conference {232941,
author = {Lezhi Li and Yunfeng Bai and Yang Wang},
title = {Manifold: A {Model-Agnostic} Visual Debugging Tool for Machine Learning at Uber},
year = {2019},
address = {Santa Clara, CA},
publisher = {USENIX Association},
month = may
}