Provenance-Based Interpretation of Multi-Agent Information Analysis

Authors: 

Scott Friedman, Jeff Rye, David LaVergne, and Dan Thomsen, SIFT, LLC; Matthew Allen and Kyle Tunis, Raytheon BBN Technologies

Abstract: 

Analytic software tools and workflows are increasing in capability, complexity, number, and scale, and the integrity of our workflows is as important as ever. Specifically, we must be able to inspect the process of analytic workflows to assess (1) confidence of the conclusions, (2) risks and biases of the operations involved, (3) sensitivity of the conclusions to sources and agents, (4) impact and pertinence of various sources and agents, and (5) diversity of the sources that support the conclusions. We present an approach that tracks agents’ provenance with PROV-O in conjunction with agents’ appraisals and evidence links (expressed in our novel DIVE ontology). Together, PROV-O and DIVE enable dynamic propagation of confidence and counter-factual refutation to improve human machine trust and analytic integrity. We demonstrate representative software developed for user interaction with that provenance, and discuss key needs for organizations adopting such approaches.We demonstrate all of these assessments in a multi-agent analysis scenario, using an interactive web-based information validation UI.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {255024,
title = {{Provenance-Based} Interpretation of {Multi-Agent} Information Analysis},
booktitle = {12th International Workshop on Theory and Practice of Provenance (TaPP 2020)},
year = {2020},
url = {https://www.usenix.org/conference/tapp2020/presentation/friedman},
publisher = {USENIX Association},
month = jun
}