Skip to main content
USENIX
  • Conferences
  • Students
Sign in
  • Overview
  • Workshop Organizers
  • Technical Sessions
  • Hotel & Travel Information
  • Sponsors
  • For Participants
  • Call for Papers
  • Past Workshops

sponsors

Bronze Sponsor
Bronze Sponsor
Bronze Sponsor

twitter

Tweets by @usenix

usenix conference policies

  • Event Code of Conduct
  • Conference Network Policy
  • Statement on Environmental Responsibility Policy

You are here

Home » Operating System Support for Augmented Reality Applications
Tweet

connect with us

http://www.twitter.com/usenix
https://www.facebook.com/usenixassociation
https://plus.google.com/108588319090208187909/posts
http://www.linkedin.com/groups?home=&gid=49559
http://www.youtube.com/user/USENIXAssociation

Operating System Support for Augmented Reality Applications

Authors: 

Loris D'Antoni, University of Pennsylvania; Alan Dunn and Suman Jana, TheUniversity of Texas at Austin; Tadayoshi Kohno, University of Washington; Benjamin Livshits, David Molnar, Alexander Moshchuk, and Eyal Ofek, Microsoft Research; Franziska Roesner, University of Washington; Scott Saponas, Margus Veanes, and Helen J. Wang, Microsoft Research

Abstract: 

Augmented reality (AR) takes natural user input (NUI), such as gestures, voice, and eye gaze, and produces digital visual overlays on top of reality seen by a user. Today, multiple shipping AR applications exist, most notably titles for the Microsoft Kinect and smartphone applications such as Layar, Wikitude, and Junaio. Despite this activity, little attention has been paid to operating system support for AR applications. Instead, each AR application today does its own sensing and rendering, with the help of user-level libraries like OpenCV or the Microsoft Kinect SDK.

In this paper, we explore how operating systems should evolve to support AR applications. Because AR applications work with fundamentally new inputs and outputs, an OS that supports AR applications needs to re-think the input and display abstractions exposed to applications. Unlike mouse and keyboard, which form explicit, separate channels for user input, NUI requires continuous sensing of the real-world environment, which often has sensitive data mixed with user input. Hence, the OS input abstractions must ensure that user privacy is not violated, and the OS must provide a fine-grained permission system for access to recognized objects like a user's face and skeleton. In addition, because visual outputs of AR applications mix real-world and virtual objects, the synthetic window abstraction in traditional GUIs is no longer viable, and OSes must rethink the display abstractions and their management. We discuss research directions for solving these and other issues and building an OS that let multiple applications share one (augmented) reality.

Loris D'Antoni, University of Pennsylvania

Alan Dunn, The University of Texas at Austin

Suman Jana, The University of Texas at Austin

Tadayoshi Kohno, University of Washington

Benjamin Livshits, Microsoft Research

David Molnar, Microsoft Research

Alexander Moshchuk, Microsoft Research

Eyal Ofek, Microsoft Research

Franziska Roesner, University of Washington

Scott Saponas, Microsoft Research

Margus Veanes, Microsoft Research

Helen J. Wang, Microsoft Research

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {181987,
author = {Loris D{\textquoteright}Antoni and Alan Dunn and Suman Jana and Tadayoshi Kohno and Benjamin Livshits and David Molnar and Alexander Moshchuk and Eyal Ofek and Franziska Roesner and Scott Saponas and Margus Veanes and Helen J. Wang},
title = {Operating System Support for Augmented Reality Applications},
booktitle = {14th Workshop on Hot Topics in Operating Systems (HotOS XIV)},
year = {2013},
address = {Santa Ana Pueblo, NM},
url = {https://www.usenix.org/conference/hotos13/session/d{\textquoteright}antoni},
publisher = {USENIX Association},
month = may,
}
Download
D'Antoni PDF
  • Log in or    Register to post comments

Bronze Sponsors

© USENIX

  • Privacy Policy
  • Contact Us