% LaTeX template for Artifact Evaluation V20210817 % % Original Authors % * Grigori Fursin (cTuning foundation, France) 2014-2020 % * Bruce Childers (University of Pittsburgh, USA) 2014 % % Modified by % * Clémentine Maurice (CNRS, France) 2021 % * Cristiano Giuffrida (Vrije Universiteit Amsterdam, Netherlands) 2021 % % (C)opyright 2014-2021 % % CC BY 4.0 license % \documentclass[letterpaper,twocolumn,10pt]{article} \usepackage{usenix-2020-09} \usepackage{hyperref} \begin{document} \special{papersize=8.5in,11in} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% % When adding this appendix to your paper, % please remove the part above %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \appendix \section{Artifact Appendix} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% % See the Artifact Appendix guidelines page on the USENIX % Security website to compile the appendix. % % See also examples of past reproduced papers with a similar Artifact Appendix at: https://cknowledge.io/?q=%22reproduced-papers%22+AND+lib+AND+%28secur*+OR+harden*+OR+mitigat*+OR+defen*+OR+attack*+OR+bug*+OR+vulnerab*%29 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Abstract} {\em Obligatory. Briefly and informally describe your artifact including minimal hardware and software requirements, how it supports your paper, how it can be validated, and what is the expected result. It will be used to select appropriate reviewers. It will also help readers understand what was evaluated and how.} \subsection{Artifact check-list (meta-information)} {\em Obligatory. Use just a few informal keywords in all fields applicable to your artifacts and remove the rest. This information is needed to find appropriate reviewers and gradually unify artifact meta information in Digital Libraries.} {\small \begin{itemize} \item {\bf Algorithm: } \item {\bf Program: } \item {\bf Compilation: } \item {\bf Transformations: } \item {\bf Binary: } \item {\bf Model: } \item {\bf Data set: } \item {\bf Run-time environment: } \item {\bf Hardware: } \item {\bf Run-time state: } \item {\bf Execution: } \item {\bf Security, privacy, and ethical concerns: } \item {\bf Metrics: } \item {\bf Output: } \item {\bf Experiments: } \item {\bf How much disk space required (approximately)?: } \item {\bf How much time is needed to prepare workflow (approximately)?: } \item {\bf How much time is needed to complete experiments (approximately)?: } \item {\bf Publicly available?: } \item {\bf Code licenses (if publicly available)?: } \item {\bf Data licenses (if publicly available)?: } \item {\bf Workflow frameworks used?: } \item {\bf Archived (provide DOI or stable reference)?: } \end{itemize} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Description} \subsubsection{How to access} {\em Obligatory} \subsubsection{Hardware dependencies} \subsubsection{Software dependencies} \subsubsection{Data sets} \subsubsection{Models} \subsubsection{Security, privacy, and ethical concerns} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Installation} {\em Obligatory. Describe the setup procedures for your artifact targeting novice users (even if you use a VM image or access to a remote machine).} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Experiment workflow} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Evaluation and expected results} {\em Obligatory. Start by listing the main claims in your paper. Next, list your key results and detail how they each support the main claims. Finally, detail all the steps to reproduce each of the key results in your paper by running the artifacts. Describe the expected results and the maximum variation of empirical results (particularly important for performance numbers).} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Experiment customization} %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% \subsection{Notes} \end{document}