Machine-readable representations of privacy policies are door openers for a
broad variety of novel privacy-enhancing and, in particular,
transparency-enhancing technologies (TETs). In order to generate such
representations, transparency information needs to be extracted from written
privacy policies. However, respective manual annotation and extraction
processes are laborious and require expert knowledge. Approaches for fully
automated annotation, in turn, have so far not succeeded due to overly high
error rates in the specific domain of privacy policies. In the end, a lack of
properly annotated privacy policies and respective machine-readable
representations persists and enduringly hinders the development and
establishment of novel technical approaches fostering policy perception and
data subject informedness.
In this work, we present a prototype system for a `Human-in-the-Loop'
approach to privacy policy annotation that integrates ML-generated suggestions
and ultimately human annotation decisions. We propose an ML-based suggestion
system specifically tailored to the constraint of data scarcity prevalent in
the domain of privacy policy annotation. On this basis, we provide meaningful
predictions to users thereby streamlining the annotation process. Additionally,
we also evaluate our approach through a prototypical implementation to show
that our ML-based extraction approach provides superior performance over other
recently used extraction models for legal documents.

本文介绍了一种针对隐私政策注释的 “人在回路”（Human-in-the-Loop）原型系统，该系统集成了机器学习生成的建议和最终的人为注释决策，提供了一种特定于数据稀缺性的基于机器学习的建议系统，其提供了有意义的预测，优于其他近期用于法律文件的提取模型的性能。