We present the Assignment-Maximization Spectral Attribute removaL (AMSAL)
algorithm, which aims at removing information from neural representations when
the information to be erased is implicit rather than directly being aligned to
each input example. Our algorithm works by alternating between two steps. In
one, it finds an assignment of the input representations to the information to
be erased, and in the other, it creates projections of both the input
representations and the information to be erased into a joint latent space. We
test our algorithm on an extensive array of datasets, including a Twitter
dataset with multiple guarded attributes, the BiasBios dataset and the
BiasBench benchmark. The latter benchmark includes four datasets with various
types of protected attributes. Our results demonstrate that bias can often be
removed in our setup. We also discuss the limitations of our approach when
there is a strong entanglement between the main task and the information to be
erased.

本文介绍了 AMSAL 算法和它在多个数据集上的测试，其中包括一个 Twitter 数据集和带有各种类型的保护属性的 BiasBench 基准测试。该算法旨在在信息需要被删除，但不是直接与输入示例对齐的情况下，从神经表示中删除信息。