Each year, thousands of people learn new visual categorization tasks --
radiologists learn to recognize tumors, birdwatchers learn to distinguish
similar species, and crowd workers learn how to annotate valuable data for
applications like autonomous driving. As humans learn, their brain updates the
visual features it extracts and attend to, which ultimately informs their final
classification decisions. In this work, we propose a novel task of tracing the
evolving classification behavior of human learners as they engage in
challenging visual classification tasks. We propose models that jointly extract
the visual features used by learners as well as predicting the classification
functions they utilize. We collect three challenging new datasets from real
human learners in order to evaluate the performance of different visual
knowledge tracing methods. Our results show that our recurrent models are able
to predict the classification behavior of human learners on three challenging
medical image and species identification tasks.

本文提出了一项新颖的任务，即追踪人类学习者在进行挑战性的视觉分类任务时不断演变的分类行为，提出了一种新的视觉知识追踪模型，并收集三个挑战性的新数据集，从而评估不同的视觉知识追踪方法的性能，结果表明我们的循环模型能够预测人类学习者在三个挑战性的医学图像和物种识别任务中的分类行为。

视觉知识追踪

Visual Knowledge Tracing

Expanding visual categorization into a novel domain without the need of extra
annotation has been a long-term interest for multimedia intelligence.
Previously, this challenge has been approached by unsupervised domain
adaptation (UDA). Given labeled data from a source domain and unlabeled data
from a target domain, UDA seeks for a deep representation that is both
discriminative and domain-invariant. While UDA focuses on the target domain, we
argue that the performance on both source and target domains matters, as in
practice which domain a test example comes from is unknown. In this paper we
extend UDA by proposing a new task called unsupervised domain expansion (UDE),
which aims to adapt a deep model for the target domain with its unlabeled data,
meanwhile maintaining the model's performance on the source domain. We propose
Knowledge Distillation Domain Expansion (KDDE) as a general method for the UDE
task. Its domain-adaptation module can be instantiated with any existing model.
We develop a knowledge distillation based learning mechanism, enabling KDDE to
optimize a single objective wherein the source and target domains are equally
treated. Extensive experiments on two major benchmarks, i.e., Office-Home and
DomainNet, show that KDDE compares favorably against four competitive
baselines, i.e., DDC, DANN, DAAN, and CDAN, for both UDA and UDE tasks. Our
study also reveals that the current UDA models improve their performance on the
target domain at the cost of noticeable performance loss on the source domain.

本文提出一种新的任务，称为无监督域扩展（UDE），在此任务中，我们扩展了无监督域自适应（UDA）方法，并引入知识蒸馏域扩展（KDDE）作为 UDE 任务的一般方法。我们的研究表明，KDDE 比四个竞争基线更优秀，同时在源域和目标域上保持高性能。

视觉分类的无监督域扩展

Unsupervised Domain Expansion for Visual Categorization

The ability to categorize is a cornerstone of visual intelligence, and a key
functionality for artificial, autonomous visual machines. This problem will
never be solved without algorithms able to adapt and generalize across visual
domains. Within the context of domain adaptation and generalization, this paper
focuses on the predictive domain adaptation scenario, namely the case where no
target data are available and the system has to learn to generalize from
annotated source images plus unlabeled samples with associated metadata from
auxiliary domains. Our contributionis the first deep architecture that tackles
predictive domainadaptation, able to leverage over the information broughtby
the auxiliary domains through a graph. Moreover, we present a simple yet
effective strategy that allows us to take advantage of the incoming target data
at test time, in a continuous domain adaptation scenario. Experiments on three
benchmark databases support the value of our approach.

本文研究领域适应和泛化中的预测领域适应的问题，提出了一种能够通过图形利用辅助域中信息的深度学习架构，同时提出了一种简单有效的策略，能够在测试时利用流入的目标数据进行连续的领域适应，并在三个基准数据库上进行了实验证明了我们方法的价值。