Neural Architecture Search (NAS) methods have been successfully applied to
image tasks with excellent results. However, NAS methods are often complex and
tend to converge to local minima as soon as generated architectures seem to
yield good results. This paper proposes GEA, a novel approach for guided NAS.
GEA guides the evolution by exploring the search space by generating and
evaluating several architectures in each generation at initialisation stage
using a zero-proxy estimator, where only the highest-scoring architecture is
trained and kept for the next generation. Subsequently, GEA continuously
extracts knowledge about the search space without increased complexity by
generating several off-springs from an existing architecture at each
generation. More, GEA forces exploitation of the most performant architectures
by descendant generation while simultaneously driving exploration through
parent mutation and favouring younger architectures to the detriment of older
ones. Experimental results demonstrate the effectiveness of the proposed
method, and extensive ablation studies evaluate the importance of different
parameters. Results show that GEA achieves state-of-the-art results on all data
sets of NAS-Bench-101, NAS-Bench-201 and TransNAS-Bench-101 benchmarks.

该论文提出了一种名为 GEA 的新型引导神经结构搜索方法，该方法使用零代理估计器在每个代际初始化阶段生成和评估多个架构，然后从现有架构生成多个后代并同时驱动探索和剪枝，结果表明 GEA 在多个数据集上都取得了最先进的结果。