Neural operators have proven to be a promising approach for modeling spatiotemporal systems in the physical sciences. However, training these models for large systems can be quite challenging as they incur significant computational and memory expense -- these systems are often forced to rely on autoregressive time-stepping of the neural network to predict future temporal states. While this is effective in managing costs, it can lead to uncontrolled error growth over time and eventual instability. We analyze the sources of this autoregressive error growth using prototypical neural operator models for physical systems and explore ways to mitigate it. We introduce architectural and application-specific improvements that allow for careful control of instability-inducing operations within these models without inflating the compute/memory expense. We present results on several scientific systems that include Navier-Stokes fluid flow, rotating shallow water, and a high-resolution global weather forecasting system. We demonstrate that applying our design principles to prototypical neural networks leads to significantly lower errors in long-range forecasts with 800\% longer forecasts without qualitative signs of divergence compared to the original models for these systems. We open-source our \href{https://anonymous.4open.science/r/stabilizing_neural_operators-5774/}{code} for reproducibility.

该研究分析了神经操作符模型中自回归误差增长的来源，并探索了减轻其影响的方法，其原理在于引入架构和应用特定的改进，以在不增加计算和内存负担的情况下对这些模型中导致不稳定性的操作进行仔细控制，实验表明采用研究团队的设计原则来构建典型的神经网络模型可以显著降低长期预测的错误率，同时能够在预测时增加8倍的时间跨度而不出现发散的迹象。

自回归神经算子稳定性探究