Table Structure Recognition (TSR) aims at transforming unstructured table images into structured formats, such as HTML sequences. One type of popular solution is using detection models to detect components of a table, such as columns and rows, then applying a rule-based post-processing method to convert detection results into HTML sequences. However, existing detection-based studies often have the following limitations. First, these studies usually pay more attention to improving the detection performance, which does not necessarily lead to better performance regarding cell-level metrics, such as TEDS. Second, some solutions over-simplify the problem and can miss some critical information. Lastly, even though some studies defined the problem to detect more components to provide as much information as other types of solutions, these studies ignore the fact this problem definition is a multi-label detection because row, projected row header and column header can share identical bounding boxes. Besides, there is often a performance gap between two-stage and transformer-based detection models regarding the structure-only TEDS, even though they have similar performance regarding the COCO metrics. Therefore, we revisit the limitations of existing detection-based solutions, compare two-stage and transformer-based detection models, and identify the key design aspects for the success of a two-stage detection model for the TSR task, including the multi-class problem definition, the aspect ratio for anchor box generation, and the feature generation of the backbone network. We applied simple methods to improve these aspects of the Cascade R-CNN model, achieved state-of-the-art performance, and improved the baseline Cascade R-CNN model by 19.32%, 11.56% and 14.77% regarding the structure-only TEDS on SciTSR, FinTabNet, and PubTables1M datasets.

将无结构的表格图像转换为HTML序列的表结构识别（TSR）任务经常遇到这样的挑战，并发现现有的基于检测的解决方案存在一些限制，因此比较了两阶段和基于Transformer的检测模型，明确了成功的两阶段检测模型的关键设计方面，包括多类问题定义、锚框生成的纵横比和骨干网络的特征生成。通过改进Cascade R-CNN模型的这些方面，并应用简单的方法，实现了在SciTSR、FinTabNet和PubTables1M数据集上针对结构TEDS的最新性能提升，分别达到19.32%、11.56%和14.77%。

对视觉丰富文档的基于检测的表格结构识别进行再思考