Prior work has combined chain-of-thought prompting in large language models
(LLMs) with programmatic representations to perform effective and transparent
reasoning. While such an approach works very well for tasks that only require
forward reasoning (e.g., straightforward arithmetic),