Aligning large language models (LLM) with human preference plays a key role in building modern generative models and can be achieved by reinforcement learning from →