In this paper, we design a real-time question-answering system specifically
targeted for helping sellers get relevant material/documentation they can share
live with their customers or refer to during a call. Taking the Seismic content
repository as a relatively large scale example of a diverse dataset of sales
material, we demonstrate how LLM embeddings of sellers' queries can be matched
with the relevant content. We achieve this by engineering prompts in an
elaborate fashion that makes use of the rich set of meta-features available for
documents and sellers. Using a bi-encoder with cross-encoder re-ranker
architecture, we show how the solution returns the most relevant content
recommendations in just a few seconds even for large datasets. Our recommender
system is deployed as an AML endpoint for real-time inferencing and has been
integrated into a Copilot interface that is now deployed in the production
version of the Dynamics CRM, known as MSX, used daily by Microsoft sellers.

我们设计了一个实时问答系统，专门为帮助销售人员获取他们可以与客户共享或在电话中参考的相关材料 / 文档而开发。通过以 Seismic 内容库作为多样化数据集的相对大规模示例，我们展示了如何使用销售人员的查询的 LLM 嵌入来与相关内容匹配。通过使用具有跨编码器后处理器的双编码器体系结构，我们展示了该解决方案如何在几秒钟内返回最相关的内容推荐，即使对于大型数据集也是如此。我们的推荐系统作为一个 AML 端点用于实时推理，并已集成到称为 MSX 的 Dynamics CRM 的生产版本中，该版本每天被微软销售人员使用。

MSX Sales Copilot 中生成式 AI 的案例研究：使用实时问答系统提高销售员工生产力的内容推荐

A case study of Generative AI in MSX Sales Copilot: Improving seller  productivity with a real-time question-answering system for content  recommendation