Existing retrieval-based methods have made significant strides in maintaining
long-term conversations. However, these approaches face challenges in memory
database management and accurate memory retrieval, hindering their efficacy in
dynamic, real-world interactions. This study introduces a novel framework,
COmpressive Memory-Enhanced Dialogue sYstems (COMEDY), which eschews
traditional retrieval modules and memory databases. Instead, COMEDY adopts a
''One-for-All'' approach, utilizing a single language model to manage memory
generation, compression, and response generation. Central to this framework is
the concept of compressive memory, which intergrates session-specific
summaries, user-bot dynamics, and past events into a concise memory format. To
support COMEDY, we curated a large-scale Chinese instruction-tuning dataset,
Dolphin, derived from real user-chatbot interactions. Comparative evaluations
demonstrate COMEDY's superiority over traditional retrieval-based methods in
producing more nuanced and human-like conversational experiences. Our codes are
available at this https URL

通过 COmpressive Memory-Enhanced Dialogue sYstems (COMEDY) 框架，利用压缩记忆的概念将实际用户 - 聊天机器人交互转化为简洁的记忆格式，该研究证明 COMEDY 比传统的基于检索的方法更能产生细致而人类化的对话体验。

压缩以惊艳：释放现实世界长期对话中压缩内存的潜能

Compress to Impress: Unleashing the Potential of Compressive Memory in  Real-World Long-Term Conversations

We propose to execute deep neural networks (DNNs) with dynamic and sparse
graph (DSG) structure for compressive memory and accelerative execution during
both training and inference. The great success of DNNs motivates the pursuing
of lightweight models for the deployment onto embedded devices. However, most
of the previous studies optimize for inference while neglect training or even
complicate it. Training is far more intractable, since (i) the neurons dominate
the memory cost rather than the weights in inference; (ii) the dynamic
activation makes previous sparse acceleration via one-off optimization on fixed
weight invalid; (iii) batch normalization (BN) is critical for maintaining
accuracy while its activation reorganization damages the sparsity. To address
these issues, DSG activates only a small amount of neurons with high
selectivity at each iteration via a dimension-reduction search (DRS) and
obtains the BN compatibility via a double-mask selection (DMS). Experiments
show significant memory saving (1.7-4.5x) and operation reduction (2.3-4.4x)
with little accuracy loss on various benchmarks.

本文提出了一种通过动态和稀疏的图结构来执行深度神经网络（DNNs）进行压缩存储和加速执行的方法，该方法在训练和推断时均可应用，以优化深度神经网络的轻量化模型。实验证明该方法可以显著提供存储和操作的性能，并在各种基准测试中几乎无损失地维护准确性。