BriefGPT.xyz
Nov, 2024
微调小型嵌入以提升性能
Fine-Tuning Small Embeddings for Elevated Performance
HTML
PDF
Biraj Silwal
TL;DR
本研究解决了小资源语言（如尼泊尔语）在自然语言处理任务中由于数据和计算能力限制而面临的挑战。通过对一个不完整的BERT模型进行微调，研究展示了即使在原始基线较差的情况下，小型嵌入的微调也能显著提高性能，与完整BERT模型相比取得了令人瞩目的进展。
Abstract
Contextual
Embeddings
have yielded state-of-the-art results in various
Natural Language Processing
tasks. However, these
Embeddings
are co
→