500xCompressor: Compressing Prompts into a Single Learned Token
Zongqian Li, Yixuan Su, Nigel Collier · University of Cambridge · arXiv, 6 Aug 2024
arXiv:2408.03094
soft prompt compression
frozen Llama-3-8B decoder