HF Daily Papers
· Papers
OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models
Omni-modal large language models (Omni-LLMs) have achieved remarkable performance on audio-visual understanding tasks, but processing long and highly redundant visual and audio token sequences incurs substantial computational overhead, demanding aggressive token compression for efficient deployment.