Sparse Embedding Compression for Scalable Retrieval in Recommender Systems
-
Updated
Nov 21, 2025 - Python
Sparse Embedding Compression for Scalable Retrieval in Recommender Systems
Near-optimal vector quantization from Google's ICLR 2026 paper — 95% recall, 5x compression, zero preprocessing, pure Python FAISS replacement
Vector compression with TurboQuant codecs for embeddings, retrieval, and KV-cache. 10x compression, pure NumPy core — optional GPU acceleration via PyTorch (CUDA/MPS) or MLX (Metal).
Product Quantization (PQ) vector compression engine partitioning embeddings into discrete codebook indices
Product Quantization (PQ) vector compression engine partitioning embeddings into discrete codebook indices
Compress embeddings, retrieval vectors, and KV-cache with TurboQuant codecs for 10x smaller storage and NumPy-first AI workloads
A PyTorch Framework for Sparse Representation Learning
TurboQuant (ICLR 2026) vector quantization for memory/RAG embedding compression | 5-8x压缩 98%+召回率 | numpy only, no GPU
TensoRAG: High-performance Python engine for vector compression & fast RAG search via ML-GSVD. Reduces RAM up to 91%, speeds up search 14x. Independent, private hobby project implementing the PhD findings of Dr. L. Khamidullina (TU Ilmenau); no official affiliation with the author or university.
To associate your repository with the embedding-compression topic, visit your repo's landing page and select "manage topics."