FastLM

Popular repositories Loading

1. CXL-SpecKV CXL-SpecKV Public

   [FPGA'26 Best Paper Nomination] CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Serving

   C++ 45 11

2. CSV-Decode CSV-Decode Public

   CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference

   Python 13

3. tinyserve-vllm tinyserve-vllm Public

   [ACM MM 2025 Oral] TinyServe: Query-Aware Page Allocation Optimization

   Python 11 2

4. SPI_VecDB SPI_VecDB Public

   [VecDB @ VLDB 2026] SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases

   Go 10

5. KVLearn KVLearn Public

   [PPoPP 2027, SYSTOR 2026] Learning KV Cache Retention and Minimize Memory Workload in Disaggregated LLM Serving Systems

   C++ 9 1

6. HSGM HSGM Public

   [ICPADS 2025 Oral, *SEM 2025 Oral] HSGM: Hierarchical Segment-Graph Memory for Scalable Long-Text Semantics

   Python 8