Skip to content

@FastLM FastLM

All

    Repositories list

    13 repositories

    • KVLearn

      Public
      [PPoPP 2027, SYSTOR 2026] Learning KV Cache Retention and Minimize Memory Workload in Disaggregated LLM Serving Systems
      C++
      •1•9•0•0•Updated Nov 1, 2026Nov 1, 2026

    • tinyserve-vllm

      Public
      [ACM MM 2025 Oral] TinyServe: Query-Aware Page Allocation Optimization
      Python
      •2•11•0•0•Updated Oct 26, 2026Oct 26, 2026

    • ForkServe

      Public
      ForkServe: Prefilling and Decoding Prunning Disaggregation for Efficient Agentic LLM Serving.
      Python
      •
      Apache License 2.0
      •0•1•0•0•Updated Oct 13, 2026Oct 13, 2026

    • vllm_fs

      Public
      Storage-Efficient vLLM serving with ForkServe
      Python
      •
      Apache License 2.0
      •25k•1•0•0•Updated Sep 17, 2026Sep 17, 2026

    • CongShed

      Public
      [HPEC 2026] Breaking the Interconnect Bottleneck in LLM Serving via Congestion-Aware Scheduling over Heterogeneous Interconnects
      C++
      •0•3•0•0•Updated Aug 25, 2026Aug 25, 2026

    • SPI_VecDB

      Public
      [VecDB @ VLDB 2026] SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
      Go
      •
      Apache License 2.0
      •0•10•1•0•Updated Aug 17, 2026Aug 17, 2026

    • CXL-SpecKV

      Public
      [FPGA'26 Best Paper Nomination] CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Serving
      C++
      •11•45•0•0•Updated Aug 7, 2026Aug 7, 2026

    • OLIVE

      Public
      [UbiComp 2026] OLIVE: Online Low-Rank Incremental Learning for Efficient Adaptive Exoskeletons
      roboticsrl
      roboticsrl
      C++
      •1•2•0•0•Updated Aug 7, 2026Aug 7, 2026

    • CSV-Decode

      Public
      CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
      Python
      •0•13•0•0•Updated Aug 1, 2026Aug 1, 2026

    • SemToken

      Public
      [*SEM 2026 Oral] SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Models
      Python
      •0•5•0•0•Updated Jul 7, 2026Jul 7, 2026

    • MKA

      Public
      [ACM CF'26 Oral] MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning
      Python
      •1•8•0•0•Updated Jun 29, 2026Jun 29, 2026

    • Thoughts-as-Planning

      Public
      Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning
      planningrlcot
      planningrlcot
      C++
      •0•3•0•0•Updated Jun 1, 2026Jun 1, 2026

    • HSGM

      Public
      [ICPADS 2025 Oral, *SEM 2025 Oral] HSGM: Hierarchical Segment-Graph Memory for Scalable Long-Text Semantics
      Python
      •
      MIT License
      •0•8•0•0•Updated Nov 23, 2025Nov 23, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.