Popular repositories Loading

1. vllm-fp8kv vllm-fp8kv Public

   fp8 KV-cache support for vLLM's Ampere DSA path (TRITON_MLA_SPARSE) — continues nickus/dsa-3090

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. vllm-sm120 vllm-sm120 Public

   vLLM overlay patches: native NVFP4 MoE kernels on consumer Blackwell SM120 (RTX 5090)

   Python

4. k3-ampere k3-ampere Public

   Python

5. callscribe callscribe Public

   Forked from viusiumbeli/callscribe

   Swift

6. unreal-agent unreal-agent Public

   Forked from unreallabsai/unreal-agent

   Async-first agent harness

   Go