Skip to content

@xlite-dev xlite-dev

Change the repository type filter

All

    Repositories list

    74 repositories

    • ffpa-attn

      Public
      Fast and Memory-Efficient Exact Attention (BF16/FP16/FP8/FP4) for Large Headdim, 1.5x~15x speedup over PyTorch SDPA.
      fp8flash-attentionfp4
      fp8flash-attentionfp4
      Python
      •
      Apache License 2.0
      •25•322•5•0•Updated Aug 21, 2026Aug 21, 2026

    • LeetCUDA

      Public
      Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.
      cudacuda-kernelscuda-demo
      cudacuda-kernelscuda-democuda-toolkitcuda-librarycuda-kernellearn-cudacuda-cpphgemmflash-attention
      Cuda
      •
      GNU General Public License v3.0
      •1.2k•12k•3•1•Updated Aug 17, 2026Aug 17, 2026

    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •8.1k•3•0•0•Updated Aug 17, 2026Aug 17, 2026

    • Awesome-LLM-Inference

      Public
      📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
      mlavllmllm-inference
      mlavllmllm-inferenceawesome-llmflash-attentiontensorrt-llmpaged-attentiondeepseekflash-attention-3deepseek-v3
      Python
      •
      GNU General Public License v3.0
      •429•5.5k•1•5•Updated Aug 14, 2026Aug 14, 2026

    • diffusers

      Public
      🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
      Python
      •
      Apache License 2.0
      •7.3k•0•0•0•Updated Aug 5, 2026Aug 5, 2026

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Python
      •
      Apache License 2.0
      •1.3k•0•0•0•Updated Aug 5, 2026Aug 5, 2026

    • quack

      Public
      A Quirky Assortment of CuTe Kernels
      Python
      •
      Apache License 2.0
      •147•1•0•0•Updated Aug 5, 2026Aug 5, 2026

    • cutlass

      Public
      CUDA Templates and Python DSLs for High-Performance Linear Algebra
      C++
      •
      Other
      •2k•1•0•0•Updated Aug 5, 2026Aug 5, 2026

    • CuTe

      Public
      Reference implementation and examples of the CuTe Layout representation and algebra.
      Python
      •
      Apache License 2.0
      •28•0•0•0•Updated Jul 28, 2026Jul 28, 2026

    • .github

      Public
      0•1•0•0•Updated Jul 22, 2026Jul 22, 2026

    • cudnn-frontend

      Public
      cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
      Python
      •
      MIT License
      •254•0•0•0•Updated Jul 14, 2026Jul 14, 2026

    • TurboDiffusion

      Public
      TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
      Python
      •
      Apache License 2.0
      •276•0•0•0•Updated Jul 14, 2026Jul 14, 2026

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •3k•0•0•0•Updated Jul 13, 2026Jul 13, 2026

    • modern-gpu-programming-for-mlsys

      Public
      modern gpu programming
      HTML
      •125•2•0•0•Updated Jun 28, 2026Jun 28, 2026

    • vllm-omni

      Public
      A framework for efficient model inference with omni-modality models
      Python
      •
      Apache License 2.0
      •1.5k•0•0•0•Updated Jun 26, 2026Jun 26, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •21k•0•0•0•Updated Jun 26, 2026Jun 26, 2026

    • DeepGEMM

      Public
      DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
      Cuda
      •
      MIT License
      •1.2k•0•0•0•Updated Jun 25, 2026Jun 25, 2026

    • deepseek-v4-for-copilot

      Public
      Pick DeepSeek V4 from the Copilot Chat model picker — and keep everything else Copilot already gives you.
      TypeScript
      •
      MIT License
      •131•0•0•0•Updated Jun 20, 2026Jun 20, 2026

    • GCMP

      Public
      通过集成国内主流原生大模型提供商，为开发者提供更加丰富、更适合本土需求的 AI 编程助手选择。 目前已内置支持 智谱AI、MiniMax、MoonshotAI、DeepSeek、阿里云百炼、快手万擎、火山方舟、腾讯云、Xiaomi MiMo 等原生大模型提供商。 此外，扩展插件已适配支持 OpenAI 与 Anthro…
      TypeScript
      •
      MIT License
      •57•0•0•0•Updated Jun 16, 2026Jun 16, 2026

    • DeepEP

      Public
      DeepEP: an efficient expert-parallel communication library
      Cuda
      •
      MIT License
      •1.4k•0•0•0•Updated Jun 15, 2026Jun 15, 2026

    • Awesome-DiT-Inference

      Public
      📚A curated list of Awesome Diffusion Inference Papers with Codes: Sampling, Cache, Quantization, Parallelism, etc.🎉
      fluxwandiffusion
      fluxwandiffusionditsorastable-diffusionsdxlsd15deepcacheopen-sora-plan
      Python
      •
      GNU General Public License v3.0
      •28•583•1•1•Updated Jun 13, 2026Jun 13, 2026

    • cache-dit

      Public
      A PyTorch-native inference engine with cache, parallelism, quantization for Diffusion Transformers.
      Python
      •
      Apache License 2.0
      •77•4•0•0•Updated Jun 13, 2026Jun 13, 2026

    • cllms-for-copilot

      Public
      Pick Qwen, GLM, MiniMax, Xiaomi MiMo, Moonshot Kimi & Tencent Hunyuan models from the Copilot Chat model picker. Vision, thinking, BYOK.
      TypeScript
      •
      MIT License
      •2•1•0•0•Updated Jun 13, 2026Jun 13, 2026

    • svdquant-kernels

      Public
      Cross-architecture CUDA kernels for SVDQuant (W4A4 with low-rank correction)
      Python
      •
      Apache License 2.0
      •4•2•0•0•Updated May 28, 2026May 28, 2026

    • FlashMLA

      Public
      FlashMLA: Efficient Multi-head Latent Attention Kernels
      C++
      •
      MIT License
      •1.1k•1•0•0•Updated Apr 30, 2026Apr 30, 2026

    • TileKernels

      Public
      A kernel library written in tilelang
      Python
      •
      MIT License
      •159•0•0•0•Updated Apr 23, 2026Apr 23, 2026

    • TensorRT-LLM

      Public
      TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inferen…
      Python
      •
      Other
      •2.7k•1•0•0•Updated Apr 1, 2026Apr 1, 2026

    • nunchaku

      Public
      [ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
      Python
      •
      Apache License 2.0
      •276•2•0•0•Updated Mar 31, 2026Mar 31, 2026

    • lite.ai.toolkit

      Public
      A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
      tensorrtmnnncnn
      tensorrtmnnncnnonnxonnxruntimeyolov5tnnmnn-modelyoloxrobustvideomatting
      C++
      •
      GNU General Public License v3.0
      •783•4.4k•0•1•Updated Mar 19, 2026Mar 19, 2026

    • Triton-distributed

      Public
      Distributed Compiler based on Triton for Parallel Systems
      Python
      •
      MIT License
      •165•0•0•0•Updated Mar 11, 2026Mar 11, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.