Skip to content
This repository was archived by the owner on Sep 21, 2026. It is now read-only.

Guide for Developer

Jump to bottom
Changqing Li edited this page Jun 15, 2024 · 7 revisions

Guide for Developer

GPU Part

  1. Enable pipeline parallel: https://github.com/intel/xFasterTransformer/pull/221
  2. Build w/ ICX: https://github.com/intel/xFasterTransformer/pull/228
  3. How to use GPU: https://github.com/intel/xFasterTransformer/pull/231
  4. Add GPU kernels and enable LLaMA model: https://github.com/intel/xFasterTransformer/pull/372
  5. Enable continuous batching on single GPU: https://github.com/intel/xFasterTransformer/pull/452

Clone this wiki locally