Skip to content
View lifeiteng's full-sized avatar

Block or report lifeiteng

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
lifeiteng/README.md

👋 Hi, I'm Feiteng

Python C++ PyTorch Multimodal AI Full-Duplex Speech Efficient Inference

I'm an AI researcher and engineer working on multimodal generation, full-duplex speech interaction, and efficient inference. With a background in computational mathematics, I have over a decade of experience taking AI systems from model design and training to optimized runtimes and production applications.

My work spans speech, image, and video generation. I've led the development of end-to-end Speech LLMs with streaming dialogue, real-time interruption, multi-turn context, and zero-shot voice cloning. For full-duplex interaction, I worked on jointly modeling listening and speaking over time, allowing the model to learn when to speak, pause, and take a turn. My speech work also covers recognition, assessment, and synthesis, including large-scale TTS systems and implementations of WaveNet, Tacotron, WaveRNN, Parallel Tacotron2, VALL-E and Moshi.

In image and video generation, I've worked on virtual try-on and conditional image editing with Flux Kontext. My video work includes WanVideo and HunyuanVideo fine-tuning, DiT and flow matching, and conditioning methods for clothing consistency and controllable motion. These projects involved data preparation, model training, and inference optimization for practical content-generation workflows.

I work across the training and inference stack: PyTorch, Megatron-Core, and FSDP for distributed training; CUDA, cuBLAS, AVX, vLLM, and quantization for efficient execution. I also build audio capabilities for AI agents, including understanding, generation, and context integration. I care about the details that make models useful in practice: output quality, memory use, latency, and reliable deployment.

I share research notes and engineering lessons on X and my blog. I'm happy to connect with people working on multimodal generation, real-time voice interaction, and efficient AI systems.

Selected projects

Project Focus
VALL-E Unofficial zero-shot TTS implementation, training code, and reproduced audio demos
OmniSenseVoice Efficient ASR and word timestamps, built on SenseVoice
OmniVAD-Kit Cross-platform VAD and audio event detection · Python, TypeScript, C API, WebAssembly

Find me

X

Pinned Loading

  1. vall-e vall-e Public

    PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html

    Python 2.2k 325

  2. OmniSenseVoice OmniSenseVoice Public

    Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯

    Python 896 38

  3. OmniVAD-Kit OmniVAD-Kit Public

    Cross-platform VAD & Audio Event Detection toolkit — Python (PyPI) + TypeScript (npm) + C API. DFSMN models ~2MB, 200x real-time. Runs everywhere: native, browser (WASM), Node.js.

    C++ 105 6