Popular repositories Loading
-
-
llm-awq
llm-awq PublicForked from mit-han-lab/llm-awq
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Python 1
-
neural-compressor
neural-compressor PublicForked from intel/neural-compressor
Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, spar…
Python
-
qlora
qlora PublicForked from artidoro/qlora
QLoRA: Efficient Finetuning of Quantized LLMs
Jupyter Notebook
-
peft
peft PublicForked from huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Python
-
OmniQuant
OmniQuant PublicForked from OpenGVLab/OmniQuant
OmniQuant is a simple and powerful quantization technique for LLMs.
Python
Repositories
- litellm Public Forked from BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- compressa-deploy Public
- compressa-perf Public
- free-cluely Public Forked from Prat011/free-cluely
Cluely - The invisible desktop assistant that provides real-time insights, answers, and support during meetings, interviews, presentations, and professional conversations.
- vllm-qwen3.5 Public
- compressa-ai.github.io Public
- pluely Public Forked from iamsrikanthnani/pluely
The Open Source Alternative to Cluely - A lightning-fast, privacy-first AI assistant that works seamlessly during meetings, interviews, and conversations without anyone knowing. Built with Tauri for native performance, just 10MB. Completely undetectable in video calls, screen shares, and recordings.
- compressa-unstructured-api Public Forked from Unstructured-IO/unstructured-api
unstructured-api fork with GPU inference support
- compressa-guidance Public Forked from guidance-ai/guidance
A guidance language for controlling large language models. (Qwen compatible)
Top languages
Loading…
Most used topics
Loading…