Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama facebook
3057K
Updated 12d ago
Details Files
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
3917K
Updated 6mo ago
Details Files
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
text-generation transformers
safetensors llama nm-vllm
15.3K
Updated 2y ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama int4
324.1K
Updated 7mo ago
Details Files
ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
63.9K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
52.7K
Updated 6mo ago
Details Files
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
62.2K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
01.8K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
41.7K
Updated 6mo ago
Details Files
RedHatAI/whisper-small-quantized.w4a16
automatic-speech-recognition transformers
safetensors whisper w4a16
11.5K
Updated 5mo ago
Details Files
RedHatAI/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
image-to-text transformers
safetensors mllama w4a16
01.4K
Updated 7mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
11.3K
Updated 6mo ago
Details Files
joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4
text-generation transformers
safetensors llama nemotron
31.2K
Updated 10mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
11.2K
Updated 6mo ago
Details Files
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit
text-generation transformers
safetensors llama gptq
41.2K
Updated 1y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
21.2K
Updated 6mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w4a16
image-to-text transformers
safetensors llava w4a16
11.2K
Updated 6mo ago
Details Files
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
text-generation transformers
safetensors mistral nm-vllm
2568
Updated 2y ago
Details Files
RedHatAI/gemma-3n-E4B-it-quantized.w4a16
image-text-to-text transformers
safetensors gemma3n vllm
0367
Updated 1mo ago
Details Files
RedHatAI/gemma-3n-E2B-it-quantized.w4a16
image-text-to-text transformers
safetensors gemma3n vllm
0239
Updated 1mo ago
Details Files