Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama facebook
3057K
Updated 10d ago
Details Files
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
3915K
Updated 6mo ago
Details Files
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
text-generation transformers
safetensors llama nm-vllm
16K
Updated 2y ago
Details Files
ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g
image-text-to-text vllm
safetensors mistral3 int4
174.3K
Updated 5mo ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama int4
324.1K
Updated 7mo ago
Details Files
ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
64K
Updated 5mo ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16
text-generation
safetensors llama facebook
32.9K
Updated 4h ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
52.8K
Updated 6mo ago
Details Files
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
62.3K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
01.9K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
41.5K
Updated 6mo ago
Details Files
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
text-generation
safetensors llama gptqmodel
51.5K
Updated 10mo ago
Details Files
RedHatAI/whisper-small-quantized.w4a16
automatic-speech-recognition transformers
safetensors whisper w4a16
11.5K
Updated 4mo ago
Details Files
RedHatAI/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
image-to-text transformers
safetensors mllama w4a16
01.5K
Updated 7mo ago
Details Files
inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ
text-generation
safetensors qwen2 code
101.4K
Updated 7mo ago
Details Files
RedHatAI/whisper-large-v3-turbo-quantized.w4a16
automatic-speech-recognition
safetensors whisper w4a16
31.3K
Updated 4h ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
text-generation
safetensors granite w4a16
11.3K
Updated 10d ago
Details Files
ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2
text-generation
safetensors qwen2 gptqmodel
71.3K
Updated 7mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
text-generation
safetensors qwen2 qwen
01.3K
Updated 10d ago
Details Files
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1
text-generation
safetensors llama gptqmodel
21.3K
Updated 10mo ago
Details Files