Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama facebook
3057K
Updated 12d ago
Details Files
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
3917K
Updated 6mo ago
Details Files
ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g
image-text-to-text vllm
safetensors mistral3 int4
174.3K
Updated 5mo ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
text-generation transformers
safetensors llama int4
324.1K
Updated 7mo ago
Details Files
ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
63.9K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
52.7K
Updated 6mo ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16
text-generation
safetensors llama facebook
32.7K
Updated 2d ago
Details Files
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g
image-text-to-text transformers
safetensors gemma3 int4
62.2K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
01.8K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
text-generation transformers
safetensors llama deepseek
41.7K
Updated 6mo ago
Details Files
RedHatAI/whisper-small-quantized.w4a16
automatic-speech-recognition transformers
safetensors whisper w4a16
11.5K
Updated 5mo ago
Details Files
RedHatAI/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
image-to-text transformers
safetensors mllama w4a16
01.4K
Updated 7mo ago
Details Files
RedHatAI/whisper-large-v3-turbo-quantized.w4a16
automatic-speech-recognition
safetensors whisper w4a16
41.3K
Updated 2d ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
text-generation
safetensors granite w4a16
11.3K
Updated 12d ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
text-generation
safetensors qwen2 qwen
01.3K
Updated 12d ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
11.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
11.2K
Updated 6mo ago
Details Files
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
image-text-to-text vllm
safetensors llava w4a16
01.2K
Updated 5mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
text-generation transformers
safetensors qwen2 deepseek
21.2K
Updated 6mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w4a16
image-to-text transformers
safetensors llava w4a16
11.2K
Updated 6mo ago
Details Files