Hugging Face Models

Showing 20 models

RedHatAI/whisper-large-v3-turbo-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
227K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
216K
Updated 4mo ago
Details Files
RedHatAI/gemma-3-1b-it-quantized.w8a8
text-generation transformers
safetensors gemma3_text vllm
03.7K
Updated 3mo ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
53.7K
Updated 5mo ago
Details Files
RedHatAI/gemma-3-27b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
73.2K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-12b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
33.1K
Updated 3mo ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
text-generation
safetensors granite w8a8
22.7K
Updated 10d ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
01.6K
Updated 4mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
text-generation
safetensors qwen2 qwen
21.5K
Updated 11d ago
Details Files
ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W8A8
text-generation transformers
safetensors qwen3_moe quantized
2341
Updated 1mo ago
Details Files
ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W8A8
text-generation transformers
safetensors qwen3_moe quantized
1291
Updated 1mo ago
Details Files
RedHatAI/gemma-3-4b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
0269
Updated 3mo ago
Details Files
ramblingpolymath/Qwen3-30B-A3B-thinking-2507-W8A8
text-generation transformers
safetensors qwen3_moe quantized
3189
Updated 1mo ago
Details Files
RedHatAI/whisper-large-v3-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
1184
Updated 5mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w8a8
image-to-text transformers
safetensors llava vllm
187
Updated 6mo ago
Details Files
ramblingpolymath/Qwen3-32B-W8A8
text-generation transformers
safetensors qwen3 quantized
053
Updated 1mo ago
Details Files
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_vl vllm
042
Updated 4mo ago
Details Files