Hugging Face Models

Showing 20 models

RedHatAI/whisper-large-v3-turbo-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
227K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
215K
Updated 4mo ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
53.7K
Updated 5mo ago
Details Files
RedHatAI/gemma-3-1b-it-quantized.w8a8
text-generation transformers
safetensors gemma3_text vllm
03.6K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-12b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
33.1K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-27b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
73.1K
Updated 3mo ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.2K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
01.6K
Updated 4mo ago
Details Files
ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W8A8
text-generation transformers
safetensors qwen3_moe quantized
2334
Updated 1mo ago
Details Files
ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W8A8
text-generation transformers
safetensors qwen3_moe quantized
1282
Updated 1mo ago
Details Files
RedHatAI/gemma-3-4b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
0256
Updated 3mo ago
Details Files
ramblingpolymath/Qwen3-30B-A3B-thinking-2507-W8A8
text-generation transformers
safetensors qwen3_moe quantized
3187
Updated 1mo ago
Details Files
RedHatAI/whisper-large-v3-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
1185
Updated 5mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w8a8
image-to-text transformers
safetensors llava vllm
179
Updated 6mo ago
Details Files
ramblingpolymath/Qwen3-32B-W8A8
text-generation transformers
safetensors qwen3 quantized
053
Updated 1mo ago
Details Files
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_vl vllm
044
Updated 4mo ago
Details Files
ramblingpolymath/qwen3-30B-A3B-w8a8
text-generation transformers
safetensors qwen3_moe quantized
025
Updated 1mo ago
Details Files
ramblingpolymath/Qwen3-4B-W8A8
text-generation transformers
safetensors qwen3 quantized
024
Updated 1mo ago
Details Files