Hugging Face Models

Showing 20 models

RedHatAI/whisper-large-v3-turbo-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
227K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
215K
Updated 4mo ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
53.7K
Updated 5mo ago
Details Files
RedHatAI/gemma-3-1b-it-quantized.w8a8
text-generation transformers
safetensors gemma3_text vllm
03.6K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-12b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
33.1K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-27b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
73.1K
Updated 3mo ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
text-generation
safetensors granite w8a8
22.7K
Updated 11d ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.2K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
01.6K
Updated 4mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
text-generation
safetensors qwen2 qwen
21.6K
Updated 12d ago
Details Files
RedHatAI/gemma-3-4b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
0256
Updated 3mo ago
Details Files
RedHatAI/whisper-large-v3-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
1185
Updated 5mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w8a8
image-to-text transformers
safetensors llava vllm
179
Updated 6mo ago
Details Files
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_vl vllm
044
Updated 4mo ago
Details Files
parasail-ai/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
015
Updated 5mo ago
Details Files
RedHatAI/whisper-tiny-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
012
Updated 5mo ago
Details Files
NeoChen1024/Ministral-8B-Instruct-2410-W8A8
vllm
safetensors mistral int8
210
Updated 8mo ago
Details Files
klusai/tf2-12b-w8a8
text-generation transformers
safetensors gemma3 image-text-to-text
010
Updated 18d ago
Details Files