Hugging Face Models

Showing 20 models

RedHatAI/whisper-large-v3-turbo-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
227K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
216K
Updated 4mo ago
Details Files
RedHatAI/gemma-3-1b-it-quantized.w8a8
text-generation transformers
safetensors gemma3_text vllm
03.7K
Updated 3mo ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
53.7K
Updated 5mo ago
Details Files
RedHatAI/gemma-3-27b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
73.2K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-12b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
33.1K
Updated 3mo ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
text-generation
safetensors granite w8a8
22.7K
Updated 10d ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
01.6K
Updated 4mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
text-generation
safetensors qwen2 qwen
21.5K
Updated 11d ago
Details Files
RedHatAI/gemma-3-4b-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3 vllm
0269
Updated 3mo ago
Details Files
RedHatAI/whisper-large-v3-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
1184
Updated 5mo ago
Details Files
RedHatAI/pixtral-12b-quantized.w8a8
image-to-text transformers
safetensors llava vllm
187
Updated 6mo ago
Details Files
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_vl vllm
042
Updated 4mo ago
Details Files
parasail-ai/Qwen2.5-VL-72B-Instruct-quantized.w8a8
image-to-text transformers
safetensors qwen2_5_vl vllm
014
Updated 5mo ago
Details Files
NeoChen1024/Ministral-8B-Instruct-2410-W8A8
vllm
safetensors mistral int8
29
Updated 8mo ago
Details Files
RedHatAI/whisper-tiny-quantized.w8a8
automatic-speech-recognition transformers
safetensors whisper w8a8
09
Updated 5mo ago
Details Files
klusai/tf2-12b-w8a8
text-generation transformers
safetensors gemma3 image-text-to-text
09
Updated 17d ago
Details Files