Hugging Face Models

Showing 13 models

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
text-generation
safetensors granite w8a8
22.7K
Updated 9d ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
text-generation
safetensors qwen2 qwen
21.5K
Updated 10d ago
Details Files
NeoChen1024/Ministral-8B-Instruct-2410-W8A8
vllm
safetensors mistral int8
214
Updated 8mo ago
Details Files
klusai/tf2-12b-w8a8
text-generation transformers
safetensors gemma3 image-text-to-text
09
Updated 17d ago
Details Files
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8
text-generation transformers
safetensors llama nvidia
06
Updated 8mo ago
Details Files
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8
text-generation
safetensors llama int8
04
Updated 1y ago
Details Files
NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8
safetensors llama int8
04
Updated 5mo ago
Details Files
RedHatAI/QwQ-32B-Preview-quantized.w8a8
text-generation transformers
safetensors qwen2 w8a8
03
Updated 8mo ago
Details Files
NeoChen1024/dolphin-2.9.3-mistral-7B-32k-W8A8
safetensors mistral generated_from_trainer
03
Updated 8mo ago
Details Files
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
image-text-to-text vllm
safetensors llava w8a8
03
Updated 5mo ago
Details Files