Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
2118K
Updated 7mo ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
text-generation
safetensors llama facebook
1110K
Updated 11d ago
Details Files
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
text-generation
safetensors llama facebook
18.5K
Updated 1y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
23.3K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
text-generation
safetensors granite w8a8
22.7K
Updated 10d ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
132.7K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
text-generation transformers
safetensors llama int8
102.2K
Updated 10mo ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8
text-generation
safetensors qwen2 qwen
21.5K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
text-generation transformers
safetensors llama int8
41.5K
Updated 10mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
11.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
41.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/gemma-2-9b-it-quantized.w8a16
text-generation
safetensors gemma2 int8
11.1K
Updated 11mo ago
Details Files
RedHatAI/gemma-3n-E4B-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3n vllm
0556
Updated 1mo ago
Details Files