Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
2118K
Updated 7mo ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
text-generation
safetensors llama facebook
1110K
Updated 11d ago
Details Files
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
text-generation
safetensors llama facebook
18.5K
Updated 1y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
23.3K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
text-generation transformers
safetensors llama int8
102.2K
Updated 10mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
text-generation transformers
safetensors llama int8
41.5K
Updated 10mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
text-generation
safetensors llama int8
170
Updated 9mo ago
Details Files
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
text-generation transformers
safetensors llama facebook
034
Updated 1y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama awq
229
Updated 1y ago
Details Files
avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16
text-generation transformers
facebook meta pytorch
026
Updated 11mo ago
Details Files
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
118
Updated 11mo ago
Details Files
DESUCLUB/Llama-3.1-8B-Instruct-bf16-quantized.w8a8
text-generation transformers
safetensors llama quantization
017
Updated 3mo ago
Details Files
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama gptq
216
Updated 1y ago
Details Files
DESUCLUB/Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama quantization
014
Updated 3mo ago
Details Files
michaelfeil/ct2fast-open-llama-13b-open-instruct
text-generation transformers
llama ctranslate2 int8
011
Updated 2y ago
Details Files
OpenNMT/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
011
Updated 2y ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
text-generation
safetensors llama int8
19
Updated 11mo ago
Details Files