Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 12d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 12d ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
2118K
Updated 7mo ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
text-generation
safetensors llama facebook
119.3K
Updated 12d ago
Details Files
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
text-generation
safetensors llama facebook
18.5K
Updated 1y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
22.7K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
text-generation transformers
safetensors llama int8
102.2K
Updated 10mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
text-generation transformers
safetensors llama int8
41.5K
Updated 10mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8
text-generation
safetensors llama int8
166
Updated 9mo ago
Details Files
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
text-generation transformers
safetensors llama facebook
032
Updated 1y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama awq
230
Updated 1y ago
Details Files
avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16
text-generation transformers
facebook meta pytorch
027
Updated 11mo ago
Details Files
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama gptq
217
Updated 1y ago
Details Files
DESUCLUB/Llama-3.1-8B-Instruct-bf16-quantized.w8a8
text-generation transformers
safetensors llama quantization
017
Updated 3mo ago
Details Files
DESUCLUB/Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama quantization
015
Updated 3mo ago
Details Files
OpenNMT/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
012
Updated 2y ago
Details Files
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
112
Updated 11mo ago
Details Files
michaelfeil/ct2fast-open-llama-13b-open-instruct
text-generation transformers
llama ctranslate2 int8
011
Updated 2y ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
text-generation
safetensors llama int8
111
Updated 11mo ago
Details Files