Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 11d ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
text-generation
safetensors llama facebook
1110K
Updated 11d ago
Details Files
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
text-generation
safetensors llama facebook
18.5K
Updated 1y ago
Details Files
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
text-generation transformers
safetensors llama facebook
034
Updated 1y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama awq
229
Updated 1y ago
Details Files
avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16
text-generation transformers
facebook meta pytorch
026
Updated 11mo ago
Details Files
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama gptq
216
Updated 1y ago
Details Files
OpenNMT/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
011
Updated 2y ago
Details Files
OpenNMT/Llama-2-7b-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
07
Updated 2y ago
Details Files
michaelfeil/ct2fast-Llama-2-7b-chat-hf
text-generation transformers
llama ctranslate2 int8
46
Updated 2y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-AWQ
text-generation transformers
safetensors llama awq
16
Updated 1y ago
Details Files
avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16
text-generation transformers
safetensors facebook meta
06
Updated 1y ago
Details Files
FriendliAI/Meta-Llama-3-8B-int8
text-generation transformers
safetensors llama facebook
16
Updated 1y ago
Details Files
michaelfeil/ct2fast-Llama-2-13b-hf
text-generation transformers
llama ctranslate2 int8
15
Updated 2y ago
Details Files
Weblet/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
pytorch llama ctranslate2
05
Updated 1y ago
Details Files
avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16
text-generation
facebook meta pytorch
05
Updated 11mo ago
Details Files
michaelfeil/ct2fast-Llama-2-7b-hf
text-generation transformers
llama ctranslate2 int8
34
Updated 2y ago
Details Files
michaelfeil/ct2fast-Llama-2-13b-chat-hf
text-generation transformers
llama ctranslate2 int8
44
Updated 2y ago
Details Files
Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2
text-generation CTranslate2
facebook meta llama
04
Updated 6mo ago
Details Files