Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 12d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 12d ago
Details Files
RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
text-generation
safetensors llama facebook
119.3K
Updated 12d ago
Details Files
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8
text-generation
safetensors llama facebook
18.5K
Updated 1y ago
Details Files
FriendliAI/Meta-Llama-3.1-70B-Instruct-int8
text-generation transformers
safetensors llama facebook
032
Updated 1y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama awq
230
Updated 1y ago
Details Files
avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16
text-generation transformers
facebook meta pytorch
027
Updated 11mo ago
Details Files
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int8
text-generation transformers
safetensors llama gptq
217
Updated 1y ago
Details Files
OpenNMT/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
012
Updated 2y ago
Details Files
michaelfeil/ct2fast-Llama-2-7b-chat-hf
text-generation transformers
llama ctranslate2 int8
47
Updated 2y ago
Details Files
OpenNMT/Llama-2-7b-hf-ct2-int8
text-generation transformers
llama ctranslate2 int8
07
Updated 2y ago
Details Files
study-hjt/Meta-Llama-3-8B-Instruct-AWQ
text-generation transformers
safetensors llama awq
17
Updated 1y ago
Details Files
avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16
text-generation transformers
safetensors facebook meta
07
Updated 1y ago
Details Files
FriendliAI/Meta-Llama-3-8B-int8
text-generation transformers
safetensors llama facebook
17
Updated 1y ago
Details Files
michaelfeil/ct2fast-Llama-2-13b-hf
text-generation transformers
llama ctranslate2 int8
16
Updated 2y ago
Details Files
Weblet/Llama-2-7b-chat-hf-ct2-int8
text-generation transformers
pytorch llama ctranslate2
06
Updated 1y ago
Details Files
avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16
text-generation
facebook meta pytorch
06
Updated 11mo ago
Details Files
michaelfeil/ct2fast-Llama-2-7b-hf
text-generation transformers
llama ctranslate2 int8
35
Updated 2y ago
Details Files
michaelfeil/ct2fast-Llama-2-13b-chat-hf
text-generation transformers
llama ctranslate2 int8
45
Updated 2y ago
Details Files
Anthonyg5005/turbcat-instruct-8b-int8-ct2
text-generation CTranslate2
facebook meta llama
05
Updated 6mo ago
Details Files