Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama facebook
1778K
Updated 10d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama facebook
539K
Updated 10d ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
text-generation transformers
safetensors llama int8
2118K
Updated 7mo ago
Details Files
SamLowe/roberta-base-go_emotions-onnx
text-classification transformers
onnx roberta int8
246.4K
Updated 2y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
23.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
132.7K
Updated 6mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
text-generation transformers
safetensors llama int8
102.2K
Updated 10mo ago
Details Files
RedHatAI/granite-3.1-2b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02.1K
Updated 6mo ago
Details Files
RedHatAI/granite-3.1-8b-base-quantized.w8a8
text-generation transformers
safetensors granite w8a8
02K
Updated 6mo ago
Details Files
minuva/MiniLMv2-toxic-jigsaw-onnx
text-classification transformers
onnx bert toxic
21.7K
Updated 1y ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
text-generation transformers
safetensors llama int8
41.5K
Updated 10mo ago
Details Files
Intel/distilbert-base-uncased-distilled-squad-int8-static-inc
question-answering transformers
pytorch onnx distilbert
51.4K
Updated 1y ago
Details Files
Intel/t5-small-xsum-int8-dynamic-inc
transformers
pytorch t5 text2text-generation
11.4K
Updated 1y ago
Details Files
echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic
text-classification transformers
pytorch distilbert neural-compressor
11.4K
Updated 2y ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
11.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
text-generation transformers
safetensors llama deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
41.3K
Updated 6mo ago
Details Files
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
text-generation transformers
safetensors qwen2 deepseek
21.3K
Updated 6mo ago
Details Files
RedHatAI/gemma-3n-E4B-it-quantized.w8a8
image-text-to-text transformers
safetensors gemma3n vllm
0593
Updated 1mo ago
Details Files