Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
text-generation transformers
safetensors llama fp8
42173K
Updated 11mo ago
Details Files
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
text-generation transformers
safetensors mistral fp8
18130K
Updated 1y ago
Details Files
stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8
image-text-to-text vllm
mistral3 fp8 compressed-tensors
6127K
Updated 2mo ago
Details Files
RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic
text-generation
safetensors llama fp8
352K
Updated 11mo ago
Details Files
BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
533K
Updated 2mo ago
Details Files
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
text-generation
safetensors mistral mistral-small
1322K
Updated 8d ago
Details Files
RedHatAI/gemma-3-27b-it-FP8-dynamic
image-text-to-text transformers
safetensors gemma3 vllm
620K
Updated 3mo ago
Details Files
RedHatAI/Qwen2-7B-Instruct-FP8
text-generation transformers
safetensors qwen2 fp8
218K
Updated 1y ago
Details Files
RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV
text-generation transformers
safetensors llama fp8
812K
Updated 1y ago
Details Files
RedHatAI/Qwen2-1.5B-Instruct-FP8
text-generation transformers
safetensors qwen2 fp8
011K
Updated 1y ago
Details Files
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
text-generation transformers
safetensors deepseek_v2 fp8
710K
Updated 1y ago
Details Files
RedHatAI/Qwen3-8B-FP8-dynamic
text-generation
safetensors qwen3 qwen
310K
Updated 8d ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
47.4K
Updated 5mo ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-FP8
text-generation transformers
safetensors llama fp8
87K
Updated 5mo ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8
text-generation transformers
safetensors llama fp8
506.4K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
36.1K
Updated 4mo ago
Details Files
RedHatAI/Meta-Llama-3-8B-Instruct-FP8
text-generation transformers
safetensors llama fp8
246K
Updated 1y ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama fp8
155.2K
Updated 11mo ago
Details Files
RedHatAI/gemma-2-9b-it-FP8
text-generation transformers
safetensors gemma2 gemma
54.8K
Updated 8d ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
94K
Updated 4mo ago
Details Files