Hugging Face Models

Showing 20 models

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
text-generation transformers
safetensors llama fp8
42174K
Updated 11mo ago
Details Files
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
text-generation transformers
safetensors mistral fp8
18109K
Updated 1y ago
Details Files
stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8
image-text-to-text vllm
mistral3 fp8 compressed-tensors
679K
Updated 2mo ago
Details Files
RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic
text-generation
safetensors llama fp8
354K
Updated 11mo ago
Details Files
BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
537K
Updated 3mo ago
Details Files
RedHatAI/gemma-3-27b-it-FP8-dynamic
image-text-to-text transformers
safetensors gemma3 vllm
620K
Updated 3mo ago
Details Files
RedHatAI/Qwen2-7B-Instruct-FP8
text-generation transformers
safetensors qwen2 fp8
217K
Updated 1y ago
Details Files
RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV
text-generation transformers
safetensors llama fp8
812K
Updated 1y ago
Details Files
RedHatAI/Qwen2-1.5B-Instruct-FP8
text-generation transformers
safetensors qwen2 fp8
011K
Updated 1y ago
Details Files
RedHatAI/Qwen3-8B-FP8-dynamic
text-generation
safetensors qwen3 qwen
311K
Updated 11d ago
Details Files
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
text-generation transformers
safetensors deepseek_v2 fp8
711K
Updated 1y ago
Details Files
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
text-generation
safetensors mistral mistral-small
1310K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-8B-FP8
text-generation transformers
safetensors llama fp8
87.8K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
47.8K
Updated 5mo ago
Details Files
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
36.5K
Updated 5mo ago
Details Files
RedHatAI/gemma-2-9b-it-FP8
text-generation transformers
safetensors gemma2 gemma
56.3K
Updated 11d ago
Details Files
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8
text-generation transformers
safetensors llama fp8
506.2K
Updated 5mo ago
Details Files
RedHatAI/Meta-Llama-3-8B-Instruct-FP8
text-generation transformers
safetensors llama fp8
246.1K
Updated 1y ago
Details Files
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
text-generation transformers
safetensors llama fp8
155.4K
Updated 11mo ago
Details Files
RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic
image-to-text transformers
safetensors qwen2_5_vl vllm
94.1K
Updated 4mo ago
Details Files