Hugging Face Models

Showing 20 models

TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF
trl
gguf mistral distilabel
1235.4K
Updated 2y ago
Details Files
QuantFactory/NeuralDaredevil-8B-abliterated-GGUF
text-generation
gguf dpo dataset:mlabonne/orpo-dpo-mix-40k
723.7K
Updated 1y ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.005-GGUF
transformers
gguf generated_from_trainer dpo
12.4K
Updated 1d ago
Details Files
mradermacher/Qwen2.5-7B-Instruct-wildfeedback-iterDPO-iter2-4k-GGUF
transformers
gguf generated_from_trainer trl
12.2K
Updated 26d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-ultrafeedback-iterdpo-iter2-RPO-GGUF
transformers
gguf generated_from_trainer dpo
12.2K
Updated 29d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-ultrafeedback-spin-iter2-RPO-GGUF
transformers
gguf generated_from_trainer dpo
02.1K
Updated 29d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-iterDPO-iter1-4k-GGUF
transformers
gguf generated_from_trainer dpo
11.9K
Updated 28d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-iterDPO-iter2-4k-GGUF
transformers
gguf generated_from_trainer trl
11.6K
Updated 26d ago
Details Files
mradermacher/Llama-3.1-8B-sft-SPIN-gpt4o-beta0.8-lr5e-7-GGUF
transformers
gguf generated_from_trainer trl
01.5K
Updated 2d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.5-GGUF
transformers
gguf generated_from_trainer trl
01.4K
Updated 2d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-DRIFT-iter2-re-GGUF
transformers
gguf generated_from_trainer trl
01.3K
Updated 2d ago
Details Files
mradermacher/Llama-3.1-8B-sft-spin-10k-IPO-GGUF
transformers
gguf generated_from_trainer trl
01.3K
Updated 2d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.01-GGUF
transformers
gguf generated_from_trainer dpo
11.3K
Updated 1d ago
Details Files
tensorblock/albertfares_DPO_MCQA_model-GGUF
text-generation
gguf merge sft
01.2K
Updated 21d ago
Details Files
mradermacher/Qwen2.5-7B-Instruct-wildfeedback-iterDPO-iter1-4k-GGUF
transformers
gguf generated_from_trainer trl
01.1K
Updated 28d ago
Details Files
mradermacher/pandora-7b-chat-GGUF
transformers
gguf chat dpo
01K
Updated 8mo ago
Details Files
darkc0de/Xortron2025
text-generation
gguf mistral uncensored
231K
Updated 4mo ago
Details Files
bartowski/NeuralDaredevil-8B-abliterated-GGUF
text-generation
gguf dpo dataset:mlabonne/orpo-dpo-mix-40k
11753
Updated 1y ago
Details Files
mradermacher/WizardCoder-3B-V1.0-dpo-beta-0.01-i1-GGUF
transformers
gguf axolotl dpo
0674
Updated 22d ago
Details Files
mradermacher/Grok_HumanLike_Llama-3.2-3B-Instruct-GGUF
transformers
gguf text-generation-inference unsloth
0665
Updated 2mo ago
Details Files