Hugging Face Models

Showing 20 models

TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF
trl
gguf mistral distilabel
1235.2K
Updated 2y ago
Details Files
QuantFactory/NeuralDaredevil-8B-abliterated-GGUF
text-generation
gguf dpo dataset:mlabonne/orpo-dpo-mix-40k
723.7K
Updated 1y ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.005-GGUF
transformers
gguf generated_from_trainer dpo
12.5K
Updated 2d ago
Details Files
mradermacher/Qwen2.5-7B-Instruct-wildfeedback-iterDPO-iter2-4k-GGUF
transformers
gguf generated_from_trainer trl
12.2K
Updated 27d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-iterDPO-iter1-4k-GGUF
transformers
gguf generated_from_trainer dpo
11.9K
Updated 29d ago
Details Files
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-iterDPO-iter2-4k-GGUF
transformers
gguf generated_from_trainer trl
11.6K
Updated 27d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.01-GGUF
transformers
gguf generated_from_trainer dpo
11.5K
Updated 2d ago
Details Files
mradermacher/Llama-3.1-8B-sft-SPIN-gpt4o-beta0.8-lr5e-7-GGUF
transformers
gguf generated_from_trainer trl
01.5K
Updated 3d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-seed-RPO-0.5-GGUF
transformers
gguf generated_from_trainer trl
01.5K
Updated 3d ago
Details Files
mradermacher/Llama-3.1-8B-Instruct-wildfeedback-DRIFT-iter2-re-GGUF
transformers
gguf generated_from_trainer trl
01.3K
Updated 3d ago
Details Files
mradermacher/Llama-3.1-8B-sft-spin-10k-IPO-GGUF
transformers
gguf generated_from_trainer trl
01.3K
Updated 3d ago
Details Files
tensorblock/albertfares_DPO_MCQA_model-GGUF
text-generation
gguf merge sft
01.2K
Updated 21d ago
Details Files
mradermacher/MimicLlama-3.1-8B-DPO-GGUF
transformers
gguf text-generation-inference unsloth
01.1K
Updated 18h ago
Details Files
mradermacher/Qwen2.5-7B-Instruct-wildfeedback-iterDPO-iter1-4k-GGUF
transformers
gguf generated_from_trainer trl
01.1K
Updated 29d ago
Details Files
mradermacher/pandora-7b-chat-GGUF
transformers
gguf chat dpo
01.1K
Updated 8mo ago
Details Files
darkc0de/Xortron2025
text-generation
gguf mistral uncensored
231K
Updated 4mo ago
Details Files
bartowski/NeuralDaredevil-8B-abliterated-GGUF
text-generation
gguf dpo dataset:mlabonne/orpo-dpo-mix-40k
11748
Updated 1y ago
Details Files
mradermacher/WizardCoder-3B-V1.0-dpo-beta-0.01-i1-GGUF
transformers
gguf axolotl dpo
0675
Updated 23d ago
Details Files
mradermacher/Phi-3-mini-4k-instruct-v0.3-i1-GGUF
transformers
gguf axolotl finetune
0663
Updated 9mo ago
Details Files
bartowski/Llama-3-SauerkrautLM-8b-Instruct-GGUF
text-generation
gguf two stage dpo dpo
13652
Updated 1y ago
Details Files