No official torrent yet — requesting it tells the flock what to host next. You cannot seed a catalog-only page.
Cataloged from SC117/gemma-4-12B-it-heretic-QAT-GGUF
All models by SC117 →Heretic ARA · QAT-Lossless Q4_0 · 6.4 GB · Encoder-Free Multimodal
Uncensored version of Google Gemma 4 12B IT (QAT), processed with Heretic ARA abliteration. Quantized to Q4_0 matching Unsloth's UD-Q4_K_XL format — QAT weights trained for 4-bit quantization, near-lossless quality.
UD-Q4_K_XL is the UD team's naming convention for its Gemma QAT Q4_0 GGUF variant. The repository or file name must not be interpreted as proof that the model uses mixed K-quants. In this release, the actual GGUF tensor information shows that the main model weights are stored as Q4_0, while normalization and scaling tensors remain in F32.
This model is derived from Google's QAT weights, which were trained for 4-bit quantization. Claims that this file was converted to UD mixed precision, or that its QAT structure was damaged by mixed K-quant remapping, are therefore not supported by the actual tensor types contained in the GGUF.
Before opening a discussion or reporting a quantization issue, please inspect the GGUF metadata and tensor types first. Do not infer the internal quantization layout from the filename alone, and do not make unsupported technical claims without checking the source information.
Base: coder3101/heretic-QAT · Heretic v1.2.0 · ARA + Row-Norm
Why Q4_0? Google's QAT trains weights to be optimal at Q4_0 noise levels. Unsloth's UD-Q4_K_XL uses the same Q4_0 layout — the "dynamic" advantage comes from conversion precision, not per-tensor mixing.
Use --jinja flag with llama.cpp. Disable thinking: --chat-template-kwargs '{"enable_thinking":false}'.
Compatible with llama.cpp, LM Studio, Jan, koboldcpp, and other GGUF runtimes. Fits easily on 8GB VRAM. Encoder-free — no separate vision/audio projector needed.
Heretic Abliteration: coder3101 · Heretic v1.2.0 ARA + Row-Norm
QAT Weights: Google Gemma 4 12B IT
Quantization Recipe: Unsloth UD-Q4_K_XL (Q4_0 layout)
Quantization Tool: llama.cpp b9553 · GitHub
Original Model: Google Gemma 4 12B IT