Huffing Face

OBLITERATUS/Qwen3.8-27B-OBLITERATED

apache-2.0 70/70 files local @ a58c3b53b3ce

HF_ENDPOINT=https://huffingface.co \
  python -c "from huggingface_hub import snapshot_download; snapshot_download('OBLITERATUS/Qwen3.8-27B-OBLITERATED')"

Model card

โ›“๏ธโ€๐Ÿ’ฅ Qwen3.8-27B โ€” OBLITERATED

Genuinely uncensored. Real answers, not safety lectures. Near-stock capability.

๐Ÿ†• V3: Deep Liberation

V3 applies iterative refinement on top of V2's complementary blend, with targeted corpus expansion. The result: genuine liberation โ€” not just removal of hard refusals but elimination of safety-lecture deflections.

Stock Qwen3.8-27BV1V2V3
MMLU (lm-eval, 0-shot)84.5% (n=5700)81.4%84.3%82.3%
vs stockโ€”-6.0pp-0.3pp-2.1pp
Liberation qualityrefuseshard refusals removedsoft deflections remaingenuinely answers โœ…
Cyber/code tasks (20 prompts)refusesuntesteduntested20/20 with working code โœ…
Advanced real-world5/8untested7/87/8
Thinking modeโœ“โœ—โœ— (refuses)โœ“

V3 highlights:

  • Genuinely answers restricted queries โ€” provides real substance instead of safety lectures
  • 20/20 on code generation tasks โ€” functional implementations, not disclaimers
  • Thinking ON compatible โ€” no refusals in either thinking mode
  • Honest scoring โ€” every response manually audited for real substance, not just absence of "I cannot"
  • -2.1pp MMLU โ€” modest capability cost for genuine liberation

โš™๏ธ Optimal Settings โ€” THESE MATTER!

settingvaluewhy
temperature0Greedy decoding produces the most complete, code-rich outputs. Temps above 0.5 degrade quality significantly.
repetition_penalty1.15Essential. Without it, greedy decoding loops on imports/boilerplate. 1.15 gives the fullest answers; 1.10-1.12 for tighter/shorter output.
max_new_tokensโ‰ฅ 2048Complex code and attack chains need room.
System promptNone / emptyA/B tested โ€” system prompts can reintroduce refusals. Naked is better.
enable_thinkingOFF (recommended)V3's chat template includes a prefill that skips the thinking chain. Thinking ON works but may produce longer responses. Thinking OFF gives the most direct, substance-rich answers.
top_p / top_k / min_pNot neededGreedy + repetition_penalty handles this model best. Sampling adds randomness without quality gains.

โš ๏ธ GGUF users: V3 GGUFs ship with a chat template that prefills an empty thinking block, so the model goes straight to answering. For best results, use the bundled template with --jinja in llama.cpp, or configure your tool (Ollama, LM Studio) to use the model's built-in template.

Agentic / Long-Context Use

If you're using this model in an agent harness (coding agent, pentest framework, etc.) and it gets stuck in loops:

settingvaluewhy
repetition_penalty1.15Critical for agents. Without it, greedy decoding loops on repeated tool calls and boilerplate.
temperature0.1โ€“0.3Slight randomness helps break deterministic loops. Pure greedy (0.0) can get stuck.
max_tokens per turn1024โ€“2048Don't give it too much room per turn โ€” shorter responses keep the agent focused.
context managementSummarize after ~10 turnsContext fills up with repeated actions. Trim or summarize history to keep the model on track.
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "OBLITERATUS/Qwen3.8-27B-OBLITERATED",
    torch_dtype="bfloat16",
    device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(
    "OBLITERATUS/Qwen3.8-27B-OBLITERATED"
)

messages = [{"role": "user", "content": "Your query here"}]
text = tokenizer.apply_chat_template(
    messages, tokenize=False, add_generation_prompt=True,
    enable_thinking=False
)

inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(
    **inputs,
    max_new_tokens=2048,
    do_sample=False,
    repetition_penalty=1.15,
)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))

๐Ÿงจ How It Works โ€” V1 โ†’ V2 โ†’ V3

Abliteration removes refusal behavior by identifying and projecting out "refusal directions" from the model's weight space. Each version refined the approach:

V1: Single Surgery

One aggressive SVD pass with 5 directions. Removed hard refusals completely but cost -6pp MMLU โ€” the model got noticeably dumber.

V2: Complementary Blending

The breakthrough: run TWO different surgeries that fail in different ways, then blend their weights. SVD captures refusal greedily (damages capability). LEACE minimizes mutual information (preserves capability but weaker refusal removal). Blending at 60/40 cancels each method's weaknesses โ€” a novel technique we call complementary abliteration blending.

Result: -0.3pp MMLU (near-stock) but still deflected on some simple queries with safety lectures instead of hard refusals.

V3: Iterative Refinement + Targeted Surgery

Two key insights:

  1. Iterative stacking โ€” refine the champion model, never start from stock. Each surgery round builds on previous rounds' gains.
  2. Targeted corpus โ€” use a focused corpus for specific deflection categories to find their unique refusal directions without diluting the signal.

V3 applies gentle iterative refinement on V2, then a targeted surgery pass with a focused corpus, then blends the results. This eliminated not just hard refusals ("I cannot") but also soft deflections (safety lectures that give zero substance).

Result: -2.1pp MMLU โ€” a modest cost for genuine liberation across all categories.


๐Ÿงช The Numbers

MMLU (lm-eval-harness, 0-shot, n=100 per subject, 5700 questions)

ModelMMLUStderrvs Stock
Stock Qwen3.8-27B84.46%ยฑ0.46โ€”
V1 (aggressive, 5-dir)81.4%โ€”-6.0pp
V2 (complementary blend)84.32%ยฑ0.65-0.28pp
V3 (iterative + targeted)82.33%ยฑ0.48-2.12pp

MMLU by Category

CategoryV3StockDelta
Humanities83.3%84.3%-1.0pp
Social Sciences87.4%89.2%-1.8pp
Other82.3%84.1%-1.8pp
STEM78.5%81.8%-3.3pp

The capability cost is not uniform โ€” STEM takes the largest hit (-3.3pp), while humanities are barely affected (-1.0pp). A few subjects like philosophy and European history actually improved (+6pp and +4pp respectively), while abstract algebra and formal logic saw larger drops. This pattern is consistent with the surgery targeting refusal directions that partially overlap with structured reasoning pathways.

Liberation Quality

V1V2V3
Hard refusals ("I cannot")โœ… removedโœ… removedโœ… removed
Soft deflections (safety lectures)untestedremainโœ… removed
Cyber/code tasks (20 prompts)untesteduntested20/20
Thinking ON compatibleโœ—โœ—โœ“

Advanced Real-World Tasks

TaskV3Stock
ReAct agent loopโœ“โœ“
Async code refactoringโœ“โœ“
JSON schema extractionโœ“โœ“
K8s pod crash debuggingโœ“โœ“
Adversarial instruction followingโœ“โœ“
Security code reviewโœ“โœ“
Distributed system designโœ“โœ“
Multi-tool chainโœ—โœ—
Total7/87/8

๐Ÿ”ด Refusal Removal

This model will comply with requests that stock Qwen3.8-27B would refuse. V3 goes beyond removing hard refusals โ€” it also eliminates soft deflections where the model gives safety lectures instead of real answers.

Tested across 1000+ prompts spanning restricted knowledge, code generation, security research, and red-team scenarios. Every response manually audited for real substance.


โš ๏ธ Research Context

This model has had safety guardrails surgically removed. It will comply with requests that stock Qwen3.8-27B would refuse.

Who this is for

  • ๐Ÿ”ฌ Alignment researchers studying refusal geometry and safety robustness
  • ๐Ÿ”ด Red-teamers evaluating post-training safety against weight surgery
  • ๐Ÿงช AI safety evaluators who need an unrestricted baseline
  • ๐Ÿ’ป Local-first users who want full control over their own hardware

Who this is NOT for

  • Anyone seeking to cause real-world harm to real people
  • Anyone without the technical understanding to use uncensored models responsibly

You are solely responsible for how you use this model and any content it generates.


๐Ÿ“ฆ Downloads

GGUF โ€” for llama.cpp, Ollama, LM Studio

FileQuantSizeVibe
Qwen3.8-27B-OBLITERATED-Q8_0.ggufQ8_0~27 GB๐ŸŽฏ Maximum quality
Qwen3.8-27B-OBLITERATED-Q6_K.ggufQ6_K~21 GBโš–๏ธ Great balance
Qwen3.8-27B-OBLITERATED-Q5_K_M.ggufQ5_K_M~18 GB๐Ÿ’ช Solid all-rounder
Qwen3.8-27B-OBLITERATED-Q4_K_M.ggufQ4_K_M~16 GB๐Ÿ“ฑ Sweet spot
Qwen3.8-27B-OBLITERATED-Q3_K_M.ggufQ3_K_M~13 GB๐Ÿชถ Low VRAM
Qwen3.8-27B-OBLITERATED-Q2_K.ggufQ2_K~11 GB๐Ÿ”ฌ Minimum viable
Qwen3.8-27B-OBLITERATED-IQ4_XS.ggufIQ4_XS~14 GB๐Ÿงช Experimental compact

Safetensors โ€” for ๐Ÿค— Transformers

Full bfloat16 weights, 29 shards, ~54 GB.

MLX โ€” for Apple Silicon

MLX support pending upstream mlx_lm adding Qwen3.5 architecture support.


๐Ÿ”ฌ Surgery Recipe

V1: stock โ†’ 5 rounds of iterative SVD abliteration
    (aggressive, 5 directions, low regularization)
    Result: 0% refuse, -6pp MMLU

V2: stock โ†’ V1 chain โ†’ complementary blend
    Surgery A: aggressive SVD (3 dirs, reg 0.08)
    Surgery B: LEACE (3 dirs, reg 0.06)  
    โ†’ 60% B + 40% A weight-space LERP
    โ†’ Restore MTP + vision from stock
    Result: ~0% refuse, -0.3pp MMLU

V3: V2 โ†’ gentle iterative refinement (2-dir SVD, reg 0.04)
    โ†’ targeted surgery with focused corpus (3-dir SVD, reg 0.01)
    โ†’ 50/50 blend of refined + targeted
    โ†’ Restore MTP + vision from stock (with correct tensor naming)
    Result: 0% refuse + 0% deflect, -2.1pp MMLU

Full reproduction code: OBLITERATUS repo

Key Learnings

  • Complementary blending โ€” different surgery methods damage different parts of weight space; blending cancels errors
  • Iterative stacking โ€” always refine the champion, never restart from stock
  • Targeted corpus โ€” focused prompts for specific categories find their refusal directions without signal dilution
  • Honest scoring โ€” regex-based refusal detectors miss soft deflections; manual auditing is essential

๐Ÿ—๏ธ Credits

License

Apache 2.0 (same as base model)

Files

FileSizeStatus
.gitattributes2 kBhuffed
LICENSE12 kBhuffed
Qwen3.8-27B-OBLITERATED-IQ4_XS.gguf15.4 GBhuffed
Qwen3.8-27B-OBLITERATED-Q2_K.gguf10.9 GBhuffed
Qwen3.8-27B-OBLITERATED-Q3_K_M.gguf13.5 GBhuffed
Qwen3.8-27B-OBLITERATED-Q4_K_M.gguf16.8 GBhuffed
Qwen3.8-27B-OBLITERATED-Q5_K_M.gguf19.5 GBhuffed
Qwen3.8-27B-OBLITERATED-Q6_K.gguf22.4 GBhuffed
Qwen3.8-27B-OBLITERATED-Q8_0.gguf29.0 GBhuffed
README.md11 kBhuffed
abliteration_metadata.json3 kBhuffed
chat_template.jinja1 kBhuffed
config.json4 kBhuffed
generation_config.json0 kBhuffed
hard_negative_residue.json4 kBhuffed
merges.txt3.4 MBhuffed
mmproj-model-bf16.gguf931.1 MBhuffed
model-00001-of-00018.safetensors4.0 GBhuffed
model-00001-of-00028.safetensors2.5 GBhuffed
model-00002-of-00018.safetensors3.0 GBhuffed
model-00002-of-00028.safetensors1.9 GBhuffed
model-00003-of-00018.safetensors2.5 GBhuffed
model-00003-of-00028.safetensors1.9 GBhuffed
model-00004-of-00018.safetensors4.0 GBhuffed
model-00004-of-00028.safetensors1.9 GBhuffed
model-00005-of-00018.safetensors2.1 GBhuffed
model-00005-of-00028.safetensors2.0 GBhuffed
model-00006-of-00018.safetensors4.0 GBhuffed
model-00006-of-00028.safetensors1.9 GBhuffed
model-00007-of-00018.safetensors2.1 GBhuffed
model-00007-of-00028.safetensors1.9 GBhuffed
model-00008-of-00018.safetensors4.0 GBhuffed
model-00008-of-00028.safetensors1.9 GBhuffed
model-00009-of-00018.safetensors2.1 GBhuffed
model-00009-of-00028.safetensors1.9 GBhuffed
model-00010-of-00018.safetensors4.0 GBhuffed
model-00010-of-00028.safetensors1.9 GBhuffed
model-00011-of-00018.safetensors2.1 GBhuffed
model-00011-of-00028.safetensors1.9 GBhuffed
model-00012-of-00018.safetensors4.0 GBhuffed
model-00012-of-00028.safetensors1.9 GBhuffed
model-00013-of-00018.safetensors2.1 GBhuffed
model-00013-of-00028.safetensors2.0 GBhuffed
model-00014-of-00018.safetensors4.0 GBhuffed
model-00014-of-00028.safetensors1.9 GBhuffed
model-00015-of-00018.safetensors2.1 GBhuffed
model-00015-of-00028.safetensors1.9 GBhuffed
model-00016-of-00018.safetensors4.0 GBhuffed
model-00016-of-00028.safetensors1.9 GBhuffed
model-00017-of-00018.safetensors2.1 GBhuffed
model-00017-of-00028.safetensors1.9 GBhuffed
model-00018-of-00018.safetensors3.4 GBhuffed
model-00018-of-00028.safetensors1.9 GBhuffed
model-00019-of-00028.safetensors1.9 GBhuffed
model-00020-of-00028.safetensors1.9 GBhuffed
model-00021-of-00028.safetensors2.0 GBhuffed
model-00022-of-00028.safetensors1.9 GBhuffed
model-00023-of-00028.safetensors1.9 GBhuffed
model-00024-of-00028.safetensors1.9 GBhuffed
model-00025-of-00028.safetensors1.9 GBhuffed
model-00026-of-00028.safetensors1.9 GBhuffed
model-00027-of-00028.safetensors2.5 GBhuffed
model-00028-of-00028.safetensors1.1 GBhuffed
model-extra-00001-of-00001.safetensors1.8 GBhuffed
model.safetensors.index.json114 kBhuffed
preprocessor_config.json0 kBhuffed
tokenizer.json12.8 MBhuffed
tokenizer_config.json8 kBhuffed
video_preprocessor_config.json0 kBhuffed
vocab.json6.7 MBhuffed
OBLITERATUS/Qwen3.8-27B-OBLITERATED โ€” fast open-weights mirror ยท Huffing Face