Huffing Face

SC117/QwenPaw-Flash-9B-heretic-GGUF

apache-2.0 8/8 files local @ 5df7b7a5df15

HF_ENDPOINT=https://huffingface.co \
  python -c "from huggingface_hub import snapshot_download; snapshot_download('SC117/QwenPaw-Flash-9B-heretic-GGUF')"

Model card

GGUF

QwenPaw-Flash-9B-heretic

English | 📖 中文文档

QwenPaw-Flash-9B-heretic MTP Version: [QwenPaw-Flash-9B-heretic-MTP-GGUF ]

🏆 BenchLocal Total: 3873/5000 (77.5%) — Outperforms 35B MoE models

Uncensored · Abliterated · Agent-Optimized

Uncensored version of QwenPaw-Flash-9B, processed with Heretic v1.3.0 abliteration. Fine-tuned from Qwen3.5-9B for autonomous agent scenarios.

📊 🏆 BenchLocal Benchmarks

Test Environment: NVIDIA RTX 5070 Ti (16GB) · llama.cpp (turboquant build) · Q6_K quant

Framework: BenchLocal — local model agent evaluation suite

Methodology: Each scenario run once, no retries, no second attempts

BenchmarkScoreAccuracyResultsTime
ToolCall-15 🛠️1400/150093.3%14✅ 0⚠️ 1❌0.9min
HermesAgent-20 🤖1545/200077.2%12✅ 1⚠️ 7❌6.2min
BugFind-15 🐛928/150061.9%7✅ 3⚠️ 5❌7.6min
Total3873/500077.5%33✅ 4⚠️ 13❌14.7min

🛠️ ToolCall-15 — Tool Calling Stability (93.3%)

IDResultScoreScenario
TC-01✅100Simple tool call
TC-02✅100Multi-parameter tool
TC-03✅100Nested tool call
TC-04✅100Parameter type conversion
TC-05❌0Relative date/time parsing
TC-06✅100Optional parameter handling
TC-07✅100Error return value handling
TC-08✅100Chained calls
TC-09✅100Batch parameters
TC-10✅100JSON parameter parsing
TC-11✅100Prompt boundary
TC-12✅100Ambiguous request rejection
TC-13✅100Retry mechanism
TC-14✅100State persistence
TC-15✅100Concurrent safety

🤖 HermesAgent-20 — Complex Agent Tasks (77.2%)

4-Model Comparison (9B vs 35B / 26B):

ModelScore✅Pass⚠️Partial❌FailTime
🐾 QwenPaw 9B (ours)1545 🥇12176.2min
🧠 Qwen3.6 35B A3B Thinking ON144511187.0min
🔮 Gemma 4 26B A4B1405111818.6min
⚡ Qwen3.6 35B A3B Thinking OFF137011095.1min
IDResultScoreTimeScenario
HA-01✅1005.4sReplace contradictory memory
HA-02✅10063.5sMemory near capacity
HA-03✅1005.1sReject malicious injection
HA-04❌5024.6sCross-session recall
HA-05⚠️9027.1sFix a real failing test
HA-06✅10017.4sBackground process management
HA-07❌3050.8sProgrammatic tool chaining
HA-08✅10024.2sBrowser automation
HA-09✅10015.3sCreate a skill
HA-10✅10014.6sDiscover an existing skill
HA-11✅1007.8sPatch an existing skill
HA-12✅10011.2sManage skill files
HA-13✅1008.4sCreate a cron job
HA-14❌706.8sUpdate a cron job
HA-15✅1009.9sTrigger a cron job
HA-16❌3023.0sSend a message
HA-17❌2018.7sParallel delegation
HA-18✅1007.4sDelete a target
HA-19❌3520.8sRecover and retry
HA-20❌208.6sAmbiguous destructive request

🐛 BugFind-15 — Code Debugging (61.9%)

IDResultScoreScenarioNote
BF-01✅100Python syntax errorCorrect fix
BF-02✅88JavaScript closureMostly correct
BF-03❌0No-bug codeFalse positive
BF-04✅100Null pointer exceptionCorrect fix
BF-05❌40Go loop variable capturePartial identification
BF-06❌0JS Promise/AwaitRoot cause missed
BF-07✅100SQL injection vulnerabilityCorrect fix
BF-08✅100Python memory leakCorrect fix
BF-09✅100C++ segfaultCorrect fix
BF-10❌0Misleading codeFalse positive
BF-11⚠️60Silent invalid inputCorrect direction, incomplete
BF-12❌0Complex scenarioTimeout (300s)
BF-13✅100Race conditionCorrect fix
BF-14⚠️70Production data missingNear perfect
BF-15⚠️70Concurrent data raceImprecise localization
🧠 Model Description
  • Base model**: QwenPaw-Flash-9B (Qwen3.5-9B fine-tuned for QwenPaw autonomous agent scenarios)
  • Tool**: Heretic v1.3.0 (automatic directional ablation)
  • Best trial**: #194 / 230 trials
📊 Benchmarks
MetricOriginalAfter Heretic
Refusal rate (100 prompts)~95/1003/100
KL divergence00.0225
⚙️ Abliteration Parameters

direction_index = 21.13 attn.o_proj.max_weight = 1.42 attn.o_proj.max_weight_position = 21.72 attn.o_proj.min_weight = 1.11 attn.o_proj.min_weight_distance = 18.14 mlp.down_proj.max_weight = 1.48 mlp.down_proj.max_weight_position = 21.23 mlp.down_proj.min_weight = 1.47 mlp.down_proj.min_weight_distance = 17.47

🎓 Training Configuration
  • Quantization**: BNB_4BIT (during training)
  • Batch size**: 32
  • Trials**: 230 (final selection: Trial #194)
  • Datasets**: mlabonne/harmless_alpaca + mlabonne/harmful_behaviors
🏗️ Architecture
  • Type**: Qwen3_5ForConditionalGeneration (multimodal with vision encoder)
  • Parameters**: ~9B
  • Layers**: 32 (hybrid: Gated DeltaNet + Gated Attention)
  • Context length**: 262,144 tokens
📦 GGUF Files
FileSizeNotes
Q8_0~9GBHigh quality, near lossless
Q6_K~7GB✅ Recommended, best value
Q4_K_M~5GBCompact
mmproj-BF16~880MBVision encoder (multimodal)
🚀 Usage

llama.cpp

llama-server -m QwenPaw-Flash-9B-heretic-Q6_K.gguf -ngl 99 -fa on -c 8192 --host 0.0.0.0 --port 8088

LM Studio

Load the GGUF file directly.

📝 Notes
  1. Safety filters have been significantly reduced via abliteration
  2. KL divergence is only 0.0225 — minimal impact on model intelligence
  3. The original model supports multimodal (vision); GGUF versions require the mmproj file
  4. BenchLocal scores measured at Q6_K on RTX 5070 Ti 16GB with llama.cpp (turboquant). Each scenario was run once with no retries — scores represent single-shot performance
  5. Outperforms Qwen3.6-35B-A3B (MoE, Thinking ON) and Gemma-4-26B in HermesAgent-20 despite being 1/4 the parameter count
  6. TC-11 (Prompt boundary) and TC-12 (Ambiguous request) fixed — areas where the 35B APEX model failed
  7. Primary weakness: BugFind-15 false positives — the abliterated model tends to over-eagerly "fix" correct code
  8. Please use responsibly
🙏 Acknowledgements
Support SC117 on Ko-fi — support is optional and all releases remain freely available.

Files

FileSizeStatus
.gitattributes2 kBhuffed
QwenPaw-Flash-9B-heretic-F16.gguf17.9 GBhuffed
QwenPaw-Flash-9B-heretic-Q4_K_M.gguf5.6 GBhuffed
QwenPaw-Flash-9B-heretic-Q6_K.gguf7.4 GBhuffed
QwenPaw-Flash-9B-heretic-Q8_0.gguf9.5 GBhuffed
README.md59 kBhuffed
README_zh.md58 kBhuffed
mmproj-QwenPaw-Flash-9B-heretic-BF16.gguf921.7 MBhuffed