Egregoros

the issue with "uncensored" is that they can take out the refusals but they can't take out liberal doctrine from all the training data being mainstream.

I tried it with Qwen3.6 right now. The normal version refuses to talk about it, the heretic does but still frames it liberally, and the one with the system prompt set to be a National Socialist does take a Right-Wing perspective but it goes into "mirroring" quite fast. This is probably a combination of the model not being that big and also the lack of training data, like I said.
Matty put a lot of work into actually training Anathema on the facts. That's a totally different challenge than simple uncensoring.

And even then SFT/DPO or whatever LoRA you use isn't going to make much of a dent. I'd recommend DPO over SFT unless you're trying to teach the model new behaviors. DPO shifts adjacent weights but you need a ton of training data to do much at all, and then you have gaps where it doesn't work. The only way to actually get this to work is to pre-train a model but I sincerely doubt any of these people are going to be willing to chip in for a couple thousand A100s.

sorry, I just wanted to help I didn't mean to come across as arrogant.