Egregoros

Signal feed

Matty-kun

@matty@nicecrew.digital

Christ is King
Apologetically imperfect
Shitpost extraordinaire
NiceCrew Admin

Posts

Latest notes

I genuinely do not care if people use AI to make "art" but calling yourself an artist when you're typing prompts into a box is a bit of a stretch. No, adding a LoRA from HuggingFace doesn't make you an engineer either. Niggas.

And even then SFT/DPO or whatever LoRA you use isn't going to make much of a dent. I'd recommend DPO over SFT unless you're trying to teach the model new behaviors. DPO shifts adjacent weights but you need a ton of training data to do much at all, and then you have gaps where it doesn't work. The only way to actually get this to work is to pre-train a model but I sincerely doubt any of these people are going to be willing to chip in for a couple thousand A100s.

:pepe_nerd: sorry, I just wanted to help I didn't mean to come across as arrogant.