Egregoros

@SuperDicq @nom no the models that work the best are just too big to fit on consumer gpus

@sun@shitposter.world @SuperDicq@minidisc.tokyo @nom@mk.spook.social that's what makes strix halo and apple's unified memory on the mac studio so great.

@lolitechengineer @SuperDicq @nom I have seen people using local models but claude/chatgpt blows the doors off them

@sun@shitposter.world @SuperDicq@minidisc.tokyo Not true, really, for those of us in the US who can extrapolate/have some modicum amount of imagination.

Definitely true if you've become a slave to the big ai modules / are trapped in lockstep greater Asia.

@nom @SuperDicq every time I'm told local models are as good as chatgpt I try it and it is if you only test it for a minute. if you do anything complicated they're just inferior

@sun@shitposter.world @SuperDicq@minidisc.tokyo Yes indeedie I think we all know that openai or claude on a great GPU are just dandy... but the local models are "good enough" to build horizontal product already.

Also, many robotic AI tasks can be done at home with fallback to the cloud. I mean it's pretty obvious.

A lot of systems are going to REQUIRE fallback to local models so please think about that when you're designing AI products in the near term for use at home.

@nom @SuperDicq I am an enthusiastic supporter of local models. I have a 24GiB nvidia 4090 for it. but most people are just using an api key on openclaw afaict and the reddits are filled with people saying they went back to chatgpt

@SuperDicq @sun @nom I mean they actually do release a bunch of research papers or did at least until recently the actual code really isn't that significant and it's mostly infra handling the vast datasets afaik, the real stuff is the training data and most of it is stolen copyrighted stuff so :)

@meeper@udongein.xyz @sun@shitposter.world @nom@mk.spook.social Yeah that's another whole problem too. They can't even share their training data if they wanted to because it's fucking illegal.

@SuperDicq @meeper @nom I didn't care about copyright violating for learning stuff before, but I didn't have time to sift through all of it myself. the big companies chewed it all up and made it digestible now, so win win

@sun @SuperDicq @nom @meeper my only real issue with this is that insofar the trump admin is just giving meta et all a free pass because "idk AI or something."

i'm fine with us just saying IP is over, had a bad run, lets move on to the star trek future. what i'm absolutely not going to tolerate is "meta and anthropic steals everything illegally, monopolizes and monetizes it, and then oh no we have to respect copyrights again (?)"

@icedquinn @SuperDicq @nom @meeper its a real problem I'm just saying right now I get the benefit of piracy via a third party to learn a ton of stuff and that's actually a good thing.

@SuperDicq it does apply to companies. this is a rather unique break in protocol.

@sun they should send zuck to prison for 9,000,000 years just like all the moms who pirated 12 tracks of music and were harassed that they caused infinity billions in damages.

or we should just admit copyright is over.

@nom @meeper

@icedquinn @SuperDicq @nom @meeper do it to all the music ai companies that clearly pirated music. leave alone models trained on scientific data that should be free anyway

@icedquinn@blob.cat @sun@shitposter.world @nom@mk.spook.social @meeper@udongein.xyz The last scenario is unfortunately the most likely outcome.

Copyright doesn't apply to you if you're a big company. It only exists to oppress us.

@SuperDicq @icedquinn @meeper @sun @nom
>Copyright doesn't apply to you if you're a big company. It only exists to oppress us.
Once again proof that copyright is dumb. If it isn't enforced, it shouldn't exist. Simple as.

@phnt @SuperDicq @nom @sun @meeper it is enforced, just not for this

@icedquinn @SuperDicq @nom @sun @meeper Let me rephrase that. If it isn't enforced equally, it shouldn't exist. Simple as.