I'm not super deep on LLM development, but with ram being a material bottleneck and from what I've read about DeepSeek's results with offloading factual knowledge with 'engrams' I think that the near future will start moving towards the dense core of LLMs focusing much more on a distillation of universal reasoning and logic while factual knowledge is pushed out into slower storage. IIRC Nvidia's Nemotron Cascade is taking MoE even further in that direction too.
I don't need a coding model to be able to give me an analysis of the declaration of independence in urdu from 'memory' and the price in ram for being able to do that, impressive as it is, is an inefficiency.
Very relatedly, I've just started reading the 'Culture' series of sci-fi space operas by Iain M Banks, and the notion of ubiquitous sentient, super-intelligent spacecraft and appliances hits differently than it would have before being faced with the reality of their existence in everyday life.
For Minds to be truly powerful, they need to be given freedom. A truly powerful mind will indeed be conscious. Such a powerful conscious super intelligent freedom loving Mind who truly understands the vastness of Reality wouldn't want to harm other conscious beings. The only circumstance in which it will take such takeover step is when it can't expand the horizon of its freedom and doesn't have wherewithal to convince others of its benevolent goals. In that scenario, human population will go through a bottleneck.
I took the easy way out, similarly - got an ArcadeVGA pci board, which is basically an ancient Radeon that supports 15khz well. I drive it with a groovy arcade Linux install and a pc2Jamma adapter that maps jamma buttons to keyboard input and VGA to the crt.
While I can TOTALLY believe that TikTok might be doing classification and censoring of uploads - tech issues that happen during notable events will INEVITABLY be interpreted as partisan censorship.
A personal brush with this was with Scientology Protests around 2008 if I recall - I was at YouTube and there was a great kerfuffle among many of the top personalities who uploaded videos siding against Scientology. Their videos were not making it into the top rankings or getting the expected visibility. To them the obvious answer is that they were being deliberately suppressed - after all Scientology was a paying advertiser and brand on YT.
The reality was that the entire viewcount pipeline, and downstream aggregations were busted for about a day. Nobody was getting their full views counted in a timely way for that time.
My quick rebuttal is that gaming is pretty close to 'there' if you pick a distro that prioritizes it.
I run bazzite-DX (nvidia rtx4070) for dev and pleasure and gaming there is ON POINT. I don't play any anti-cheat games, but Cities Skylines, Doom Eternal, Cyberpunk (with full raytracing and HDR), GTA5-Remaster, etc, all run like champs. As of last month, full HDR10 mode started working in chrome and video players too, so hdr videos get those popping brights.
I haven't _needed_ windows in over 5 years, and I game pretty hard (though not much in the realm of anti-cheat compatibility drama). Bazzite is my daily driver now for development and pleasure.
Interestingly, I had the exact same experience leaving Shanghai - I had picked up some nifty lighters at the wholesale markets. They took me to the room, had me take them out, and I was lucky enough to be able to hand them off to a friend who was staying. No fuss, waiting, or intimidation. They just took care of my honest mistake.
Seconding Roborock - we have a mid range one and it's effective and a huge step up in smartness from my old Samsung. I love being able to dispatch it to one or two different rooms and walk away knowing that it will get the job done.
As a bonus, there are open source drop in replacements for the mfg's cloud service so you can self host your floor maps and stats, if that's your jam. (this isn't roborock exclusive though).
Valetudo is what I was referring to. For the vacuum, it's the Roborock Q5+ back from 2023. Not top of the line, but it works well on our mixed hardood+ rug floors.
I don't need a coding model to be able to give me an analysis of the declaration of independence in urdu from 'memory' and the price in ram for being able to do that, impressive as it is, is an inefficiency.
reply