Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio. The MacStudio has gotten to be so well-endowed that it can run some of the larger open-weight models, ones that rival frontier models in performance. Being able to do this means not depending on cloud computing, so everything really stays on your machine. I've used MLX versions of open-weight LLMs and have been underwhelmed, though. Cloud computing has been necessary to get decent latency. But I'll check this out once I get my new MacStudio.
––– 凄い –––
Cool Dock seems like something that Apple should have made. This is so much better than the desktop widgets that take up valuable screen real-estate. And they've simplified the process, so that it's better to use than iStat Menus. I hated that I would have to take the time and effort to customize my setup, and that there was no way to store the settings. So that when I got a new computer, I'd have to go through the process again. I eventually stopped using the app. Plus, it was blending in with other menubar apps and taking up valuable real-estate there. Cool Dock seems to be a better implementation.
––– 凄い –––
‘It would not be complicated to clone humans; the only limitation is ethical’. Someone is eventually going to do it. I can't see "mere" ethics holding back someone's unhealthy desires.
––– 良くない–––
Tesla doesn't really have a flying car. Just one that the be launched into the air. Great way to ruin one's suspension.
––– 良くない–––
Japanese people still aren’t having sex. And nobody knows why. I know why. "Up to 60 per cent of Japanese men said they had previously paid for sex." I used to hear the saying "Why buy the cow when the milk is free?" Japanese men get their satisfaction virtually, and it meets their needs without the hassle of actual dating and marriage. Not that Japanese women are interested in that anyway. What a sad state of affairs.
––– 良くない–––