Okay, fair, but why would I get an Apple device when I can get a Linux device with some monster motherboard that has a dozen memory slots?
"Overall, my honest read: this feels like a human-written opinion piece (possibly AI-assisted for polish/editing, which is extremely common now), not a fully AI-generated article. The specific personal history ("I've been saying this in group chats for months"), the running joke about being right before everyone else, and the reader engagement in the comments (with the author replying) all point to a real person with a strong personality behind it — though I can't rule out that Claude or another model helped tighten the prose."
It is interesting that everyone was so very certain it was AI written. Just read your comment about it being Claude based, now I am trying to figure out if Claude is trying to recuse itself in some way by giving me those results.
Still feel like the point it interesting and going to keep diving into it and I am surprised it was flagged. May have to up my reading on Removals more and more.
Looks like Mac Minis had a 64 GB model (hard to get now) for roughly $1,600. You could get a 3 of these (192GB) & thanks to the Thunderbolt 5 connection, they out performed any single board AMD for a similar price that had more memory. If you tried to do so something similar with Nvidia GPU you're looking at a lot of watts, cooling & a much faster experience but only 48 GB of memory.
You can layer the LLMs across multiple GPUs, you can absolutely have 192gb of Nvidia dGPU memory with the right MOBO and CPU combo.
but of course author chose to use a.i to write this.
& bury very important points which are 1. Chinese Memory Manufacturers 2. Apple Unified Memory + their own chips which are a result of their 'car' effort.
Perhaps AI serves also as an attempt to reverse course on this: raise prices on general-purpose computing hardware (excluding phones, which are increasingly locked down) so that it becomes again inaccessible to consumers.
The way I see it, is that they missed the boat on how powerful those models will become meanwhile other players are integrating deeply into their ecosystem. It might go down as the fall of the empire similar to Nokia, Kodak etc. It is still too early to tell.
My comment won’t add anything to the discussion. As far as I know I have heard same idea * several times from George Hotz blog posts. I guess that’s what tiny corp wants to do.
Apple is not doing anything magical with hardware that other companies, including Nvidia, cannot do for roughly the same price/performance. The M series is amazing, but there are comparable products out there now. If you want to say eventually demand for Nvidia will fade because demand for training frontier models will decrease with time, fair, but that doesn’t suddenly make Apple the king of AI.
Also, for new better AI models to happen someone will need to train those new better models and that isn’t going to happen on 5000 Mac minis duct taped together.
The king of AI isn’t the shop with the biggest/bestest model, or whose machine has the bandwidth and unified memory.
It’s the company who has the trust of a massive number of users.
Apple was smart enough to give OpenAI the finger on deep integration, and focus on building out the part that everyone really wants.
Whoever provides the llm inference, do it with the privacy protection, and with access to the personal data you want AI to have access to, but without sacrificing the former. They’re literally the only company on earth in a position to do this.
We’ll see if they’re going to pull it off, very soon. If they have, they’ll have managed to negotiate and capitalize on this crazy hype cycle better than anyone, by far.
They could become the trusted gatekeeper of AI services, doing the one thing that none of the rest can ever do… and have done it without lighting trillions of dollars on fire fighting an unwinnable war.
This does really feel like the first milestone for voice assistants that are equivalent to talking to a human. Not suggesting it's perfect - but the tech is only going to improve from here.
It would be nonsense of course, but it’s a tale that seems to work for a significant number of readers here.
Plots with no axis labels or units displayed? In fact if you're literally just comparing two things, why not just write down the two numbers? Or better yet strengthen your argument by comparing more than just literally two options?
And the pictures. You seriously couldn't be bothered to just go find a picture of four Mac minis stacked on top of each other, and had to genai a picture of four vaguely-mac-mini-shaped blocks?