Source link : https://tech365.info/dev-runs-data-center-ai-mannequin-on-macbook-and-it-adjustments-all-the-things/
Over the previous few years, the substitute intelligence race seemed like a narrative about infrastructure. Which firm can construct the most important, most power-hungry knowledge middle, inventory it with probably the most Nvidia GPUs and spend probably the most cash? OpenAI, Amazon, Google, xAI — they’re all in a contest to construct industrial-scale computing factories simply to run probably the most highly effective AI fashions. But it surely appears like developer Dan Woods simply upended that story by operating a data-center AI mannequin on MacBook.
And that would imply Apple wins the AI race in any case.
Developer runs data-center AI mannequin on MacBook
Woods introduced on X this week that he managed to get Qwen3.5-397B — a cutting-edge “frontier” AI mannequin that usually requires a server rack full of specialised {hardware} — operating on a 48GB MacBook Professional with an M3 Max chip. The mannequin takes up 209GB (120GB when compressed) on disk, far exceeding what any laptop computer might maintain in working reminiscence. But Woods bought it operating at over 5.5 tokens per second. That’s fairly a stunning accomplishment with a shopper laptop computer — particularly one from an organization with a popularity for citing the rear on AI improvement.
To grasp why that is outstanding, some context helps. Frontier AI fashions — the category of fashions that powers ChatGPT, Claude and Gemini at their most succesful — are sometimes huge….
—-
Author : tech365
Publish date : 2026-03-19 15:19:00
Copyright for syndicated content belongs to the linked Source.
—-
1 – 2 – 3 – 4 – 5 – 6 – 7 – 8