themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · edit-28 hours agoChatGPT's new browser has potential, if you're willing to paywww.bbc.comexternal-linkmessage-square21fedilinkarrow-up17arrow-down194file-text
arrow-up1-87arrow-down1external-linkChatGPT's new browser has potential, if you're willing to paywww.bbc.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · edit-28 hours agomessage-square21fedilinkfile-text
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-24 hours ago I have access to GLM 4.6 through a service but that’s the ~350B parameter model and I’m pretty sure that’s not what you’re running at home. It is. I’m running this model, with hybrid CPU+GPU inference, specifically: https://huggingface.co/Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF You can likely run GLM Air on your 3060 desktop if you have 48GB+ RAM, or a smaller MoE easily. Heck. I’ll make a quant just for you, if you want. Depending on the use case, I’d recommend ERNIE 4.5 21B (or 28B for vision) on your Macbook, or a Qwen 30B variant. Look for DWQ MLX quants, specifically: https://huggingface.co/models?sort=modified&search=dwq
minus-squareMagicShel@lemmy.ziplinkfedilinkEnglisharrow-up1·4 hours agoI’m going to upgrade my ram shortly because I found a bad stick and I’m down to 16GB currently. I’ll see if I can swing that order this weekend.
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up2·edit-23 hours agoTo what? 64G would be good, as that’s enough to fit GLM Air. There are some good 2x64GB 6000Mhz kits for 128GB as well.
minus-squareMagicShel@lemmy.ziplinkfedilinkEnglisharrow-up1·2 hours agoI’ll see about 128, then, but I’ll probably do 64. Just depends on cost. Any recs?
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·edit-259 minutes agoFor DDR5? Depends how much you care about latency: https://pcpartpicker.com/products/memory/#ff=ddr5&Z=131072002&B=1000000000%2C1250000000&sort=price&page=1 The $342 Crucial kit is kinda a no-brainer for 128. Its timings aren’t great when overclocked, but it’s 5600 MHz out of the box, low voltage, and significantly cheaper per gigabyte than many 64GB/96GB kits. See for yourself: https://www.igorslab.de/en/when-size-is-all-that-matters-crucial-2x-64-gb-ddr5-5600-kit-with-new-micron-32-gbit-ics-in-test-incl-gaming-and-overclocking/4/ The overclockability matters even less if you are on a 7000 series CPU. I got the 1.25V Flare X5 kit because I wanted tighter timings for sim games, albeit at a MUCH lower price ($390) than it is now. RAM prices seem to be rising (hence the price of my kit spiked by $200), so now is not a bad time to buy.
It is. I’m running this model, with hybrid CPU+GPU inference, specifically: https://huggingface.co/Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF
You can likely run GLM Air on your 3060 desktop if you have 48GB+ RAM, or a smaller MoE easily. Heck. I’ll make a quant just for you, if you want.
Depending on the use case, I’d recommend ERNIE 4.5 21B (or 28B for vision) on your Macbook, or a Qwen 30B variant. Look for DWQ MLX quants, specifically: https://huggingface.co/models?sort=modified&search=dwq
I’m going to upgrade my ram shortly because I found a bad stick and I’m down to 16GB currently. I’ll see if I can swing that order this weekend.
To what?
64G would be good, as that’s enough to fit GLM Air. There are some good 2x64GB 6000Mhz kits for 128GB as well.
I’ll see about 128, then, but I’ll probably do 64. Just depends on cost. Any recs?
For DDR5? Depends how much you care about latency:
https://pcpartpicker.com/products/memory/#ff=ddr5&Z=131072002&B=1000000000%2C1250000000&sort=price&page=1
The $342 Crucial kit is kinda a no-brainer for 128. Its timings aren’t great when overclocked, but it’s 5600 MHz out of the box, low voltage, and significantly cheaper per gigabyte than many 64GB/96GB kits. See for yourself:
https://www.igorslab.de/en/when-size-is-all-that-matters-crucial-2x-64-gb-ddr5-5600-kit-with-new-micron-32-gbit-ics-in-test-incl-gaming-and-overclocking/4/
The overclockability matters even less if you are on a 7000 series CPU.
I got the 1.25V Flare X5 kit because I wanted tighter timings for sim games, albeit at a MUCH lower price ($390) than it is now.
RAM prices seem to be rising (hence the price of my kit spiked by $200), so now is not a bad time to buy.
deleted by creator