GPU prices are coming to earth just as RAM costs shoot into the stratosphere
arstechnica.com
Some RAM kits are over three times as expensive as they were three months ago.
  • tal@lemmy.todayEnglish
    40·
    5 days ago

    GPU prices are coming to earth

    https://lemmy.today/post/42588975

    Nvidia reportedly no longer supplying VRAM to its GPU board partners in response to memory crunch — rumor claims vendors will only get the die, forced to source memory on their own

    If that’s true, I doubt that they’re going to be coming to earth for long.

    • panda_abyss@lemmy.caEnglish
      12·
      5 days ago

      I hope this is the beginning of the end for the cuda monopoly. I just want good gpgpu support for numerical code.

  • ffhein@lemmy.worldEnglish
    17·
    5 days ago

    … I was thinking about buying a 96GB DDR5 kit from the local computer store a few weeks ago, but wasn’t sure it was actually worth €700. Checked again now and the exact same product costs €1500. I guess that settles it, 32GB will have to be enough for the next couple of years then.

    • Holytimes@sh.itjust.worksEnglish
      86·
      5 days ago

      Iv come to learn over the years. If you want to buy computer parts just do it.

      Your actively stupid if you don’t cause some bigger idiot with more money then brains will make a new grift that causes everything to be unaffordable.

      Fuck waiting for deals, fuck thinking twice. Just fucking buy it and ignore reality around you cause you will be pissed either way.

      Either a deal comes and you fucked yourself, or everything goes to the moon and now you have nothing AND your fucked.

      • lemming741@lemmy.worldEnglish
        8·
        5 days ago

        Part of it the thrill of the hunt. I’ve caught some great deals over the years stalking marketplace.

        Got .iso storage after chia crashed
        Got a 3090 after Bitcoin asics took over
        Got a 5900x when the X3D parts came out

        But I’ve never seen decent RAM for sale, only single sticks or slow kits.

        • COASTER1921@lemmy.mlEnglish
          1·
          5 days ago

          I fully agree it’s worth waiting for the thrill of the deal.

          The Chia crash was great. A local dude I found on Facebook marketplace bought a whole array worth of drives and never got around to even opening the packages for them.

          I scored a great local deal on a PC last week, but unfortunately the only weak point of it is the 16GB of DDR5. So I guess for a while I’ll just be chilling with equal amounts of GPU and system memory. Luckily I’m not a gamer and rarely limited by the system memory.

      • ffhein@lemmy.worldEnglish
        1·
        4 days ago

        I just wanted to test if it was viable to run larger MoE LLMs on CPU, e.g. Qwen3-next-80B-A3B… Even if I got acceptable generation speeds I’d probably get bored with it after a few hours, as with other local models. Had I got it for €700 it was pretty low value for money anyway, since my current RAM is enough for everything else I use the computer for. On the positive side, I can put that money towards a Steam Frame instead.

  • krooklochurm@lemmy.caEnglish
    10·
    5 days ago

    So… the models are all trained up and now they need to run them is what I’m reading.

    You need lots of vram to train a model.

    An llm once trained can be run in much less vram and a lot of ram

  • w3dd1e@lemmy.zipEnglish
    9·
    5 days ago

    Buying used RAM on marketplace and hoping it isn’t broken. Hoping it was just stolen from a Best Buy. Fingers crossed y’all!

  • Two2Tango@lemmy.caEnglish
    3·
    4 days ago

    I just bought an Arc A310 for <$200. I couldn’t find a set of 16x2 DDR4 in stock for less than that on Black Friday… Wild times for the RAM market.