Absolutely needed: to get high efficiency for this beast … as it gets better, we’ll become too dependent.

“all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,”

    • Bogasse@lemmy.ml
      link
      fedilink
      English
      arrow-up
      15
      ·
      2 months ago

      Yeah, I think there was some efforts, until we found out that adding billions of parameters to a model would allow both to write the useless part in emails that nobody reads and to strip out the useless part in emails that nobody reads.

  • Dr. Moose@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    arrow-down
    8
    ·
    2 months ago

    The energy issue almost feels like a red herring for distracting all idiots from actual AI problems and lemmy is just gobbling it up every day. It’s so tiring.

    • Phoenixz@lemmy.ca
      link
      fedilink
      English
      arrow-up
      48
      arrow-down
      2
      ·
      2 months ago

      That’s because it IS an issue, together with many other issues like disinformation, over reliance, wrong tools for wrong (most) jobs, etc.

      • REDACTED@infosec.pub
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        13
        ·
        2 months ago

        Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

        So how comes it is A issue for AI, but everyone seemingly has forgotten about crypto?

        Last I heard, securing one transaction on chain is equalivent to powering US household for many days (feel free to fact check). In comparison, generating LLM text for entire hour on your PC is pretty much the same as gaming for two hours (very approx., your gpu is unlikely at 100% load), which means gaming world is far more destructive energy wise. Are you getting triggered yet?

        • I Cast Fist@programming.dev
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          1
          ·
          1 month ago

          Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

          That’s because one has all the big tech companies madly rushing to implement it everywhere, while the other even Ubisoft has abandoned and is more or less stuck to their own cult

        • Decq@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          arrow-down
          1
          ·
          1 month ago

          What stone did you live under? The huge power consumption of crypto was often debated. You just don’t hear too much about it because people don’t really talk about crypto much anymore. Now it’s mostly just people pro crypto who discuss it. And obviously they tend to talk leas about the downsides.

          • Phoenixz@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 month ago

            Eh, that enormous energy consumption hasn’t change, y’know. For Bitcoin, for example, the basic concept is still that ALL wallets have to process ALL transactions, which scales as well as studfing a walrus in a mini Cooper. Bitcoin is extremely energy inefficient and is simply not a good replacement for transactions for the entire world.

            Same goes for all other block chain technologies, they’re fundamentally flawed and won’t ever be good. If you want a good alternative to visa and MasterCard, you’ll need something fundamentally different from blockchain tech.

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            6
            ·
            1 month ago

            … Oh, so so the terawatts of power wasted is no longer a problem because people don’t really speak of it anymore and cryptobros tried to debate it.

            If I’m living under a stone, you’re straight up stoned.

        • JackbyDev@programming.dev
          link
          fedilink
          English
          arrow-up
          7
          ·
          1 month ago

          Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

          I have both heard and said that crypto uses a lot of energy on Lemmy.

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            4
            ·
            edit-2
            1 month ago

            This? Hipster 4chan from everything I’ve seen. Altought nowadays 4chan tends to be less hateful/extreme, especially when it comes to calls for genocide/killings of Jews

        • Phoenixz@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 month ago

          You don’t hear so much about it because it has faded a bit into the background and crypto bros work hard spreading misinformation about how awesome Bitcoin is.

          Technically, blockchain tech is interesting, bit nothing more than that. Blockchain technology is fundamentally flawed. Requiring everyone to confirm the same transactions by having everyone make the same CPU / GPU / memory intensive calculations is just dumb and it won’t scale to anything that could sustain the daily transactions of even a single small country, let alone the world.

          At least AI has a whole lot of pieces that are fundamentally “useful”. As it currently stands, AI will need completely new concepts and technologies to be able to grow in capabilities and shrink in power requirements, but at least the prices that are there are reasonably useful.

          Blockchain technology is fundamentally flawed for just about any application at all.

          Having said all that, fuck AI companies. AI could be a great new tool for humanity but instead we hacet all sorts of shitty assistants being shoved down our throats. Oh, and AI revenge porn, that too

        • adr1an@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          4
          ·
          2 months ago

          That’s not true if you were to use off-chain transactions (i.e. lightning network)

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            2
            ·
            edit-2
            2 months ago

            “That’s not true”

            “But not true only if you use non-mainstream transaction method that was not part of the original design and is only supported by selected cryptos, meaning not universal”

            K

            I mean, don’t get me wrong, it’s nice that things are improving, but it’s safe to say that things will improve for AI too (energy-wise), hella lot of people now working on optimization and it looks very promising, even by just splitting large models into many smaller ones by topic

            • adr1an@programming.dev
              link
              fedilink
              English
              arrow-up
              6
              arrow-down
              1
              ·
              1 month ago

              I just wanted to clarify the confusion that was in my head for a moment after going after the truth and fact checking. If I buy a pizza with Bitcoin and Lightning Network (which is the only one in use at most legal places), it’s not like I’m using 1600 kWh… The original message is misleading in that regard… Practical and concrete reality are different. But theoretical, if that pizza wanted a normal transaction it would use such amount of energy and take days (that’s why they wouldn’t use that)… So… There’s that.

              Anyway, the dichotomy ‘AI or Crypto’ is false. I am not taking sides. But you do you, enjoy.

          • vrighter@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 month ago

            the ones that give up on all the “desirable” aspects of cryptocurrencies? The payment isn’t final until it is on chain. You don’t need to trust anyone to figure out if you’re on the right chain in the first place. Off-chain shit defeats this. What’s the point, other than dressing up the horse before beating it some more?

    • Quibblekrust@thelemmy.club
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      4
      ·
      edit-2
      2 months ago

      lemmy is just gobbling it up every day. It’s so tiring.

      Are you fucking serious? All I ever see on Lemmy is prople saying “AI slop” over and over and over and over again… in like every comment section of every post. It could be a picture that was actually hand-drawn, or a photograph that was definitely not AI, or articles written by someone “sounding like AI”. The AI hate on Lemmy is WAY overpowering any support.

    • kalkulat@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      Partly, yep. Seems like every time I try to pin down an AI on a detail of a question worth asking - a math question, or a date in history, it’ll confidently reply with the first answer it finds … right or wrong.

      • Dr. Moose@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I don’t think accuracy is an issue either. I’ve been on the web since inception and we always had a terribly inaccurate information landscape. It’s really about individual ability to put together found information to an accurate world model and LLMs is a tool just like any other.

        The real issues imo are effects on society be it information manipulation, breaking our education and workforce systems. But all of that is overshadowed by meme issues like energy use or inaccuracy as these are easy to understand for any person while sociology, politics and macro economics are really hard.

    • pdqcp@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 months ago

      It should be clarified that it’s 99.99% Bitcoin mining that’s wasting all that energy, any other crypto that still uses mining is basically irrelevant when compared to it

    • crystalmerchant@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      2 months ago

      Depends on the prompt, the model, the parameters, which DCs, time of day, location in the world, and other factors. They answer the question but there’s so many variables that can affect footprint (and big hyperscalers do not release this data so you have to under a lot)

    • OmgItBurns@discuss.online
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      2 months ago

      Nothing wrong with examining potential issues for emerging technology before they become actual issues.

      • Melvin_Ferd@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        5
        ·
        edit-2
        2 months ago

        For sure, and I agree. But that isn’t what happens around here. Instead we turn to panic rather than skepticism. We are cynical more than anything. And I don’t trust cynicism about topical subjects.

        This wasn’t well reasoned objectivism. It was journalist and artist fearing for their jobs about technology they don’t understand. They generate a lot of content to generate panic. The mob saw the panic and adopted it. You’re not a true lefty unless you accept that AI is some new danger to the threat of the lowly creative.

        • Feathercrown@lemmy.world
          cake
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 month ago

          Do you disagree that AI presents an existential threat to our current way of life, and that a new way of life may be worse, and that we should therefore plan ahead before plunging in?

          • Melvin_Ferd@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 month ago

            I’m going to ask you something and please think about it. I have a belief that media highlighted these dangers in the same way the right wing media highlighted the dangers of immigration. If I look at articles, the framework is the same. The details are different, but it’s the same scaffolding. That puts my hair up.

            So to answer your question, yes I think AI poses a danger. That doesn’t mean I don’t embrace it or look forward to it positively. I believe we need to push the other way. Embrace and seize it. Force awareness of it and force legislation or cultural views that puts it in a better place for these tools to remain open Source. We have to be the primary consumers to influence it.

      • technocrit@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        edit-2
        2 months ago

        They’re trying to compare “AI” to fire. If you don’t see the point, I can’t blame you.

  • notfromhere@lemmy.ml
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    42
    ·
    2 months ago

    At some point, someone said the same thing about:

    • electricity
    • books
    • cars
    • computers
    • medicine
    • houses

    Is this /c/technology or /c/anti_technology because it’s hard to tell most of the time.

    • yeahiknow3@lemmings.world
      link
      fedilink
      English
      arrow-up
      33
      arrow-down
      6
      ·
      2 months ago

      A better analogy for AI is the discovery of asbestos or the invention of single-use plastics. Terrible fucking idea.

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        3
        ·
        2 months ago

        I think it’s probably a bit early to tell for certain on that assessment. There is definitely pros and cons to all technology. Electricity production causes environmental damage, building wooden houses require logging. Plastics are a byproduct of a withering industry. Asbestos might have saved more lives than it took, but there were probably much better ways to solve fire resistant buildings.

        Why all these destructive things? Capitalism requires maximizing profits above all else. So, really the question is how will capitalism fuck us over with AI? So, so many ways. That’s why it’s important that we build community understanding of this technology in order to combat it. It’s not going away. It’s here to stay. So we either put our heads in the sand and pretend it’s not here or we can embrace it and learn how it works and how to defeat it and come up with open source tooling to combat it.

        I’m in the latter camp. I love technology breakthroughs and want to learn first hand the capabilities to understand how it will be used against me and how I can use it.

      • dust_accelerator@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        6
        ·
        2 months ago

        Well, it’s a bit better than that, simply because you can train AI with solar power. Probably nobody does that currently, as it’s easier, faster-to-market and probably (for whatever corrupt reason) cheaper for business to let it run on burning fossils/nuclear. Currently there’s an insane amount of waste, often 1000s of models are trained and only the best performing one is deployed - and then it’s just a fancy autocomplete. The better use is for prediction of material failure, new medicine and protein folding, generally improved processes.

        With asbestos you get some convenience, but it’ll be for eternity a pain to find a waste management facility that will accept it.

    • technocrit@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      edit-2
      2 months ago

      Cars are literally privileged garbage that’s destroying the planet. Great comparison on that one.

      Is this /c/technology or /c/anti_technology because it’s hard to tell most of the time.

      Well only one of those is allowed to exist so you figure it out.

      https://en.wikipedia.org/wiki/Scientism

    • madjo@feddit.nl
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      4
      ·
      2 months ago

      What benefit for society does this crop of large language models and generative “AI” offer?

      We already see students use it for homework, meaning they don’t learn their stuff.

      We also see people treat the output of LLMs as gospel truth, despite the fact that LLMs often hallucinate complete BS!

      LLMs and generative “AI” rely on stolen artwork. Which is a net negative for society.

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        Well for me, I enjoy pair programming my own projects with offline models. I also bounce ideas off it to attempt to ground myself in some type of reality (some models are better for this than others… probably has risk of delusions of grandeur. Some models will just verbally suck you off which is annoying).

        I built ansible tooling for deploying k3s kubernetes and Ceph-backed Proxmox clusters and VMs and containers and services. Utilized the help of LLMs to structure my playbooks and figure out how roles work.

        I love learning new things and LLMs have a lot to offer in that regard. You have to watch out for the bullshit and independently look at other sources as well, but it’s a great starting point and I can sometimes have sone deep conversations around some topics.

    • eleitl@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      2 months ago

      You might have heard of these fossil fuels we’re busily running out of. And fossil is still 80% of primary energy use so there is no renewable energy transition, and renewable infrastructure is being built almost exclusively using fossil fuels.

      So this means future energy rationing. What’s the business case for AI?

        • Melvin_Ferd@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          2 months ago

          Also telling me how to install arch Linux but sing it to me as a Kenny Loggins

          Verse 1 Reboot your rig and hit the USB, Boot it up live from the Arch IS-OOOHH-B! You’re in the zone now, terminal’s lit, You gotta ping that net and make sure it’s legit!

          (CHORUS) Highway to the Arch install, (Gonna fly into the…) Highway to the Arch install!


          Verse 2 Partition time with cfdisk — no fear, Format your root with mkfs.ext4 my dear. Mount it up with a little mount /dev/sdX, Now you’re rolling smooth, yeah you’re onto the next!

          (CHORUS) Highway to the Arch install, (Gonna fly into the…) Highway to the Arch install!


          Bridge Mirror, mirror, set 'em fast, reflector knows how to make that last. Then pacstrap /mnt base linux — so fly, Installin’ Arch, baby, you’re touching the sky!

          (Slow breakdown) genfstab, then chroot in, Now you’re living life like a power sysadmin…


          Final Chorus – belt it! Highway to the Arch install, You’re flying, configuring it aaaaall! Bootloader, locale, make that call — You’re livin’ the dream with no safety net at all!

          Highway… to the Arch install…

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        2 months ago

        Restricting our energy use is not a very good end game. We need to learn how to unlock more energy production without destruction of the environment. This will happen through technological development. Temporarily rationing or conservation may be needed, but permanent is not the answer.

          • notfromhere@lemmy.ml
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            2 months ago

            I’m not interested in books championing our reduction of human expansion. I want to see us reach out into the stars one day. Technological development and progress is needed. We need to also change our mindset on current systems. E.g., if it doesn’t maximize return on investment, forget about it. If there is a way to do it slightly cheaper even if it’s detrimental, do it cheaper. That mindset sucks.

            • eleitl@lemm.ee
              link
              fedilink
              English
              arrow-up
              1
              ·
              2 months ago

              Just develop fully autopoietic artificial photosynthetic systems. Piece of cake.

    • Melvin_Ferd@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      2 months ago

      When AI was getting popular, the media released an absolute war against it. A lot of us are swayed by what the media tell us

    • Engywook@lemm.ee
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      12
      ·
      edit-2
      2 months ago

      Is this /c/technology or /c/anti_technology because it’s hard to tell most of the time.

      People here are generally anti-anything. That’s what echo chambers are for.

      • technocrit@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        edit-2
        2 months ago

        It’s much better to be a critical thinker than mindlessly accepting whatever BS from some grifter just because it’s “accepted wisdom” in a completely brainwashed society.

        • Engywook@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          2 months ago

          I’m gladly you’re one of the few non-brainwashed humans on the Earth. So special!

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        2 months ago

        I am biased, I am having a ton of fun with LLMs and they are helping me achieve some personal goals. Do they use energy? Sure. Will new, more powerful technologies come along later that require even greater amounts of energy? I hope so one day. We need to find cleaner more abundant energy sources.

      • zerofk@lemm.ee
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        8
        ·
        2 months ago

        Sounds like most of Lemmy. Honestly sometimes I feel it’s worse than Reddit with the constant bashing on anything except Linux, Firefox, or - for some reason - Steam. Still glad I left Reddit though.

        • Engywook@lemm.ee
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          4
          ·
          edit-2
          2 months ago

          I didn’t leave reddit, because I consider useful the subs I use (mostly technical stuff). And yes, you’re right about the constant bashing on anything out of the herd mentality.

        • taladar@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          2 months ago

          Nuclear power seems to be one of those things that are anything but bashed here but instead gets treated with an almost worship-like reverence.