• Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    2
    ·
    edit-2
    4 hours ago

    I did some quick math with metas llama model and the training cost was about a flight to Europe worth of energy, not a lot when you take in the amount of people that use it compared to the flight.

    Whatever you’re imagining as the impact, it’s probably a lot less. AI is much closer to video games then things that are actually a problem for the environment like cars, planes, deep sea fishing, mining, etc. The impact is virtually zero if we had a proper grid based on renewable.

    • Damage@feddit.it
      link
      fedilink
      English
      arrow-up
      27
      arrow-down
      1
      ·
      4 hours ago

      If their energy consumption actually was so small, why are they seeking to use nuclear reactors to power data centres now?

      • null@lemmy.nullspace.lol
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        54 minutes ago

        Because demand for data centers is rising, with AI as just one of many reasons.

        But that’s not as flashy as telling people it takes the energy of a small country to make a picture of a cat.

        Also interesting that we’re ignoring something here – big tech is chasing cheap sources of clean energy. Don’t we want cheap, clean energy?

      • finitebanjo@piefed.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        1 hour ago

        Because the training has diminishing returns, meaning the small improvements between (for example purposes) GPT 3 and 4 will need exponentially more power to have the same effect on GPT 5. In 2022 and 2023 OpenAI and DeepMind both predicted that reaching human accuracy could never be done, the latter concluding even with infinite power.

        So in order to get as close as possible then in the future they will need to get as much power as possible. Academic papers outline it as the one true bottleneck.

      • Imacat@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        1
        ·
        1 hour ago

        To be fair, nuclear power is cool as fuck and would reduce the carbon footprint of all sorts of bullshit.

      • Armok_the_bunny@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        4 hours ago

        Volume of requests and power consumption requirements unrelated to requests made, at least I have to assume. Certainly doesn’t help that google has forced me to make a request to their ai every time I run a standard search.

        • Rentlar@lemmy.ca
          link
          fedilink
          English
          arrow-up
          8
          ·
          3 hours ago

          Seriously. I’d be somewhat less concerned about the impact if it was only voluntarily used. Instead, AI is compulsively shoved in every nook and cranny of digital product simply to justify its own existence.

          The power requirement for training is ongoing, since mere days after Sam Altman released a very underehelming GPT-5, he begins hyping up the next one.

    • taiyang@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 hours ago

      I usually liken it to video games, ya. Is it worse that nothing? Sure, but that flight or road trip, etc, is a bigger concern. Not to mention even before AI we’ve had industrial usage of energy and water usage that isn’t sustainable… almonds in CA alone are a bigger problem than AI, for instance.

      Not that I’m pro-AI cause it’s a huge headache from so many other perspectives, but the environmental argument isn’t enough. Corpo greed is probably the biggest argument against it, imo.