• self@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    3 months ago

    there’s this type of reply guy on fedi lately who does the “well actually querying LLMs only happens in bursts and training is much more efficient than you’d think and nvidia says their gpus are energy-efficient” thing whenever the topic comes up

    and meanwhile a bunch of major companies have violated their climate pledges and say it’s due to AI, they’re planning power plants specifically for data centers expanded for the push into AI, and large GPUs are notoriously the part of a computer that consumes the most power and emits a ton of heat (which notoriously has to be cooled in a way that wastes and pollutes a fuckton of clean water)

    but the companies don’t publish smoking gun energy usage statistics on LLMs and generative AI specifically so who can say

    • GoTeamBoobies@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 months ago

      I joined the Microsoft climate solutions team, I think doing so has crushed all my hopes. That team is doing small things like “let’s all go plastic free for July!” Top 20 company in the world and the best we can do is go plastic free for a month? Meanwhile MSFT is not on course to meet their own climate goal by 2030