• 3 Posts
  • 24 Comments
Joined 2 years ago
cake
Cake day: June 19th, 2023

help-circle

  • Had to look up Chat GPT’s energy usage because you made me curious.

    Seems like Open AI claims Chat GPT 4o uses about 0.34 Wh per “query.” This is apparently consistent with third party estimates. The average Google search is about 0.03 Wh, for reference.

    Issue is, “query” isn’t defined, and it’s possible this figure is the energy consumption of the GPUs alone, omitting additional sources that comprise the full picture (energy conversion loss, cooling, infrastructure, etc.). It’s also unclear if this figure was obtained during model training, or during normal use.

    I also briefly saw that Chat GPT 5 uses between 18-40 Wh per query, so 100x more than GPT 4o. The OP used GPT 5.

    It sounds like the energy consumption is relatively bad no matter how it’s spun, but consider that it replaces other forms of compute and reduces workload for people, and the net energy tradeoff may not be that bad. Consider the task from the OP - how much longer/how many more people would it take to accomplish the same result that GPT 5 and the lone author accomplished? I bet the net energy difference isn’t that far from zero.

    Here’s the article I found: https://towardsdatascience.com/lets-analyze-openais-claims-about-chatgpt-energy-use/



  • This article essentually summarizes a report from China but doesn’t give the report’s title, authors, or web link. This whole article is hearsay without providing the source material.

    Also, why does it read like it was written by a middle schooler with zero technical understanding? You’d expect better quality from a website named “Interesting Engineering.”

    “They send out photons whose quantum properties changes once they hit the stealth aircraft. This means that even the false signals generated by the aircraft would not be able to match the properties of the photons emitted by quantum radars.”

    Like, what does that even mean? I would check the source material, but I can’t because we’re not told what it is.

    Is all journalism this bad these days?