• blakestacey@awful.systems
    link
    fedilink
    English
    arrow-up
    22
    ·
    13 天前

    Paragraph 2:

    METR funded 16 experienced open-source developers with “moderate AI experience” to do what they do.

    • HedyL@awful.systems
      link
      fedilink
      English
      arrow-up
      28
      ·
      13 天前

      … and just a few paragraphs further down:

      The number of people tested in the study was n=16. That’s a small number. But it’s a lot better than the usual AI coding promotion, where n=1 ’cos it’s just one guy saying “I’m so much faster now, trust me bro. No, I didn’t measure it.”

      I wouldn’t call that “burying information”.