When A.I.’s Output Is a Threat to A.I. Itself
www.nytimes.com
As A.I.-generated data becomes harder to detect, it’s increasingly likely to be ingested by future A.I., leading to worse results.
  • Admiral Patrick@dubvee.orgEnglish
    2·
    3 months ago

    My takeaway from this is:

    1. Get a bunch of AI-generated slop and put it in a bunch of individual .htm files on my webserver.
    2. When my bot user agent filter is invoked in Nginx, instead of returning 444 and closing the connection, return a random .htm of AI-generated slop (instead of serving the real content)
    3. Laugh as the LLMs eat their own shit
    4. ???
    5. Profit
    • mesamune@lemmy.worldEnglish
      1·
      3 months ago

      I might just do this. It would be fun to write a quick python script to automate this so that it keeps going forever. Just have a link that regens junk then have it go to another junk html file forever more.

  • gravitas_deficiency@sh.itjust.worksEnglish
    1·
    3 months ago

    Imo this is not a bad thing.

    All the big LLM players are staunchly against regulation; this is one of the outcomes of that. So, by all means, please continue building an ouroboros of nonsense. It’ll only make the regulations that eventually get applied to ML stricter and more incisive.

  • floofloof@lemmy.caEnglish
    1·
    2 months ago

    Maybe this will become a major driver for the improvement of AI watermarking and detection techniques. If AI companies want to continue sucking up the whole internet to train their models on, they’ll have to be able to filter out the AI-generated content.

    • silence7@slrpnk.netOPEnglish
      1·
      2 months ago

      “filter out” is an arms race, and watermarking has very real limitations when it comes to textual content.

      • floofloof@lemmy.caEnglish
        1·
        2 months ago

        I’m interested in this but not very familiar. Are the limitations to do with brittleness (not surviving minor edits) and the need for text to be long enough for statistical effects to become visible?

        • silence7@slrpnk.netOPEnglish
          2·
          2 months ago

          Yes — also non-native speakers of a language tend to follow similar word choice patterns as LLMs, which creates a whole set of false positives on detection.

  • Ekky@sopuli.xyzEnglish
    1·
    3 months ago

    So now LLM makers actually have to sanitize their datasets? The horror…

  • leftzero@lemmynsfw.comEnglish
    1·
    3 months ago

    Anyone old enough to have played with a photocopier as a kid could have told you this was going to happen.