TikTok’s parent launched a web scraper that's gobbling up the world’s online data 25-times faster than OpenAI
fortune.com
The crawler, dubbed Bytespider, is scraping the internet at 3,000 times the rate of other genAI tools like Anthropic.
  • DrunemetonEnglish
    4•3 months ago

    I think that’s the “25-times faster” bit. They seem to be in a hurry to collect as much human-generated data as possible.

    • GHiLAEnglish
      4•3 months ago

      How does it know what is and isn’t?

      Uh oh.

      • DrunemetonEnglish
        5•3 months ago

        Yeah…

        Hey! Perhaps they’ll use A.I. to weed out the A.I. generated bits.

      • JackbyDevEnglish
        1•3 months ago

        I mean, if I could theoretically take a snapshot of the entire Internet I’d rather do it now than later because there’s just gonna be more AI later.