• @[email protected]
    link
    fedilink
    English
    43 months ago

    Isn’t there a way to limit requests so that traffic isn’t bringing down your servers

    • @[email protected]
      link
      fedilink
      English
      143 months ago

      They obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you

      • @[email protected]
        link
        fedilink
        English
        13 months ago

        the article told all source IPs can be tracked back to bytedance. Wouldn’t it be possible to block them? maybe even blocking all IPs of a specific ASN

        • @[email protected]
          link
          fedilink
          English
          2
          edit-2
          3 months ago

          They can be tracked back one by one but if you have any amount of traffic it’s a constant game of cat and mouse.

          You can block entire ASNs until they start using residential proxies provided by less ethical companies. Then you end up blocking all of France or destroying user experience by enforcing a captcha on everyone.

      • @[email protected]
        link
        fedilink
        English
        13 months ago

        Why do they need to hit a website like that? Wouldn’t it just need to scrape the data and frig off. What is the point of creating that much traffic