Bot vs human traffic
92 points
1 hour ago
| 20 comments
| radar.cloudflare.com
| HN
jawns
43 minutes ago
[-]
It's a silly metric. There could be only one master bot that pings every known endpoint multiple times a second, and that would probably surpass all human activity, too. It doesn't really tell us much about intention or the ability to masquerade as humans.

Where I would start to worry is if there's evidence that bot access patterns are starting to become harder to distinguish from human access patterns, which would suggest that they are, in fact, mimicking or masquerading as humans. I don't care how many search bots are indexing web content, but I do worry about how many social bots are attempting to manipulate or mislead people.

reply
al_borland
37 minutes ago
[-]
Looking at the verified bots section, all the top bots are web crawlers, which have been around for decades, to your point.
reply
01284a7e
27 minutes ago
[-]
Thales Bad Bot Report categorizes the traffic between "good" and "bad" bots.

I would add that AI dramatically blurs the line between legitimate and malicious, and the intent generally speaking.

In regards to social bots, there's a 2024 study of over 1 million accounts on X and over 60% were found likely to be bots. Curiously, when Musk took over Twitter, the "Blue Checkmark" became something that can be bought for several bucks a month (with crypto, even), without any sort of verification.

reply
RobRivera
26 minutes ago
[-]
>but I do worry about how many social bots are attempting to manipulate or mislead people.

You should browse reddit sometime. The easy ones to spot just autocreate accounts using the autoname at signup, which is of the formfactor [word1][word2]/d{4}

Regex nazis please spare me, I am doing my bestest

reply
ryanschaefer
58 minutes ago
[-]
“First time”

The graph seems like it only goes back to April 27 and on that day it was 57% bot…

reply
embedding-shape
48 minutes ago
[-]
Maybe "first time on a weekday"? Asit seems it's been above 60% every weekend since they started monitoring it.
reply
sheepscreek
49 minutes ago
[-]
I think it’s meant as “for the first time in history..”. Not today in particular, but as a milestone.
reply
jmaw
9 minutes ago
[-]
This feels like a vibe-coded dashboard that someone made just because they could and with AI it is much cheaper/quicker to create. But they didn't actually put too much thought into how it would/could actually be used. This doesn't really provide much value over "well that's kind of interesting to know". There aren't really actionable points that one can take from looking at these charts.

Some of my opinion above is formed from my own experience making similar charts just because I wonder what something would look like graphed out :)

reply
01284a7e
47 minutes ago
[-]
According to the Thales Bad Bot Report, in 2025 >53% of traffic came from bots. 2024 was 50 - 50, and in 2013, it was measured at 43%.

AI-driven* bot activity has increased more than tenfold however in the past 12 months so I'm confident this will grow to a very solid majority.

reply
pixelesque
41 minutes ago
[-]
> and in 2013, it was measured at 43%.

Do you mean 2013 or 2023?

reply
01284a7e
38 minutes ago
[-]
I mean, just for a reference point, 2013. 2013 was the first year they did the report.
reply
asdff
57 minutes ago
[-]
For the first time? No way. People were saying this 5, 10, 15+ years ago.
reply
tushar-r
42 minutes ago
[-]
I was tracking this as part of an older job and this has been the case for some years now - started around the Covid time with all the scalping bots etc and has just been building up.

This sorta mirrors the early-mid 2010's when people[1] were worried about how much of the internet was streaming traffic.

[1] Mostly ISP's annoyed at not being able to monetize it and folks trying to sell monetization solutions to them - https://www.sandvine.com/hubfs/Sandvine_Redesign_2019/Downlo...

reply
Shank
57 minutes ago
[-]
Automated systems that don’t sleep and are often programmed to aggressively scrape and are limited only by compute capacity outstripped humanity? I am not surprised by this at all.
reply
Waterluvian
52 minutes ago
[-]
We're the "retail users" of the Web.
reply
InfiniteVortex
59 minutes ago
[-]
Dead internet theory
reply
tonymet
42 minutes ago
[-]
what comes after death? more like dead -> dead -> dead internet
reply
nocman
38 minutes ago
[-]
It's been mostly dead all morning.
reply
conductr
43 minutes ago
[-]
Any thoughts on why ~30% of HTTP request are in US? I know we had first mover advantage for awhile but I'd expect this to have been diluted by larger populations by now. It doesn't appear to be AI/bot driven either.
reply
arbol
19 minutes ago
[-]
Is it not just a case of most of their clients being US based?
reply
yacin
35 minutes ago
[-]
my first guess would be a decent chunk of things bot operators want to scrape are in the US. might as well have your bot nearer to the source.
reply
giancarlostoro
31 minutes ago
[-]
Would love to see it go further back and some meaningful metric of how much is web scrapers vs bots.
reply
dietr1ch
28 minutes ago
[-]
Not shocking if CF is now trying really hard to keep me out of the internet
reply
0x59
30 minutes ago
[-]
CF posts metrics which reinforces their business... shocking
reply
Symbiote
22 minutes ago
[-]
It's not Cloudflare's title, the submitted invented it.
reply
0x59
15 minutes ago
[-]
Sorry for the confusion, I was pointing out that the submitter submitted something silly and not that CF is boosting its business.
reply
system2
11 minutes ago
[-]
Can bot traffic cause ad revenue to go up by any chance? Or false clicks that cost advertisers?
reply
vaylian
1 hour ago
[-]
Given how many rounds of captchas I have to fight through, I'm not sure if these numbers are accurate.
reply
asdff
42 minutes ago
[-]
Funny how I get captcha looped with my adblocking in firefox but you can just get through easily with a few puppeteer plugins controlling headless chrome.
reply
elaus
57 minutes ago
[-]
You have to fight, for some bots it might not be a real fight anymore...
reply
dawnerd
40 minutes ago
[-]
Trivial to bypass though, the big players just haven't gone that far yet.
reply
layer8
47 minutes ago
[-]
Captchas are part of the traffic. ;)
reply
layer8
48 minutes ago
[-]
Only for HTML content. Total traffic would have been surprising.
reply
giancarlostoro
59 minutes ago
[-]
Given how most of the internet is on mobile, I wonder how much that would skew this.
reply
EarlKing
56 minutes ago
[-]
If they were truly this accurate at identifying sources of bot traffic, you'd think they'd be better at blocking them without inconveniencing the rest of us.
reply
tonymet
43 minutes ago
[-]
OP: please add [2012] to the title
reply
vinyl7
34 minutes ago
[-]
I'm looking forward to the fraud lawsuites for ad companies
reply
deafpolygon
51 minutes ago
[-]
Dead internet theory gaining more credibility with every passing day.
reply