Between 2023 and 2024, robots.txt restrictions cut off about 5% or more of all tokens in C4 and 28% or more of its most actively maintained sources, and 45% of C4 was restricted by terms of service.
~5%+ of all tokens in C4, or 28%+ of the most actively maintained, critical sources; 45% of C4 (ToS)
Dated 20 Jul 2024Source checked 11 Oct 2026Quote found on its page again 16 Oct 2026Basis: stated
In the source's own words
“rendering ~5%+ of all tokens in C4, or 28%+ of the most actively maintained, critical sources in C4, fully restricted from use. For Terms of Service crawling restrictions, a full 45% of C4 is now restricted.”
Where it was read
What it is about
Figures it counts in
It is shown on its own, not counted into a figure.
Cited in these 2 guides