Sources / Research and analysis

arXiv, Consent in Crisis: The Rapid Decline of the AI Data Commons

1 record was read from this source, dated 20 Jul 2024.

Its permanent copy is being made in the Wayback Machine.

Last checked 11 Oct 2026

What was read from it

Records read from this source
Record	Kind	As stated	Dated
Between 2023 and 2024, robots.txt restrictions cut off about 5% or more of all tokens in C4 and 28% or more of its most actively maintained sources, and 45% of C4 was restricted by terms of service.	Supply fact	~5%+ of all tokens in C4, or 28%+ of the most actively maintained, critical sources; 45%…	20 Jul 2024