3. Conclusions

Diese Seite fasst den entsprechenden Abschnitt von RFC 9969 zusammen und bewahrt wichtige Begriffe, Daten und RFC-Verweise.

Participants generally agreed that the ecosystem is not sustainable on its current path. One participant said, "robots.txt is broken and we broke it".

Legal uncertainty and fundamental limits of opt-out regimes constrain any technical solution. The system is unlike traditional robots.txt, where content owners and crawlers often had a symbiotic relationship, and unlike copyright, where the default is effectively opt-in rather than opt-out.

The workshop nevertheless ended with general agreement that positive steps can improve communication of preferences from content owners for AI use cases. Discovery from multiple attachment mechanisms is necessary, and defining how those mechanisms combine is important.