Source Package: perl-WWW-RobotRules (6.02-42.fc43)
Database of robots.txt-derived permissions
This module parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <https://www.robotstxt.org/robotstxt.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
Package information
- Homepage
- [https://metacpan.org/release/WWW-RobotRules]
- License
- GPL-1.0-or-later OR Artistic-1.0-Perl
- Downstream-Paketbetreuer
- jplesnik, mspacekObserved Nov 19, 2026 [source]
The following binary packages are built from this source package:
- perl-WWW-RobotRules
Database of robots.txt-derived permissions
- perl-WWW-RobotRules-tests
Tests for perl-WWW-RobotRules
