FreeBSD.software
Home/www/rubygem-robots

rubygem-robots

0.10.1_1

Simple library to parse robots.txt files

Robots is a simple Ruby library to parse robots.txt files.

Origin: www/rubygem-robots
Category: www
Size: 23.2KiB
License: MIT
Maintainer: sunpoet@FreeBSD.org
Dependencies: 2 packages
Required by: 0 packages
Website: github.com/fizx/robots
$pkg install rubygem-robots

Dependencies (2)

ruby33-gemsruby

More in www

py311-requests2.32.5
Python HTTP for Humans
p5-libwww6.81
Perl5 library for WWW access
p5-HTML-Parser3.83
Perl5 module for parsing HTML documents
php84-session8.4.16
The session shared extension for php
p5-Catalyst-Runtime5.90132_1
Elegant MVC Web Application Framework (Runtime)
py311-django424.2.29
High-level Python Web Framework
apache242.4.66
Version 2.4.x of Apache web server
p5-HTTP-Message7.01
Representation of HTTP style messages
p5-Template-Toolkit3.102
Extensible template processing system
p5-Plack1.0051
Perl extension of PSGI reference implementation and utilities