RECENT POSTS

Rubygem-robots

May 26, 2018

Simple library to parse robots.txt files

Robots is a simple Ruby library to parse robots.txt files.

WWW https//github.com/fizx/robots