RECENT POSTS

P5-html-robotsmeta

May 26, 2018

Parse HTML For Robots Exclusion META Markup

HTMLRobotsMETA is a simple HTMLParser subclass that extracts robots exclusion information from meta tags.

WWW http//search.cpan.org/dist/HTML-RobotsMETA/