HTML::RobotsMETA::Rules - A Representation Of Robots Exclusion Rules

  $rules = $p->parse_rules($html);
  $bool  = $rules->can_index();
  $bool  = $rules->can_follow();
  $bool  = $rules->can_archive();
  $bool  = $rules->can_serve();
  $bool  = $rules->can_imageindex();
  $bool  = $rules->can_imageclick();

HTML::RobotsMETA::Rules represents the robots exclusion policies that are described within HTML META tags.