Gungho::Component::RobotRules::Storage - RobotRules Storage Base Class

Holds the actual storage backend

Gets a rule for a particular URL

Stores a rule for a particular URL

Returns a list of requests that were waiting for that particular robots.txt information

Adds a request to the list of requests waiting for a particular robots.txt information