RobotsMatcher.OneAgentAllowedByRobots

Do robots check for 'url' when there is only one user agent. 'url' must be %-encoded according to RFC3986.

class RobotsMatcher

bool

OneAgentAllowedByRobots

(

string robots_txt

,

string user_agent

,

string url

)

Meta

Source

See Implementation