RobotsMatcher.disallow_ignore_global

Returns true if we are disallowed from crawling a matching URI. Ignores any rules specified for the default user agent, and bases its results only on the specified user agents.

class RobotsMatcher
const
bool
disallow_ignore_global
()

Meta