A RobotsMatchStrategy defines a strategy for matching individual lines in a
robots.txt file. Each Match* method should return a match priority, which is
interpreted as:
match priority < 0:
No match.
match priority == 0:
Match, but treat it as if matched an empty pattern.
A RobotsMatchStrategy defines a strategy for matching individual lines in a robots.txt file. Each Match* method should return a match priority, which is interpreted as:
match priority < 0: No match.
match priority == 0: Match, but treat it as if matched an empty pattern.
match priority > 0: Match.