unrobotstxt.test_extra

Members

Functions

testGetKV

bool testGetKV(string ex_key, string ex_value, string line)

Undocumented in source. Be warned that the author may not have intended to support it.

• test
• test_extra

• LongestMatchRobotsMatchStrategy
• RobotsMatchStrategy
• RobotsMatcher
• RobotsParseHandler

• GetPathParamsQuery
• Matches
• MaybeEscapePattern
• ParseRobotsTxt
• emitKeyValueToHandler
• equalsIgnoreAsciiCase
• getKeyAndValueFrom
• startsWithIgnoreCase

• extractUserAgent

• ParsedRobotsKey
• RobotsTxtParser

• kHexDigits