unrobotstxt ~master (2020-07-03T06:00:54Z)
Dub
Repo
Matches
unrobotstxt
Implements robots.txt pattern matching.
@
safe
pure
bool
Matches
(
string
path
,
string
pattern
)
Meta
Source
See Implementation
unrobotstxt
modules
test
test_extra
classes
LongestMatchRobotsMatchStrategy
RobotsMatchStrategy
RobotsMatcher
RobotsParseHandler
functions
GetPathParamsQuery
Matches
MaybeEscapePattern
ParseRobotsTxt
emitKeyValueToHandler
equalsIgnoreAsciiCase
getKeyAndValueFrom
startsWithIgnoreCase
static functions
extractUserAgent
structs
ParsedRobotsKey
RobotsTxtParser
variables
kHexDigits
Implements robots.txt pattern matching.