unrobotstxt ~master (2020-07-03T06:00:54Z)
Dub
Repo
kHexDigits
unrobotstxt
Undocumented in source.
package @
safe
immutable
auto
kHexDigits
=
"0123456789ABCDEF"
;
Meta
Source
See Source File
unrobotstxt
modules
test
test_extra
classes
LongestMatchRobotsMatchStrategy
RobotsMatchStrategy
RobotsMatcher
RobotsParseHandler
functions
GetPathParamsQuery
Matches
MaybeEscapePattern
ParseRobotsTxt
emitKeyValueToHandler
equalsIgnoreAsciiCase
getKeyAndValueFrom
startsWithIgnoreCase
static functions
extractUserAgent
structs
ParsedRobotsKey
RobotsTxtParser
variables
kHexDigits