langbank / languages /

Robots Exclusion Rules

• detection recognise a file as this language
• comments strip comments without parsing
• facets know it hosts components or styles
• conventions find its tests and fixtures
• toolchain name a tool that handles it
• compiler build or run it
• analyser lint or format it
• ecosystem resolve its packages

id

robots-exclusion-rules

role

data

filenames

robots.txt