About how Google bot processing #robots.text

#robots #robotstxt