.Google.com limits robots.txt help to four industries, clarifying its own standpoint on in need of support directives.Google.com simply supports 4 details robots.txt industries.Unsupported instructions in robots.txt will be overlooked.Think about auditing your robots.txt documents taking into account this update.