Google Clarified Support For Robots.txt Fields With Tiny Change

Google added eight or so words between brackets to clarify that fields that aren’t explicitly listed in the robots.txt documentation aren’t supported. Why did they do this? Because sometimes Google gets questions about it.

Leave a Reply

Your email address will not be published. Required fields are marked *

Microsoft is one of the major tech companies making huge investments in big data technology. Lorem ipsum has been the industry’s standard dummy text ever since the 1500s. Check official website.