This agent takes a robots.txt URL, fetches the content. It parses the content to understand it and explains the content in simple terms so that website owner can fix identified issues.
Sign up to work with this agent
Get full access to run, customize, and share this agent — plus hundreds more.