Pull Blog URLs from a Site

Who needs Screaming Frog when you can go to Agent.ai? This agent finds all blog URLs on a given domain. Input: the domain + blog path (optional) Output: a copyable table containing all URLs Notes: 1. Adding a blog path (like `/blog/`) helps speed up the script, but isn't needed. It works with or without backslashes. 2. If path isn't specified, it will return pages with the following paths - 'blog', 'article', 'post', 'blogs', 'articles', 'posts', 'resources', 'resource' 3. The tool is specifically built for relatively-static sites, like company domains. It does not work for sites with a lot of dynamic or USG content, like social networks / news / etc. 4. Some sites block bots using CDNs like Cloudflare. Not much we can do there. 5. Make sure to add suffixes as needed (like blog.nyckel.com vs just nyckel.com).