The site crawl offers us a prosperity of data, but to choose this audit to another level, we need to seek advice from the major search engines. However, search engines don't love to provide unrestricted use of their servers so we'll just need to accept the subsequent neatest thing: https://www.youtube.com/watch?v=EVeTP0aV8gY