Redirection detection

Wed, 08 Jul 2015 00:00:00 +0200
Computers/Internet/Searching/Search_Engines

We have added a redirection detector when you add a new website to your account. In the past we have had some questions from users who created a new account and added a site like http://freesitemapgenerator.com/. This website was actually a redirect to https://www.freesitemapgenerator.com/ and our spider sees this as two different websites. The sitemap for freesitemapgenerator.com would then be empty: all links to https://www.freesitemapgenerator.com/ are considered to be external links.

If you now add a new website we will fetch the homepage automatically and see if it this is a redirect. If it is we will follow the redirect and store the new url in our database. In the use case mentioned above, the URL stored in our database would have been https://www.freesitemapgenerator.com/ and we think that is exactly what this user was requesting.

This feature will not affect existing entries: the filter is applied only when adding a new account or new site. Your feedback is, as always, highly appreciated and will help us to improve our ability to serve you and other users of our web sites.