Page 1 of 1

Redirection Detection

Posted: Wed Jul 08, 2015 1:55 pm
by michael
We have added a redirection detector when you add a new website to your account. In the past we have had some questions from users who created a new account and added a site like http://freesitemapgenerator.com/. This website was actually a redirect to https://www.freesitemapgenerator.com/ and our spider sees this as two different websites. The sitemap for freesitemapgenerator.com would then be empty: all links to https://www.freesitemapgenerator.com/ are considered to be external links.

If you now add a new website we will fetch the homepage automatically and see if it this is a redirect. If it is we will follow the redirect and store the new url in our database. In the use case mentioned above, the URL stored in our database would have been https://www.freesitemapgenerator.com/ and we think that is exactly what this user was requesting.

This feature will not affect existing entries: the filter is applied only when adding a new account or new site. Your feedback is, as always, highly appreciated and will help us to improve our ability to serve you and other users of our web sites