• The BIND DNS server has already been deprecated and removed from Plesk for Windows.
    If a Plesk for Windows server is still using BIND, the upgrade to Plesk Obsidian 18.0.70 will be unavailable until the administrator switches the DNS server to Microsoft DNS. We strongly recommend transitioning to Microsoft DNS within the next 6 weeks, before the Plesk 18.0.70 release.
  • The Horde component is removed from Plesk Installer. We recommend switching to another webmail software supported in Plesk.

search engines getting a 404 when trying to crawl domain

B

butler

Guest
Hi

When I submit all the domains on my server to the search engines, they are getting a 404 return.

however if I submit using the ip, they pull up index page with no problem

it's like something is blocking the search engine crawler,

I can pull the domain up in a browser window by typing in the url with no problem

I have talked to the tech's at the company where my deicated server is, but they dismiss me when I say the word search engine. All they can think is I want them to tell me how to get a listing.

I have tried to explain it, but it's like going against a wall.

Please help, or if you need more information, please let me know

Wlee
 
It sounds like your search engine does not support HTTP1.1 (i.e. does not send Host: header with the request). All major search engines do have such support. Which one are you trying to use? Check their FAQ or ask their support if they do.

If they don't, all you can do is to use one dedicated IP per each your site.
 
Yes, additional JavaScript may fool some search engines too. You should disable @domains feature by unchecking "enable [email protected] access format" checkbox then.
 
Back
Top