Domains work after migration but HTTP Request and Response Heade pulling default page

Neil1983 · Sep 18, 2014

Hi,

I have successfully migrated from my old plesk 11 server to plesk 12.0.18 on a brand new centos 6.5 dedicated server.

All my websites work correctly, I can visit the sites via www.example.com or http://example.com however my search engine rankings seem to have dropped significantly and when I do a search on web-sniffer.net or any equivalent site, the html content (see below) is displayed as my default plesk page.

This is even the case if someone attempts to share the website through facebook, facebook pulls a thumbnail of the plesk default page instead of my website.

I had a look and the vhost.conf file is missing from /var/www/system/example.com/conf/. I'm not sure if this is effecting it?

Any help would be hugely appreciated, i've searched and tinkered all day but to no avail.

Thanks in advance,

Neil

erver: nginx
Date: Thu, 18 Sep 2014 23:24:15 GMT
Content-Type: text/html
Content-Length: 7156
Connection: close
Last-Modified: Thu, 18 Sep 2014 17:34:36 GMT
ETag: "2069c-1bf4-5035a6600db8e"
Accept-Ranges: bytes
X-Powered-By: PleskLin
Content (6.99 KiB)

<!DOCTYPE html>




<html class="" lang="en">
<head>
<meta name='copyright' content='Copyright 1999-2014. Parallels IP Holdings GmbH. All Rights Reserved.'>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta http-equiv="Cache-Control" content="no-cache">
<title>Default Parallels Plesk Page</title>
<link rel="shortcut icon" href="favicon.ico">
<link rel="stylesheet" href="css/style.css">
</head>
<body>
<div id="page">
<div id="wrapper">

<div id="top">
<div class="header">
<div class="header-wrapper">
<a class="product-logo" href="http://www.parallels.com/products/panel/intro"><img src="./img/panel-logo.png" alt="Parallels Plesk"></a>
<a class="company-logo" href="http://www.parallels.com"><img src="./img/parallels-logo.png" alt="Parallels"></a>
</div>
</div>
</div> 

<div id="content">

<div class="p-box p-box-page-info">
<div class="p-box-wrap">
<div class="p-box-title">
<div class="p-box-title-wrap">
<h1>Web Server's Default Page</h1>
</div>
</div>
<div class="p-box-content">
<div class="p-box-content-wrap">
<p>This page is generated by <a href="http://www.parallels.com/products/panel/intro">Parallels Plesk</a>, the leading hosting automation software. You see this page because there is no Web site at this address.</p>
<p>You can do the following:</p>
<ul>
<li>Create domains and set up Web hosting using Parallels Plesk.</li>
</ul>
</div>
</div>
</div>
</div>

<div class="grid">
<div class="g-span g-span-1-2">
<div class="g-span-wrap g-span-1-2-wrap">

<div class="p-box p-box-company-info">
<div class="p-box-wrap">
<div class="p-box-title">
<div class="p-box-title-wrap">
<h2>New to <a href="http://www.parallels.com/intro">Parallels</a>?</h2>
</div>
</div>
<div class="p-box-content">
<div class="p-box-content-wrap">
<p>Parallels is a worldwide leader in virtualization and automation software that optimizes computing for consumers, businesses, and Cloud services providers across all major hardware, operating systems, and virtualization platforms.</p>
<p>For the Cloud, Parallels automation and virtualization software enables cloud services providers to rapidly and profitably deliver the widest range of cloud services that small businesses want and need. Our software includes key building blocks of cloud service delivery - self service control panels, billing, cloud service provisioning and virtualization. We enable the delivery of all types of services that small businesses need - shared web hosting and web applications, messaging and collaboration services, virtualized infrastructure services and thousands of other applications.</p>
<p>Our Automation products allow businesses to optimize their systems to maximize profit. Our Virtualization products allow personal computers to run several operating systems on one computer (like OSX and Windows) and for individual servers to function like many servers at once for creating cloud computing environments.</p>
<p>This website was created using our Parallels Plesk product. We offer a full line of Billing, Sitebuilder and cloud computing tools. Please visit <a href="http://www.parallels.com/intro">www.parallels.com</a> to find out more information.</p>
</div>
</div>
</div>
</div>

</div>
</div>
<div class="g-span g-span-2-2">
<div class="g-span-wrap g-span-2-2-wrap">

<div class="p-box p-box-consumer-products">
<div class="p-box-wrap">
<div class="p-box-title">
<div class="p-box-title-wrap">
<h2>Consumer Products</h2>
</div>
</div>
<div class="p-box-content">
<div class="p-box-content-wrap grid">
<div class="g-span g-span-1-2">
<div class="g-span-wrap g-span-1-2-wrap">
<h3><a href="http://www.parallels.com/products/desktop/intro">Parallels® Desktop<br> for Mac</a></h3>
<a href="http://www.parallels.com/products/desktop/intro"><img src="img/apps/pd-box.gif" alt="Parallels® Desktop for Mac"></a>
The best solution for running Windows, Linux, or any of many other operating systems alongside OS X.
</div>
</div>
<div class="g-span g-span-2-2">
<div class="g-span-wrap g-span-2-2-wrap">
<h3><a href="http://www.parallels.com/products/desktop/pd4wl/intro">Parallels® Desktop for<br />Windows and Linux</a></h3>
<a href="http://www.parallels.com/products/desktop/pd4wl/intro"><img src="img/apps/pdfwl-box.gif" alt="Parallels® Desktop for Windows and Linux"></a>
Simultaneously run multiple operating systems on your PC
</div>
</div>
</div>
</div>
</div>
</div>

<div class="p-box p-box-consumer-products">
<div class="p-box-wrap">
<div class="p-box-title">
<div class="p-box-title-wrap">
<h2>Service Provider Products</h2>
</div>
</div>
<div class="p-box-content">
<div class="p-box-content-wrap grid">
<div class="g-span g-span-1-2">
<div class="g-span-wrap g-span-1-2-wrap">
<h3><a href="http://www.parallels.com/products/automation/intro">Parallels® Automation</a></h3>
<a href="http://www.parallels.com/products/automation/intro"><img src="img/apps/poa-box.gif" alt="Parallels® Automation"></a>
Hosting, SaaS, and cloud computing automation solution.
</div>
</div>
<div class="g-span g-span-2-2">
<div class="g-span-wrap g-span-2-2-wrap">
<h3><a href="http://www.parallels.com/products/panel/intro">Parallels® Plesk</a></h3>
<a href="http://www.parallels.com/products/panel/intro"><img src="img/apps/pcp-box.gif" alt="Parallels® Panel"></a>
The Best Control Panel Ever For Easy, Complete and Profitable Hosting
</div>
</div>
</div>
</div>
</div>
</div>

</div>
</div>

</div>

</div> 
</div>
</div>

<div id="footer-wrapper">
<div id="footer">
This page was generated by <a href="http://www.parallels.com/products/panel/intro">Parallels Plesk</a> <span class="separator"> </span> <a class="copyright" href="http://www.parallels.com">© 1999-2014. Parallels IP Holdings GmbH. All rights reserved.</a>
</div>
</div>

</body>
</html>

Neil1983 · Sep 19, 2014

Any suggestions, anything at all would be really appreciated! Pleaaaaaaaaaaaaaaaaaaase help me.

Thanks again!

daniiii_e · Sep 19, 2014

Do you use a virtualization?

I had the same issue.
After changing the virtual ip addresses to public ip it works

Neil1983 · Sep 20, 2014

daniiii_e said:
Do you use a virtualization?

I had the same issue.
After changing the virtual ip addresses to public ip it works

Hi Daniiii_e, thank you for your reply, unfortunately I don't use virtualization so that can't be it

UFHH01 · Sep 20, 2014

First of all, if you don't need the default Plesk page ( which is generated, when you add a new domain into Plesk ), please rename the file or delete it... if you have other content which you put into /httpdocs there is no need to keep this page in the docroot.

Second, there are directions that tell a browser ( or any other client/bot/script ), which sort of file extension should it be looking for, when it first visits the URL http://www.example.com or https://www.example.com . If this is set to the standard configuration of nginx:

Code:

location ~ /$ {
	index index.html index.htm index.php index.cgi index.xhtml index.shtml index.pl;
	try_files $uri $uri/ /index.php?$args;
}

... you tell them, that they should first look for any file named in this order. Let's say you have several INDEX - sites, with the name "index.html", "index.htm", "index.php", then we get directed to these sites in this specific order, because your webserver tells us to do that, as you can see in the standard order above. So if just "index.php" is your real content, make sure, to erase or rename ( index.html.fromplesk ) all other files with the name "index" in a document root.

Neil1983 · Sep 21, 2014

Hi UFHH01,

Thank you for your reply.

Unfortunately this is not the case, I deleted all the plesk default files from my domains a long time ago. The only files within the httpdocs folder are the current website files, of which one is index.php.

I am wondering if nginx is not correctly configured. Do you know where I can check the options for default directory settings for nginx? Currently all my websites work correctly it is just when they are crawled by bots they bring up the plesk default page.

Thanks again for all your help.

Neil

UFHH01 · Sep 21, 2014

There is a quite new Plesk Extension, which is free, called "Webserver Configurations Troubleshooter". It does pretty much the same as the "httpdmng", which you probably might know. You can rebuild any configuration with just a click. ^^

Start - Modules/Extensions - Webserver Configurations Troubleshooter

If you don't already installed this extension, please get it by visting the site: [url]https://YOURSERVERDOMAINNAME.COM:8443/admin/update/add-components/[/URL] - under "Additional Plesk extensions" you find "Plesk Webserver Configurations Troubleshooter extension".

If you have problems, using the new extension, you could read the KB - article ( Plesk Webserver Configuration Troubleshooter ( KB 115587 ) ) or you could open another thread with your description and problems.

Neil1983 · Sep 21, 2014

Hi UFHH01,

Thanks again for your reply. I discovered the webserver configurations troubleshooter earlier today. I ran a check and everything is fine on there, I rebuilt all the records anyway but nothing has changed.

I just can't understand why facebook and any of the domain tools sites seem to scrape my parallel plesk default page instead of my domains. All the domains are functioning perfectly when viewed via the browser.

Sorry to be a pain, and thanks in advance for your help if you have any more suggestions

Thanks,

Neil

UFHH01 · Sep 21, 2014

As quoted in your starting post, facebook and co. spider a HTML - document ( Last-Modified: Thu, 18 Sep 2014 17:34:36 GMT - <!DOCTYPE html> ) and this HTML document was last modified 18.09.2014 and is still in the document root, where you send the spiders to. Is the domain probably only a redirect to somewhere else and the redirection is not well configured?

Neil1983 · Sep 21, 2014

Thanks, you are right, the html document is the default plesk page, and it was modified on Thu, 18 Sep 2014 17:34:36 GMT.

I deleted it out of all my domains a long time ago, the only one that is there still is the template page located in var/www/vhosts/default/htdocs/index.html. It is showing modified on the 18/09/2014 because I added a line of code to check whether this was the page that is being scraped and it is.

I'm not using a redirect, all of the sites run on php, there are 54 in total, some are wordpress, some are not. All of them show the same page when ran through a spider though. If i delete that page it just shows no content found, it doesn't scrape the domain itself.

Any ideas?

Thanks

Neil

UFHH01 · Sep 21, 2014

Please provide MORE informations, when you start a posting, because then we don't have to guess right into the blue. ^^

Are you using NGINX ( and apache2 ) or are you using just the "normal" apache2 ?

Did you ever had some "rewrite" - rules defined for the apache2 ( something in a ".htaccess" - file probably? Is the START - page ( index.php ) the one from wordpress?

Neil1983 · Sep 21, 2014

Sorry, I'm using NGINX ( and apache2). The server I migrated from was just using Apache2.

I do have rewrite rules defined in the htaccess for the domain. I've listed them below:

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

The Index.php file is the one from wordpress yes.

Thanks

UFHH01 · Sep 21, 2014

First... for your notice: NGINX doesn't work with ".htaccess" - files at all. You always have to convert them. A nice tool for that can be found at: [url]http://winginx.com/en/htaccess[/URL]

I just converted these rules four you:

Code:

<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

is for NGINX - rewrite rules:

Code:

location / {
	if (!-e $request_filename){
		rewrite ^(.*)$ /index.php break;
	}
}

You may put this individual directive in the editor box for NGINX, which you find in your domain subscription under the menu "Webserver settings" ( Additional NGINX instructions ).

I would recommend using the default wordpress NGINX directives, which you find at the NGINX - Wiki under: [url]http://wiki.nginx.org/WordPress[/URL]

Code:

        location = /favicon.ico {
                log_not_found off;
                access_log off;
        }
 
        location = /robots.txt {
                allow all;
                log_not_found off;
                access_log off;
        }
 
        location / {
                try_files $uri $uri/ /index.php?$args;
        }
 
        location ~ \.php$ {
                include fastcgi.conf;
                fastcgi_intercept_errors on;
                fastcgi_pass php;
        }
 
        location ~* \.(js|css|png|jpg|jpeg|gif|ico)$ {
                expires max;
                log_not_found off;
        }

UFHH01 · Sep 21, 2014

Oh... I forgot.... if you are as well using PHP5-FPM, then you have a slightly different configuration... but due to the fact that you didn't mention, that you are using PHP5-FM ( for FastCGI ), I didn't post the addtional configuration for that.

Neil1983 · Sep 21, 2014

UFHH01, I think you could be a genius. I am using PHP5-FPM, do you happen to know what would be different in my configuration for this? Sorry I neglected to mention it. Really hope this works!

Thanks

UFHH01 · Sep 21, 2014

For NGINX with PHP5-FPM, you now have to configure some things:

Please check with the command "ps - a | grep fpm", that there is a PHP5-FPM process for your domain running ( i.e. " php-fpm: pool yourdomain.com" )
Please check with "locate php-fpm.sock" that your domain-specific socket for your domain is listed and copy the path.

Go to your Plesk Panel and switch to the Webserver settings in your domain subscription and scroll down to the "Additional NGINX settings" - editor and paste the following content into it:

Code:

        location = /favicon.ico {
                log_not_found off;
                access_log off;
        }
 
        location = /robots.txt {
                allow all;
                log_not_found off;
                access_log off;
        }
 
        location / {
                try_files $uri $uri/ /index.php?$args;
        }
 
        location ~ \.php$ {
                fastcgi_pass unix:[B][COLOR="#FF0000"]/var/run/php5-fpm.sock[/COLOR][/B];
                fastcgi_index index.php;
                try_files $uri $uri/ /index.php?q=$uri&$args;
                fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
                fastcgi_param PATH_INFO $fastcgi_path_info;
                include /etc/nginx/fastcgi_params;
                include /etc/nginx/fastcgi.conf;
        }
 
        location ~* \.(js|css|png|jpg|jpeg|gif|ico)$ {
                expires max;
                log_not_found off;
        }

Insert the just copied path instead of the current RED definition.

Click "o.k." and wait for the Plesk Panel to recreate your vhost - config - as well the apache2 and nginx should get restarted during this procedure.

Next step: SMILE and open your website and check if all is fine... afterwards check with the site https://developers.facebook.com/tools/debug/ if facebook now crawls the right URL and even has a preview pic included ( well, I hope, you deleted the Plesk - standard - domain site "index.html" before using the facebook developper tool and you have a picture on this start - page, because otherwise there might be no preview pic, but the rest should be fine. ^^ )

Neil1983 · Sep 24, 2014

UFHH01, thank you so much for your help, it all works great now, I owe you a beer, actually a crate of beer!

Case closed!

UFHH01 · Sep 24, 2014

There is a little mistake in my suggestion ( double definition with "fastcgi_params" and "fastcgi.conf" and some missing "" at the unix-socket path... please be sure to correct it - as well, I modified the vhost_nginx.conf again to be sure that it should work for most CMS, blogs and forums/boards ( on PHP - basis ) and the "fastcgi_read_timeout" is just a suggestion, because some CMS, blogs or what ever, sometimes need a bit longer than others. ^^

You can either edit the config at

"/var/www/vhosts/system/<DOMAIN>/conf/vhost_nginx.conf"

or you use the Plesk - Editor at

Start > Abonnements > DOMAIN.COM > Websites & Domains > (SUBDOMAIN.)DOMAIN.COM > Webserver settings

# Changed the order of the general config, to make sure, that some index.extensions get served before others and "location / " is already used.
location ~ /$ {

index index.php index.cgi index.pl index.html index.htm index.xhtml index.shtml;
try_files $uri $uri/ /index.php?$args;
}

location ~ .php$ {

fastcgi_split_path_info ^((?U).+\.php)(/?.+)$;
fastcgi_index index.php;
try_files $uri =404;

fastcgi_pass "unix:/var/www/vhosts/system/<DOMAINNAME>/php-fpm.sock";

fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
fastcgi_param PATH_INFO $fastcgi_path_info;
include /etc/nginx/fastcgi_params;
}

# Defines a lot more file - extensions - please choose and edit, if some of the files doesn't fit your need.
# At the moment, Plesk is having a little issue with the definition "public"; , when you paste it into the
# vhost.nginx.conf with the Plesk - Editor. Please check at the config - docroot, that the Editor didn't
# rewrite it to some strange letters. They should be cached to reduce traffic and to fasten the rendering.
location ~ ^/(.*\.(ac3|avi|bmp|bz2|css|cue|dat|doc|docx|dts|exe|flv|gif|gz|htm|html|ico|img|iso|jpeg|jpg|js|mkv|mp3|mp4|mpeg|mpg|ogg|pdf|png|ppt|pptx|qt|rar|rm|swf|tar|tgz|txt|wav|xls|xlsx|zip))$ {

expires 30d;
add_header Pragma public;
add_header Cache-Control “public”;
try_files $uri @fallback;
}

# There is no need to spam logs, because some spider ( robots ) look for a favicon and don't find any.
location = /favicon.ico {

log_not_found off;
access_log off;
}

# Most spider and robots don't follow the rules anyway... so we allow all and make them happy ^^
location = /robots.txt {

allow all;
}

# css and js - files should have a low caching - expires setting
location ~ \.(css|js)$ {

expires 7d;
add_header Cache-Control "public, must-revalidate, proxy-revalidate";
add_header "Vary" "Accept-Encoding";
}

# Some sites need some more time, we should make bad coders happy and get a coffee while the site keeps loading. ^^
fastcgi_read_timeout 600;

I did not use

if (!-e $request_filename) {

rewrite (.*) /index.php last;

}

because this doesn't work on some CMS I tested...but it doesn't harm a wordpress installation, so feel free to put this in. ^^ ... and could a get some coffee instead of the bear, please?

UFHH01 · Sep 24, 2014

... I can't edit my post to correct spelling mistakes .... püh.... oki...then I post directly after myself... I think I don't like the new forum...

Correction of the previous post:

- and could a get some coffee instead of the bear, please?

+and could I get some coffee instead of the beer, please?

Konstantin_Sigul · Mar 29, 2015

Hello!
My website djkrypton.de.
Recently i migrate from Debian to Cenos VPS with Plesk installed.
And now i can't share any post. I always get 404 error or default plesk page.
I tried to follow your suggestions, but it didn't work for me.
1st of all these command reported an error

ps - a | grep fpm
Please check with "locate php-fpm.sock

2nd of all - when i tried to copy-paste Additional NGINX settings, i always got syntax error.

The strange thing is that if i want to share any of my older posts which was created before migration, everything works great.
I'm not an expert at all so sorry if i missed something)
Thank you in advance!

Domains work after migration but HTTP Request and Response Heade pulling default page

New Pleskian

New Pleskian

Basic Pleskian

New Pleskian

UFHH01

Guest

New Pleskian

UFHH01

Guest

New Pleskian

UFHH01

Guest

New Pleskian

UFHH01

Guest

New Pleskian

UFHH01

Guest

UFHH01

Guest

New Pleskian

UFHH01

Guest

New Pleskian

UFHH01

Guest

UFHH01

Guest

New Pleskian

Similar threads