It was a clean install...using wordpress toolkit.
The virtual robots.txt file was generated immediately after install.
I added my own and nothing changed...
I THEN installed yoast...and nothing changed.
I have a robots.txt file in my root. It is NOT what shows when I go to check it (yoursite)/robots.txt; it shows the virtual file installed or activated by Wordpress toolkit.
Maybe I should have been clearer...I already created a great robots.txt in my root folder, and when I activated the wordpress toolkit; it overtook it and I can not disable this virtual robots.txt file because it is not available to do. You need to do some research, because YES there is a virtual...
The default setting is the following...
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
First of all, there is NO documentation on this file ANYWHERE.
Where is it?
How do you change it or disable it?
Why does it replace the robots.txt file I already have?
Any answers would...