Why SE won't index this?

[Ben]

Several months ago I read an article somewhere that every porn site must have a warning page before the actual content. Prior to that time I kept little sample thumbs and text links to my sites on the main hub, e.g. for my free sites all sites were listed on http://www.free-porn-masters.com

however, when I put the warning page to the root directory, and transfered the list of sites to http://www.free-porn-masters.com/content.html NONE of the major search engines has indexed and cashed this page (content.html). I can't figure out why. There's a big Enter link on the warning page that SE should follow.

What's more, I noticed that all the sites I added on that domain after this change are not being indexed by Google. Does anyone know why is that so, and what can be done to make SE index all pages correctly again?

I tested the site with Google tools for webmasters, and all it says is something like "your site is indexed, but we may not have all your pages. Consider submitting the map of your site". Would the map help, or is it better to simply drop the warning page?

[Xstr8guy]

Do you have robots.txt blocking anything on the server?

[Ben]

Do you have robots.txt blocking anything on the server?

I put this robots.txt about one month ago:

-------
User-agent: ia_archiver
Disallow: /
-------

it's intended to disallow the webarchive robot (archive.org). I've seen it on many sites (e.g. Ugas and Mancheck) and it shouldn't affect other search engines. I don't think this has any effect on Google, because the warning page was introduced about 3 months ago, and that's when normal indexing stopped.