Okay, I gotcha, but can you explain it any clearer? If you think about it, the PHP page is the same thing as the CGI page. When it's called from an outside source, the server processes it, regardless (as far as I know), so the results will never contain PHP or Perl code. They're ALL separate entities by themselves, and as we've seen with the sample results, Google WILL index files that are in the CGI-bin. You can modify Google's indexing behavior by using a robots.txt file as well. You can read more about this at
http://www.robotstxt.org/.
Quote:They are .txt files, which Google is not in the habit of indexing.
The .txt files that you refer to, Dave, will never even be visible to search engines because there are no links to them. Instead, when Google or another spider follows a link, the Perl or PHP script will pull up the appropriate file and output the results.
Quote:Google is a very smart search engine, but it's not going to run a perl program and then index the results it finds, 99 times out of 100.
Another reason is the fact that almost all search engines skip over files in directories containing the name "bin", so even if it were to actual run your YaBB and find pages, it's most likely not going to do that as long as you YaBB is in a "bin" directory or sub-directory.
We've already proven that they DO index YaBB's and plenty of other scripts in the CGI-bin. Your host or you (using robots.txt) would specifically have to request that the spider not index the cgi-bin.
As for Google seeming to only pull up results that contain boards as opposed to individual posts, I don't really know, but I believe it is because there are only one or two links to individual threads throughout the board, the site, and probably the whole internet, while every single thread in each board will always have a link back to that board. Google judges results by the number of links to the page, I believe, so a thread with one link to it will not get listed, while a board with links to it from almost every page in the YaBB will get listed. I don't profess to be an expert on search engine algorithms and methods, but that's from what I've read.
Quote:Cause I did many searches and it would not show any results from threads, so that proves that GOOGLE prefers HTML insead of DYNAMIC YABB.
That proves absolutely nothing. As I said, only one or two links to a thread = no listing. Many links to a board = a listing. I really don't see what you're trying to accomplish by having search engines index every bloody post on your board. Granted, it'd get you listed more often and possibly more hits, but if search engines indexed all the posts on every board in the internet, then search results would be pretty much useless. When I've found threads in the results of a search, it's usually from the type of board that has a separate page for each reply to a post, in a tree-like form, so every post page has a link to other posts in that thread or tree, which is why they get listed.