How do search engine robots list a site?

Think about a visit from the eyes of a robot. He finds a site, usually from links on other web pages, then records the text from the page or saves the page.

He extracts just the text from the page without the HTML coding, including the title. He uses a mathematical equation to catalogue all the words on the site (this is called an algorithm). He follows the links on your site and retrieves any information he finds. All this information is then stored.

Now he knows how many pages you have, how significant your site is for a given keyword. How many “outside” links your site has, and can give your site a “score” based on how it is set up. This is how your site ends up being ranked high or low.

He then travels the links that leave your web site, and visits new web sites.

Will my site be in any search engines, if so, which ones, and how long does it take?

We have a Search Engine Maintenance program available on a monthly basis.

We hand-submit your site to all the major search engines. Each engine is its own independent company so the time it takes will vary.

It can be anywhere from 4 week to 12 weeks.

Are there any web components that don’t work with the search engines and why?

Yes, Flash.

You’ve probably seen web sites that open with music, moving images, moving text etc. and they look very visually exciting, and certainly attract attention once you get to them. These are created with Flash. However, some web developers don’t understand that search engines don’t read Flash movies.


Search engines use “crawlers” or “robots” to record your web site in their databases. These crawlers read the text on your web site. Flash is used to produce spectacular graphics, which they do very well. However, these graphics require significant load time and load time is a key component for search engines.


Some search engines will “ignore” web sites that use Flash. So it’s more than likely that these web sites won’t do well in these search engines.

What are search engines?

Basically, search engines are web sites where you can type in words and phrases called “key words” to help you find what you’re looking for on the Internet.

It’s important to be indexed on as many search engines as possible.

Although we would advise getting it professionally done, rather than attempting it yourself.

Search engines generate income by advertising on the search results.

What do search engines do with the information?

When someone searches for a phrase or keyword, another search program takes over using the information the robot found.

A person types in the keywords and the search program returns the thousands of pages matching their keywords.

They also consider the following:

  • How large is the web site?
  • Was it properly constructed?
  • How fast the site is?
  • Location of the site, eg. in Australia or overseas?
  • How many other web sites link to this web site?