web design and hosting
features and pricing my account customer support about ICG Link, Inc. contact ICG Link, Inc.

Site Search
   
 
 
Our Site Search is a complete web site crawler and site search engine that you can add to your web site. In order to enable the Site Search feature of your web site, please submit a request.

Site Search Management

Once your Site Search has been enabled, use the Site Search Management page to control the behavior of your search.
  • Site Name: This is the base url for your web site. If you would like this changed, please contact support.
  • Last Index: Once the crawler has indexed your site for the first time, this will display the number of pages and the time the last index was created. The crawler automatically runs once a week unless you check the box to ask it to run manually.
  • robots.txt: This displays the contents of your robots.txt file. This file resides in your www directory, and instructs site crawlers about how to properly index your site. It is displayed here because our crawler will follow the instructions in this file as well as using the options you set in Site Search Management.
  • Include URL: Use this area to add and remove any URL's that you wish to include in your site search, but that may not be linked from pages in your regular web site. These URL's can be relative (starting with /) or absolute (starting with http). You may include absolute URL's starting with http://www.domain.com/ or https://secure.icglink.com/domain if you have a secure site. https://secure.icglink.com/domain is normally included in your site search if it is linked to from your regular site.
  • Exclude URL: Use this area to add and remove any URL's that you wish to exclude from your site search.
  • Options: Here you can set various options for your site search
    • Display # results per page: this number controls the number of results on your search results page, both for the default template and for any custom template you design.
    • Show description in results: this will affect the results in the default template.
    • Default search: this controls the type of search to perform if the search is on two or more keywords. Choose will display a radio button option with the default search form.
    • Don't follow redirects: this affects the behavior of the site crawler.
    • Username and Password: if you want to index a section of your site that is password protected, enter a username and password here. The crawler will index the password protected pages, and will display a brief description of the page in the Site Search results, but users will still be required to enter their username and password to view the page.
    • Schedule for reindexing: after you update your web site, or after you reconfigure your Site Search, check this box to reindex the site. Your site will be reindexed at the end of that day. If you don't do anything, your site will be crawled weekly on Sunday night.
Adding the Site Search to your site
Once your site has been successfully indexed, you can test your search by going to http://www.yourdomain.com/cgi-bin/sitesearch.pl You can enter search words and it will display any matches it finds.
Customizing your Search Page: Create a file called sitesearch.html in your www/data directory. To use the default search form and results, follow this example:
<html><head><title>Site Search</title></head>
<body bgcolor=#FFFFFF>
<h1>Site Search</h1>

<! SEARCH>

</body>
</html>
Now you can add your own HTML before and after the <! SEARCH> tag to customize the page.

Advanced Template: If you want full control over the display of the search results, follow this example:
<html><head><title>Site Search</title></head>
<body bgcolor=#FFFFFF>
<h1>Site Search</h1>

<! SEARCH_FORM>

<table>
<tr>
<td align=left><! SEARCH_PREV></td>
<td align=middle><! SEARCH_MATCH></td>
<td align=right><! SEARCH_NEXT></td>
</tr>
<tr><td> </td></tr>
<! SEARCH_RESULT>
<tr>
<td valign=top><! SEARCH_STARS></td>
<td valign=top><a href="<! SEARCH_URL>"><! SEARCH_TITLE></a><br>
<! SEARCH_DESCRIPTION><br>
<a href="<! SEARCH_URL>"><! SEARCH_URL></a>
- <! SEARCH_SIZE>k<br><br></td></tr>
</! SEARCH_RESULT>
<tr>
<td align=left><! SEARCH_PREV></td>
<td align=middle> </td>
<td align=right><! SEARCH_NEXT></td>
</tr>
</table>

</body>
</html>
SEARCH_FORM display the search form
SEARCH_PREV if there are results on a previous page, display a link called "Previous"
SEARCH_NEXT if there are results on a following page, display a link called "Next"
SEARCH_MATCH display the number of matching pages, otherwise display "No results"
SEARCH_RESULT opening and closing tag for search results. The html between these tags will be repeated for each search result, up to the number of results per page specified in Site Search Management
SEARCH_STARS display 1 to 5 asterisks based on the relavance of the matching page
SEARCH_URL URL for the matching page
SEARCH_TITLE title of the matching page
SEARCH_DESCRIPTION description of the matching page
SEARCH_SIZE size in kilobytes of the matching page

Search Form If you'd like to put a search form on the pages in your site, use this example html, changing domain.com to your domain name:
<form method=get action="http://www.domain.com/cgi-bin/sitesearch.pl">
<input type=text name=search>
<input type=submit value="Search">
</form>
Controlling the way pages are indexed

In order for the crawler to index a page, it must be a valid HTML document including a TITLE tag. All words found in a document are indexed and weighted by their proximity to the top of the page. The TITLE is used as the title of the page in the search. Words in the TITLE and META tags are also heaviliy weighted. You can use the META KEYWORDS tag to add more heavily weighted search terms.


<meta name="keywords" content="Computers,Banking">

You can use the META DESCRIPTION tag to specify the description that will be displayed in the search results. These words will also be heavily weighted in the index.

<meta name="description" content="This is a great web page about stuff">
If you do not specify a META DESCRIPTION, the crawler will use the first few sentences on the page instead.
ICG Link, Inc. 7003 Chadwick Drive, Suite 111, Brentwood, TN 37027