Premier Software Download Place

Crawlers

Show:  All | Free
Screenshot of ETagFix ETagFix 1.00
ETagFix is an add-on for Microsoft Internet Information Server (IIS) or any web server that supports ISAPI filters, that cuts off part of the etag that IIS produces so that is does not change every time your computer is rebooted. Etag is an HTTP header that is produced by IIS to allow web crawlers and user clients to check against to see if a web page has changed. ETagFix fixes the problem where etags for each page change once your machine is...

Price: USD $0.00;   License: Freeware   File Size: 696 KB;
Platform: Windows NT, Windows 2000, Windows XP

Reboot - Restart - Server - Page - Cache - Iis - Isapi - Expired - Etag - Http Headers

Advertisements


No Screenshot XML Sitemap for Zen Cart 3.0.4
XML Sitemap for Zen Cart - Zen Cart module generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once!Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow crawlers that support Sitemaps to pick up all URLs in the Sitemap and learn about those URLs using the associated metadata. Using the Sitemap protocol does not guarantee that web...

Price: USD $39.00;   License: Commercial   File Size: 189 KB;
Platform: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP, Windows Vista, Windows CE, PDA

Zen Cart Xml Sitemap - Zencart Xml Site Map - Xml Sitemap Zencart - Zen Xml Site Map
Screenshot of Vietspider Web Data Extractor Vietspider Web Data Extractor 3.18
The web crawler is a program that automatically traverses the web by downloading the pages and following the links from page to page. A general purpose of web crawler is to download any web page that can be accessed through the links. This process is called web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the...

Price: USD $0.00;   License: Freeware   File Size: 57617 KB;
Platform: Windows XP, Windows Vista, Windows Me, Windows 98, Windows 95, Windows 2000, Mac OSX, Linux

No Screenshot Robot-Manager 3.1
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.

Price: USD $129.95;   License: Shareware (Free to Try)   File Size: 3475 KB;
Platform: Windows 98, Windows, Windows Me, Windows NT, Windows 2000, Windows XP

Log File Analysis - Robot - Seo - Spider - Crawler - Log File - Log File Analyzer - Robots.txt - Spider Tracking - Referrer Logs
No Screenshot URI Crypter 3.1
This program allows you to substitute URI for symbol codes of ASCII table. It's very useful to prevent web pages scanning by the crawlers gathering e-mail addresses for broadcasting spam messages on next step. Using this software you protect your mailbox from tons of junk mail and will not be afraid of publishing contacts on your home page or a company's web site. URI Crypter is absolutely free and have multilingual interface.

Price: USD $0.00;   License: Freeware   File Size: 63 KB;
Platform: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP

Internet - Javascript - Url - Spider - Web Crawler - Junk Mail - Uri - Ciphering - Uri Crypter - Urn
Screenshot of Free Large Android Icons Free Large Android Icons 2011.1
Free Large Android Icons picture various space creatures, such as robots, crawlers and androids. Not only does the set present the creatures themselves, it also shows their moods and actions. All the images are created by professional artists and demonstrate bright colors and well-finished edges. This free icon set is a perfect choice for your personal desktop customization. Each icon includes the following sizes: 32x32, 48x48 and...

Price: USD $0.00;   License: Freeware   File Size: 14074 KB;
Platform: Windows XP, Windows Vista, Windows NT, Windows Me, Windows 98, Windows 95, Windows 3.x, Windows 2003, Windows 2000, Windows CE, Pocket PC, Mac OSX, Linux

No Screenshot XML Sitemap for CRE Loaded 2.3.5
Generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once!Search engine rivals Google, Yahoo and Microsoft are teaming up to make it easier for Web site owners to make sure their sites get included in the Web indexes, the companies are expected to announce Thursday, Oct 16, 2006.Now Web site owners will be able to go to one place for alerting all three major search engines to their Web pages, something...

Price: USD $39.00;   License: Commercial   File Size: 30 KB;
Platform: Windows 98, Windows, Windows Me, Windows NT, Windows 2000, Windows XP

Xml Sitemap For Cre Loaded - Cre Loaded Xml Sitemap - Cre Loaded Sitemap
Screenshot of CoffeeCup Sitemapper CoffeeCup Sitemapper 5.5
By placing a Sitemap-formatted file on your webserver, you enable the search engine crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index. Sitemaps are an easy way for you to help improve your coverage in search engine indexes. It's a...

Price: USD $29.00;   License: Shareware (Free to Try)   File Size: 4855 KB;
Platform: Windows XP, Windows Vista

Screenshot of CoffeeCup Google SiteMapper CoffeeCup Google SiteMapper 4.5
By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index. Google Sitemaps are an easy way for you to help improve your coverage in the Google index. It's a...

Price: USD $29.00;   License: Shareware (Free to Try)   File Size: 3116 KB;
Platform: Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP, Windows 2003

Freeware - Java - Software - Ftp - Free - Download - Flash - Javascript - Html - Xml
No Screenshot KeyWord Generator lite 1.0.0
KeyWord generator is free powerfull tool to generate keywords and save them. Using KeyWord generator lite you can generate more than 100 keywords and use them in your meta tags, titles or content of your web page. Keywords are really powerfull way to make search engines remember about you. Meta keywords can be extremely effective if they feat content properly. But beware of spam keywording. Awoid repeating of the same keyword too often. Make...

Price: USD $0.00;   License: Freeware   File Size: 138 KB;
Platform: Windows 98, Windows, Windows 2000, Windows XP

Keyword - Link Popularity - Keywords - Keyword Generator - Selections - Google Keyword Generator - Meta Keyword Generator - Request Tracker - Rt2 - Keyphrase
No Screenshot Kyb Web Log Analyzer by Keyword 3.1
How many of the users your stats package count are REAL PEOPLE?Robots and crawlers have exploded. Can you seperate bthem from actual visitors to get a true picture?DO you know which KEYWORDs actually produce sales? (These are the ones you should concentrate on). Can you report on WORDS and PHRASES from within keywords to guide your search engine optimisation?DO you know which PAGEs users find and then leave immediately? (You need to change...

Price: USD $99.00;   License: Shareware (Free to Try)   File Size: 4371 KB;
Platform: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP, Windows Vista

Log - Search - Analysis - Term - Data - Keyword - Engine - Analyzer - Raw
Screenshot of Web Scraper Plus+: Web Spider Edition Web Scraper Plus+: Web Spider Edition 4.0.12
Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor. Creating your own web grabber that can screen scrape the data to a database or Excel has never been easier. The website spider / crawlers can even sort and filter the webpages while spidering....

Price: USD $419.00;   License: Shareware (Free to Try)   File Size: 52521 KB;
Platform: Windows 2000, Windows XP, Windows 2003

Email Extractor - Web Spider - Web Crawler - Web Extract - Crawlers - Web Grabber - Website Spider - Screen Scraping - Spidering - Screen Scraper
No Screenshot Log Advertiser 5.0.1
Why do you need Log Advertiser?Have you ever seen sites with 'last 10 referrers' area? Just go to Yahoo! and input this query string 'link:http://cialis-online-buy.surf.to'. Then click search. Almost each site from results contains a small area with referrals.Those areas are indexed by search engines too. You found results using search engine? Crawlers find same results too. You do not need any expensive advertising to get your site indexed in...

Price: USD $35.00;   License: Shareware (Free to Try)   File Size: 1202 KB;
Platform: Windows 98, Windows, Windows 2000, Windows XP

Logs - Link Popularity - Referrals - Reciprocal - Reciprocal Links - Http Logs - Fake - Link Validation - Log Advertiser - Http Advertising
No Screenshot Bowu sitemaps generator 2.0
The main features:Automatically generated sitemaps, With yahoo, google and other large-scale search engine standards.Simulation crawling web crawlers, can check out the incorrect link.Set up a free multi-threaded, to generate extremely fast.Manual support Web site editor, artificial setting parameters such as frequency of updates.To support the import and export data.Support URL filtering and page content filtering, you can specify the content...

Price: USD $9.00;   License: Shareware (Free to Try)   File Size: 1665 KB;
Platform: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP, Windows Vista

Map - Web Site - Web Site Management - Sitemaps Generator - Sitemaps
Screenshot of Advanced Robots.txt Generator Advanced Robots.txt Generator 1.2
Create your robots.txt files in seconds and maintain them easilly and effortlesly with the unique utility Advanced Robots.txt Generator. Advanced Robots.txt Generator is the most complete and easy to use application that allows you to create, maintain and keep track of your Robots.txt files for all your websites. The following is a list of the features of Advanced Robots.txt Generator. * Support for ~300 Robots and Crawlers *...

Price: USD $65.00;   License: Shareware (Free to Try)   File Size: 1577 KB;
Platform: Windows 2003, Windows XP, Windows 2000, Windows NT, Windows Me, Windows 98, Windows 95

Robots.txt - Robots.txt Generator - Robots.txt Creator - Make Robots.txt - Create Robots.txt
MENU
Business & Productivity Tools

Desktop

Developer Tools

Drivers

Education

Games

Home & Personal

Internet & Networking

Ipod Tools

Linux

Mac

Multimedia & Design

Operating Systems

Others

PDA

Utilities

NEW DOWNLOADS
POPULAR TRENDS
TRENDING TOPICS
RELATED TOPICS
© 1997-2010 FileDudes.com
Home | Contact | Privacy | Submit PAD | Catalogs