DRKSpider 3.1 - Build 179
The application:
DRKSpider will navigate a web site from a given URL, checking internal (and external) links, style sheets, images and other files. Broken links will be reported and the sitemap displayed in a tree control. You will be able to export the sitemap to a plain text file for submitting to Google, Yahoo and other search engines.
DRKSpider is a free open source software, which means you can use it, modify it and distribute it to your friends, freely.
We've been working hard to port DRKSpider to JavaSE in order to make it available to different operating systems users outside Windows world. Preview Java implementation of DRKSpider in its Beta stage: DRKSpiderJava 0.1 Beta DRKSpiderJava.zip - 43.4 kBytes - April 9, 2010
Check the screenshot and the features list for more details. If you want to use this tool, download and run DRKSpider_setup.exe in your computer.
Screenshots:
DRKSpider after scanning a website.
DRKSpiderJava includes SEO oriented data.
What's new:
- Improved online help.
- Saved projects contain full scan information and tree.
- Several bugs corrected.
Features:
- Generates a website tree matching site's navigation hierarchy.
- Sitemap exporter for search engine optimization: generate sitemaps for Google, Yahoo and other engines.
- Detailed information about every link found.
- Several scan limit options.
- Site scan results window.
- Export command allows to export to CSV format for further processing.
- Preferences command in the File menu for saving DRKSpider settings.
- Exclude word list for URL excluding.
- Proxy server support.
- Internet system cache control.
- Referrer information field control.
- Binary install distribution (NSIS Setup)
- HTML Validator by World Wide Web Consortium added in the link properties dialog.
- SWFRIP add-in for parsing SWF content (SWFRIP source code).
- Web lookup for any tree item.
- Generates sitemap file for search engine optimization (SEO).
The project:
DRKSpider is a sitemap generator and link checker and it's a free open source software. It is written in C++ using MS Visual Studio 2008 and it's an MFC based application.
Any comments, feedback or questions are welcome: Feedback form.
Download binary distribution:
DRKSpider_setup.exe - 1.1 MBytes - May 9, 2010
Download source code:
DRKSpider-src.7z - 80.1 kBytes - April 9, 2010
DRKSpider is licensed under the GNU General Public License
SWFRIP add-in is published under the GNU General Public License
ZLIB library is published under a propietary license