Home

SF Logo

Documents

Features
READ ME
Sample configuration
ChangeLog
Online Manual

Source code

Download
Browse

Mailing list
Bug Tracker

Smart Cache Loader on

SForge page
Open Hub

Stats

SForge

My projects

Smart Cache
Download Machine
FSP Suite
FSP Client
Old programs

Smart Cache Loader - Home Page

What is Smart Cache Loader

Smart Cache Loader is most configurable web batch downloader in world! If you have a very specific needs to grab some portions of web site – this is right tool for you! This program can be also used as web crawler if you need to crawl defined parts of www site(s).

Operation

This program is command line driven. Forget slow GUI and other nice things. If you want GUI downloader, there are other programs. Main power of this program is configuration file. And yes this program has a very nice integration with Smart Cache proxy server.

Support

If you need help with this program feel free to ask on mailing list scloader-users.

Latest version

0.32 - released 02-Jun-2010

News

02-Jun-2010: SC Loader 0.32 Fixed value in upd= its in hours. Code updated to Java 5 typesafe collections. Added locking to work better on multi CPU. Support for smart cache cacheinfo version 4 and fixed bugs in smart cache cooperation. Corrected test for object age during update.

10-Aug-2007: SC Loader 0.31 Fixed bug in localstores, only nullstore worked, send Host: header to server, decode HTML entities before extracting URLs, request gziped pages from server if available.

8-Aug-2007: SC Loader 0.30 Support for extracting URLs from page text using regexp and possible replace, regexp package is used from standard Java runtime library, Loader now depends on JDK1.5.