[Xitami-Dev] Large Volume File Transfer

Bob Paddock xitami-dev@lists.xitami.org
Fri, 14 Jun 2002 06:09:26 -0400


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


> Our application area is document imaging including production
> environments.
>
> With the growing trend towards offshore processing, we now are
> faced with customers scanning on-site and then transferring
> files to an offshore server. The quantum of data could be
> anywhere from 500 MB per day to a few GB. 

You really should look at some document specific compression 
methods then.

Take a look at http://www.lizardtech.com/ .

and 

http://www.djvuzone.org/ .

Using DjVu compression I can get a 43+Meg document down to under
10 Megs.  You can see these examples on 
http://www.unusualresearch.com/ .

Simple black and white page scans might be as low as 50K per 
page, from originals that are in the meg range.

There are specific compression methods for medical imaging and 
maps as well.

> At the originating site, we have a FTP client - 

You might be better served by a rsync or unison client.
rsync has much better error detection and recovery than FTP.

Any one done rsync in SMT?

> Imaging Solutions Pvt Ltd

Sounds like a fun project.  I'm always playing with my scanners 
here at home trying to reduce the weight of my library down to a 
few CD's.  Just wish I could afford faster scanners, and ones 
that didn't skew the paper during feeding all the time.

Ever come across any good deskewing code?



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: For info see http://www.gnupg.org

iD8DBQE9CcDWoqsDS8ujjoQRAsHhAJ4qY68ygdkr0zxYZlXyf5CPF7ZGVACgp0h2
g2xMjBFxro9zuucUXDHcGfk=
=CfNW
-----END PGP SIGNATURE-----