Wednesday, March 22, 2017

FTP multiple parallel connections to download large file fast.

Some ISP's limit the download speed of a single file. This can lead to slower downloads of large files even though the speed you are paying for is much higher. For example my internet connection is advertised at 50 Mb/s download. When I try to download a large file from an ftp I get speeds around 600 KB/s or to put it in the same units as the ISP rate, 4.8 Mb/s. In order to get around that limitation I have to download the file using multiple connections.

 LFTP is an application for linux that has an option for multiple parallel download connections. It can be used on windows through the cygwin application (https://www.cygwin.com/).

Command to run lftp:

lftp <username>@<server>:<port>

Then to download a file using multiple connections:

pget -n <number of connections> <filename>

This will use up bandwidth on the server so be careful to not use too many connections if the server has limited bandwidth.

No comments:

Post a Comment