Re: speeding up FTP

Jerry,

Where are you saving your media in the cloud?

*If you are using Azure BLOB Storage you can mount the Image Catalog IFS directory from a Linux machine using SSHFS and send the files with the native client.

* If you are sending to the IBM i on Skytap you can use SFTP or SCP and compress when possible

* When using IBM Cloud Object Storage or AWS S3 you can use the AWS Client configuring multipart uploads

In all these cases you can send files in parallel. You could split your 25GB  images using the "split" command and then upload in parallel with FTP or the protocol you want.
I've seen a product that splits image catalog files under 256 MB per chunk and send in massive parallelism. The key is the amount of files you can send at once and the temporary space in your disk.



El 29/09/21 a las 14:43, Jerry Draper escribió:

Here we need to send a full system save (virtual tape in image catalog volumes) to a cloud provider (SkyTap) because they don't support physical tape.

The SavSys21 is about 650GB.  It is broken up into segments/catalog:

SAVSEC
SAVCFG
SAVIBM
SAVALL
SAVDLO
SAVIFS

Each image catalog is broken up into 25BGB volumes.

Sigh.


Jerry



On 9/29/2021 12:31 PM, Diego E. Kesselman wrote:

BTW:

If files are big enough: Have you tried splitting in parts and using simultaneous uploads/downloads?

Diego E. Kesselman
diegokesselman@xxxxxxxxx

El 29/09/2021, a las 14:25, Diego E. Kesselman <diegokesselman@xxxxxxxxx> escribió:

Hi Jerry,

DNS is not the same as Routes, but yes, adding a host entry and using *LOCAL on DNS configuration (check there’s no dead DNS entry) can help too.


Diego E. Kesselman
diegokesselman@xxxxxxxxx <mailto:diegokesselman@xxxxxxxxx>

El 29/09/2021, a las 13:33, Jerry Draper <midrangel@xxxxxxxxxxxxx <mailto:midrangel@xxxxxxxxxxxxx>> escribió:

Probably meaning to add entries to IBM I host table and specify *LOCAL for DNS lookup.

@Diego?

J

On 9/29/2021 11:26 AM, Patrik Schindler wrote:

Hello Diego,
Am 29.09.2021 um 20:15 schrieb Diego E. Kesselman <diegokesselman@xxxxxxxxx <mailto:diegokesselman@xxxxxxxxx>>:

When connecting from IBM I you can add static routes to your target servers and avoid network broadcasting.

May I kindly ask for more details on this statement(s)?
:wq! PoC

--
Jerry Draper, Trilobyte Software Systems, since 1976
IBMi, Network, and Connectivity Specialists, LAN/WAN/VPN
Representing WinTronix, Synapse, HiT, and others .....
(415) 457-3431 opt-1 . www.trilosoft.com <http://www.trilosoft.com/>

--
This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list
To post a message email: MIDRANGE-L@xxxxxxxxxxxxxxxxxx <mailto:MIDRANGE-L@xxxxxxxxxxxxxxxxxx>
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/midrange-l <https://lists.midrange.com/mailman/listinfo/midrange-l>
or email: MIDRANGE-L-request@xxxxxxxxxxxxxxxxxx <mailto:MIDRANGE-L-request@xxxxxxxxxxxxxxxxxx>
Before posting, please take a moment to review the archives
at https://archive.midrange.com/midrange-l <https://archive.midrange.com/midrange-l>.

Please contact support@xxxxxxxxxxxxxxxxxxxx <mailto:support@xxxxxxxxxxxxxxxxxxxx> for any subscription related questions.

Help support midrange.com <http://midrange.com/> by shopping at amazon.com <http://amazon.com/> with our affiliate link: https://amazon.midrange.com <https://amazon.midrange.com/>