parsyncfp seems to work, but there is no progress output

Question

parsyncfp seems to work, but there is no progress output

annymous opened this issue 5 years ago · comments

I am following "Good example 1". I see no errors, and files get transferred. But there is no output after:

Thanks for using parsyncfp. Tell me how to make it better.
<hjmangalam@gmail.com>

This is in a Debian 9.2 x64 VPS. I'm using multiple interfaces that are aggregated with MPTCP. And I can see that there is multipathing.

Harry Mangalam · Answer 1 · Tue Apr 23 2019 06:51:06 GMT+0800 (China Standard Time)

On Monday, April 22, 2019 3:17:59 PM PDT annymous wrote: I am following "Good example 1". I see no errors, and files get transferred. But there is no output after: Thanks for using parsyncfp. Tell me how to make it better. ***@***.***>

Umm - you shouldn't see anything after that. That's the goodbye message. What were you expecting? hjm

This is in a Debian 9.2 x64 VPS. I'm using multiple interfaces that are aggregated with MPTCP. And I can see that there is multipathing.

Harry Mangalam, Info[1]

…

-------- [1] http://moo.nac.uci.edu/~hjm/hjm.sig.html

annymous · Answer 2 · Tue Apr 23 2019 09:04:29 GMT+0800 (China Standard Time)

Thanks. I was expecting the status updates

 Time  | time(m) |  Load  |     TCP / RDMA  out  |   PIDs  ||  PIDs   | [UpTo] of [ToDo]

But now I see them, with more files in the test folder. With two files, I saw no status output. But with nine files, I see expected status output. Anyway, thanks again.

Harry Mangalam · Answer 3 · Tue Apr 23 2019 09:39:31 GMT+0800 (China Standard Time)

Do note that parsyncfp is meant for transferring LOTS of files and that the admin overhead for transferring even a few hundred small files will make it much slower than a naked rsync. rsync is an effing miraculous piece of software. :) hjm

On Monday, April 22, 2019 6:04:31 PM PDT annymous wrote: Thanks. I was expecting the status updates Time | time(m) | Load | TCP / RDMA out | PIDs || PIDs | [UpTo] of [ToDo] But now I see them, with more files in the test folder. With two files, I saw no status output. But with nine files, I see expected status output. Anyway, thanks again.

Harry Mangalam, Info[1]

…

-------- [1] http://moo.nac.uci.edu/~hjm/hjm.sig.html

annymous · Answer 4 · Tue Apr 23 2019 10:07:36 GMT+0800 (China Standard Time)

Yes, I get that. And so is parsyncfp :)

My application is unusual, I guess. I'm working with VPS that are linked with multiple tinc networks, with tinc running as Tor onion services. And then aggregated with MPTCP. It's not so much that I'll be transferring huge files, but I need multiple TCP transfers to saturate the links. So far, using parsyncfp, I've gotten ~30 Mbps with NP=4 and ~40 Mbps with NP=8. With just rsync, it's ~10 Mbps. And with 10 scp instances, it's also ~30 Mbps. I know that's pitiful, but for Tor it's fast.