Hi guys! I have a server on a rather reliable network, with 1Gbps connection upload verified by different connections over the same area. However, in some countries where the connection is very unreliable, the connection slowly dies, and stays dead halfway through the transfer. Is there any client which would be prepared to adapt or detect an unreliable connection, and retry/resume as soon as it happens without losing the transfer? I find filezilla sometimes tends to stall halfway through, and it stays...hung without doign much. And sometimes after restarting the connection, it just overwrites the file from the beginning without prompting. Is there a better system or client to transfer large files in a resumeable way over the internet?
Thanks!
11 Comments
underpuddle@lemmy.world · 6 pts · 124d
It sounds to me like you're gonna like rsync. It's cool, you can copy 1 or multiple large files, resume interrupted transfers, and even keep entire directories in sync.
Oh yes, and it's a Linux tool. Not sure if it's available with a GUI version, so you might need to get comfortable with using the terminal (which you probably already are if you're using Linux).
Menschlicher_Fehler@feddit.org · 4 pts · 124d
If you are on Windows, take a look at Robocopy.
iturnedintoanewt@lemmy.world · 2 pts · 124d
Thanks! I'm looking for some Linux equivalent of this...Not sure if there's an SFTP client that can reliably copy a bunch of large files, or I'd need to go with any other protocol.
fascicle@leminal.space · 3 pts · 124d
I use syncthing to keep my photos from tablet backed up to server as I travel and stuff. But its more for a lot of smaller files and not one big file that might stop halfway
iturnedintoanewt@lemmy.world · 2 pts · 124d
Thanks...I'm actually considering this as an option, but it would make it a bit more...indirect than what I was intending to do, as it syncs a pre-defined folder, not specific files at will. But definitely I know it to be reliable transferring lots of files reliably.
RedBauble@sh.itjust.works · 2 pts · 124d
I have never done this, but maybe you can try creating a torrent and sharing it with your friend, or using plain http/https with a download client lile jDownloader, so that it automatically resumes the download and handles errors
iturnedintoanewt@lemmy.world · 1 pts · 124d
Thanks, but this would be for myself alone...I'd prefer to stay away from Torrent I think.
klankin@piefed.ca · 2 pts · 124d
Pretty sure I heard somewhere SSHfs is pretty robust against flakey connections
iturnedintoanewt@lemmy.world · 1 pts · 124d
Thanks...I need to look into this. Isn't it integrated already with your average openssh-server install?
Onomatopoeia@lemmy.cafe · 2 pts · 124d
You can configure Syncthing for more ad-hoc, but it's a little convoluted.
Try Resilio Sync - it has a Selective Sync feature that allows you to select individual files to sync in the moment.
I use Resilio this way to access my files at home - Resilio runs on a machine at home and indexes/shares the root folder on my NAS. Then from any device (including my phone) I can browse for any file and select sync. It will take as long as needed for the file size and network stability, but it will sync the file.
This is especially useful for media files, since I can't exactly keep my entire library (4 TB) synced to my phone, but using Resilio I can grab any movie/TV show/music at any time.
Just don't leave Resilio running your phone - it can be hard on memory as it keeps an index there, and it isn't the most battery friendly app. So I close it when done syncing something.
iturnedintoanewt@lemmy.world · 2 pts · 124d
Thanks, this looks promising! I'm going to take a look.