Linux Format forums Forum Index Linux Format forums
Help, discussion, magazine feedback and more
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

rsync slowdown - 2 TB external USB 3.0

 
Post new topic   Reply to topic    Linux Format forums Forum Index -> Help!
View previous topic :: View next topic  
Author Message
serene
LXF regular


Joined: Sun Jun 19, 2005 1:43 pm
Posts: 111

PostPosted: Sat Mar 08, 2014 10:16 am    Post subject: rsync slowdown - 2 TB external USB 3.0 Reply with quote

Hi.

Problem:
Rsync drops from 80 Meg/sec to 3-10 Meg/sec

80 Megs/Sec
From laptop to external USB 3.0, 2 TB Western Digital
$ rsync -avP --stats -h /media/Laptop01/ /media/USB3/Backup01

3-10 Megs/Sec
When I want to do a snapshot, it bottlenecks...
$ rsync -avP --stats -h --link-dest=/media/USB3/Backup01/ /media/Laptop01/ /media/USB3/Snapshot01/

I've tried;
-forcing each of the (3) rsync processes to individual cpus
--no-compress --no-blocking-io
--temp-dir=/media/Laptop/Cache/
--bwlimit=30000
-disabling legacy usb
-temporary disalbe acpi /sys/firmware/acpi/interrupts...

I noticed the disk is stuck with 100 % usage;
$ iostat -xd 2

I've read tons of others with this problem, no solution has worked for me so far.

Might anyone have an idea for a solution ?

Thank you.
Back to top
View user's profile Send private message
serene
LXF regular


Joined: Sun Jun 19, 2005 1:43 pm
Posts: 111

PostPosted: Tue Mar 11, 2014 3:17 am    Post subject: Reply with quote

One of those unresolved mysteries...

Some bizzare foreign music filename characters were removed and now rsync behaves.

I couldn't find enough information on the --iconv=CONVERT_SPEC to make it useful so I just hunted down the culprits.

All seems OK now.

Cheers.

[SOLVED]
Back to top
View user's profile Send private message
View previous topic :: View next topic  
Display posts from previous:   
Post new topic   Reply to topic    Linux Format forums Forum Index -> Help! All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Linux Format forums topic RSS feed 


Powered by phpBB © 2001, 2005 phpBB Group


Copyright 2011 Future Publishing, all rights reserved.


Web hosting by UKFast