[01:51] *** killsushi has joined #archiveteam-ot [03:28] *** nyany_ has joined #archiveteam-ot [05:15] *** phuzion has quit IRC (Quit: https://quassel-irc.org - Chat comfortably. Anywhere.) [06:32] *** Flashfire has quit IRC (Remote host closed the connection) [06:32] *** kiska has quit IRC (Remote host closed the connection) [06:33] *** Flashfire has joined #archiveteam-ot [06:33] *** kiska has joined #archiveteam-ot [06:33] *** Fusl sets mode: +o kiska [06:33] *** Fusl_ sets mode: +o kiska [09:23] *** killsushi has quit IRC (Quit: Leaving) [10:45] *** Dragnog2 has joined #archiveteam-ot [12:58] *** systwi_ has joined #archiveteam-ot [13:00] *** systwi_ has quit IRC (Read error: Connection reset by peer) [13:01] *** systwi_ has joined #archiveteam-ot [13:03] *** systwi has quit IRC (Read error: Operation timed out) [13:21] *** BlueMax has quit IRC (Read error: Connection reset by peer) [14:28] *** systwi has joined #archiveteam-ot [14:35] *** systwi_ has quit IRC (Ping timeout: 600 seconds) [15:02] *** Atom has quit IRC (Quit: Atom) [15:02] *** godane has joined #archiveteam-ot [15:15] *** Atom has joined #archiveteam-ot [16:40] *** nataraj has joined #archiveteam-ot [18:31] *** Mateon1 has quit IRC (Ping timeout: 360 seconds) [18:40] *** Mateon1 has joined #archiveteam-ot [18:43] *** ShellyRol has quit IRC (Ping timeout: 252 seconds) [18:43] *** ShellyRol has joined #archiveteam-ot [18:52] *** Mateon1 has quit IRC (Ping timeout: 745 seconds) [18:52] *** Mateon1 has joined #archiveteam-ot [19:01] any suggestions how to merge two directory trees with millions of files? all files from A should move into B, overwriting if needed. with rsync or mc it is really, really slow [19:06] and it is 60000*5*10 directories [19:11] That's probably going to be really, really slow regardless of how you do it. [19:12] ETA is 80 hours right now =( [19:13] i am considering making a list of all the files, diffing that and making a bash script [19:17] import ssd; ? [19:18] I don't think there is a easy way on doing this [19:33] Yeah, SSD or even better tmpfs if the dataset's small enough. [19:33] 1.5TB D: [19:33] Welp [19:34] Time to spend $24k: https://www.amazon.com/24x64GB-DDR4-2133-PC4-17000-Upgrade-Poweredge/dp/B01N5M3GAK [20:23] *** ShellyRol has quit IRC (Ping timeout: 252 seconds) [20:24] *** ShellyRol has joined #archiveteam-ot [20:33] *** ShellyRol has quit IRC (Read error: Connection reset by peer) [20:34] *** ShellyRol has joined #archiveteam-ot [20:55] *** godane has quit IRC (Ping timeout: 246 seconds) [21:24] *** nataraj has quit IRC (Read error: Operation timed out) [21:26] *** killsushi has joined #archiveteam-ot [22:47] *** BlueMax has joined #archiveteam-ot