Time |
Nickname |
Message |
01:51
🔗
|
|
killsushi has joined #archiveteam-ot |
03:28
🔗
|
|
nyany_ has joined #archiveteam-ot |
05:15
🔗
|
|
phuzion has quit IRC (Quit: https://quassel-irc.org - Chat comfortably. Anywhere.) |
06:32
🔗
|
|
Flashfire has quit IRC (Remote host closed the connection) |
06:32
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
06:33
🔗
|
|
Flashfire has joined #archiveteam-ot |
06:33
🔗
|
|
kiska has joined #archiveteam-ot |
06:33
🔗
|
|
Fusl sets mode: +o kiska |
06:33
🔗
|
|
Fusl_ sets mode: +o kiska |
09:23
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
10:45
🔗
|
|
Dragnog2 has joined #archiveteam-ot |
12:58
🔗
|
|
systwi_ has joined #archiveteam-ot |
13:00
🔗
|
|
systwi_ has quit IRC (Read error: Connection reset by peer) |
13:01
🔗
|
|
systwi_ has joined #archiveteam-ot |
13:03
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
13:21
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
14:28
🔗
|
|
systwi has joined #archiveteam-ot |
14:35
🔗
|
|
systwi_ has quit IRC (Ping timeout: 600 seconds) |
15:02
🔗
|
|
Atom has quit IRC (Quit: Atom) |
15:02
🔗
|
|
godane has joined #archiveteam-ot |
15:15
🔗
|
|
Atom has joined #archiveteam-ot |
16:40
🔗
|
|
nataraj has joined #archiveteam-ot |
18:31
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 360 seconds) |
18:40
🔗
|
|
Mateon1 has joined #archiveteam-ot |
18:43
🔗
|
|
ShellyRol has quit IRC (Ping timeout: 252 seconds) |
18:43
🔗
|
|
ShellyRol has joined #archiveteam-ot |
18:52
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 745 seconds) |
18:52
🔗
|
|
Mateon1 has joined #archiveteam-ot |
19:01
🔗
|
schbirid |
any suggestions how to merge two directory trees with millions of files? all files from A should move into B, overwriting if needed. with rsync or mc it is really, really slow |
19:06
🔗
|
schbirid |
and it is 60000*5*10 directories |
19:11
🔗
|
JAA |
That's probably going to be really, really slow regardless of how you do it. |
19:12
🔗
|
schbirid |
ETA is 80 hours right now =( |
19:13
🔗
|
schbirid |
i am considering making a list of all the files, diffing that and making a bash script |
19:17
🔗
|
kiska |
import ssd; ? |
19:18
🔗
|
kiska |
I don't think there is a easy way on doing this |
19:33
🔗
|
JAA |
Yeah, SSD or even better tmpfs if the dataset's small enough. |
19:33
🔗
|
schbirid |
1.5TB D: |
19:33
🔗
|
JAA |
Welp |
19:34
🔗
|
JAA |
Time to spend $24k: https://www.amazon.com/24x64GB-DDR4-2133-PC4-17000-Upgrade-Poweredge/dp/B01N5M3GAK |
20:23
🔗
|
|
ShellyRol has quit IRC (Ping timeout: 252 seconds) |
20:24
🔗
|
|
ShellyRol has joined #archiveteam-ot |
20:33
🔗
|
|
ShellyRol has quit IRC (Read error: Connection reset by peer) |
20:34
🔗
|
|
ShellyRol has joined #archiveteam-ot |
20:55
🔗
|
|
godane has quit IRC (Ping timeout: 246 seconds) |
21:24
🔗
|
|
nataraj has quit IRC (Read error: Operation timed out) |
21:26
🔗
|
|
killsushi has joined #archiveteam-ot |
22:47
🔗
|
|
BlueMax has joined #archiveteam-ot |