[01:17] *** arkiver has quit IRC (Ping timeout: 745 seconds) [01:18] *** arkiver has joined #archiveteam-bs [01:18] *** Fusl sets mode: +o arkiver [01:18] *** Fusl____ sets mode: +o arkiver [01:18] *** Fusl_ sets mode: +o arkiver [01:24] *** acridAxid has quit IRC (Quit: marauder) [01:35] *** benjinss has joined #archiveteam-bs [01:38] *** superkuh_ is now known as superkuh [01:41] *** benjinsmi has quit IRC (Read error: Operation timed out) [03:05] *** odemgi has joined #archiveteam-bs [03:07] *** DogsRNice has quit IRC (Read error: Connection reset by peer) [03:08] *** odemgi_ has quit IRC (Ping timeout: 252 seconds) [03:16] *** qw3rty2 has joined #archiveteam-bs [03:24] *** qw3rty has quit IRC (Ping timeout: 745 seconds) [04:17] *** HashbangI has quit IRC (Remote host closed the connection) [04:27] *** HashbangI has joined #archiveteam-bs [04:29] *** BlueMax has quit IRC (Read error: Connection reset by peer) [04:30] *** BlueMax has joined #archiveteam-bs [06:24] *** Yurume has quit IRC (Quit: No Ping reply in 180 seconds.) [06:27] *** DopefishJ has joined #archiveteam-bs [06:31] *** Yurume has joined #archiveteam-bs [06:37] *** kiska18 has quit IRC (Remote host closed the connection) [06:37] *** Ryz has quit IRC (Remote host closed the connection) [06:37] *** DFJustin has quit IRC (Ping timeout: 745 seconds) [06:37] *** kiska18 has joined #archiveteam-bs [06:37] *** Fusl____ sets mode: +o kiska18 [06:37] *** Fusl sets mode: +o kiska18 [06:37] *** Fusl_ sets mode: +o kiska18 [06:37] *** Ryz has joined #archiveteam-bs [07:34] *** ReimuHaku has joined #archiveteam-bs [08:11] *** ReimuHaku has quit IRC (Ping timeout: 492 seconds) [08:35] *** terry1 has quit IRC (Quit: WeeChat 2.4) [09:54] *** kiska18 has quit IRC (Read error: Operation timed out) [09:55] *** kiska18 has joined #archiveteam-bs [09:55] *** Fusl____ sets mode: +o kiska18 [09:55] *** Fusl sets mode: +o kiska18 [09:55] *** Fusl_ sets mode: +o kiska18 [10:33] *** deevious has quit IRC (Quit: deevious) [10:53] *** deevious has joined #archiveteam-bs [11:00] My picosong grab is about halfway done. 1.3 TiB so far. [11:03] Halfway through the IDs, I should add. Based on Dash's ID list from Disqus, there are many more occupied IDs in the higher ranges; more precisely, my crawl would be at about one quarter of all existing songs. [11:22] there's a large empty gap between your current crawl range and the high range picking up again? [11:29] That as well. But more of the w???? codes are occupied compared to ???? and lower (where each ? is [0-9A-Za-z]). [11:30] Hopefully the gap will let the uploader catch up a bit though. It's still fighting with the backlog from yesterday's problems. [11:35] *** systwi_ has joined #archiveteam-bs [11:39] *** systwi has quit IRC (Ping timeout: 612 seconds) [12:47] *** schbirid has joined #archiveteam-bs [12:48] *** benjinss has quit IRC (Quit: Leaving) [12:49] *** benjins has joined #archiveteam-bs [13:07] *** BlueMax has quit IRC (Quit: Leaving) [13:33] *** Yurume has quit IRC (No Ping reply in 180 seconds.) [13:34] *** Yurume has joined #archiveteam-bs [13:39] *** Mateon1 has quit IRC (Remote host closed the connection) [13:39] *** Mateon1 has joined #archiveteam-bs [14:30] *** Yurume has quit IRC (No Ping reply in 180 seconds.) [14:30] *** Yurume has joined #archiveteam-bs [14:54] *** sep332 has joined #archiveteam-bs [15:01] *** fredgido_ has joined #archiveteam-bs [15:08] *** fredgido has quit IRC (Read error: Operation timed out) [15:13] *** DopefishJ is now known as DFJustin [16:01] *** killsushi has joined #archiveteam-bs [16:27] *** DogsRNice has joined #archiveteam-bs [16:31] *** Smiley has quit IRC (Read error: Operation timed out) [16:33] *** Smiley has joined #archiveteam-bs [17:30] As expected, the item completion rate on picosong has dropped massively now that it's doing items with more songs than before. In fact, the drop is exactly as large as I expected from the numbers mentioned above (about 3 times slower). [17:31] I'm occasionally hitting 500s from S3 now. [17:35] But even at the slower rate, it should finish in time. Rough estimate puts it at 6 days remaining if it stays at this speed. And it looks like the song density is about constant for the remaining codes to be scanned. [17:35] So there's a buffer of another week in case of problems. [18:11] could I get more attention, help, or feedback on yourshot? There's a 25TB dataset of images that we could start with now on tracker/warrior. I suspect if we don't start this we won't get the site completely. [20:01] *** dxrt has quit IRC (Ping timeout: 246 seconds) [20:40] *** achip has joined #archiveteam-bs [20:49] *** ats has quit IRC (Quit: An emu10k1 in 2019??) [21:01] markedL: is there a wiki page yet? whats the link [21:02] https://www.archiveteam.org/index.php?title=Your_Shot [21:06] I'll have time to look into it tomorrow ✔ [21:44] *** ats has joined #archiveteam-bs [22:00] *** ndiddy has quit IRC (Quit: WeeChat 1.4) [22:02] *** ndiddy has joined #archiveteam-bs [22:20] The upload backlog is slowly but steadily growing as I can't get the data off this machine quickly enough. Good thing I have that buffer of a week... [22:40] what's the total disk space you'd need to not be limited by upload rate? [22:44] markedL: To be completely independent of the upload, I'd have to be able to store everything at once, so 5-6 TiB. But part of that is already done, and I can upload about three quarters of the data in real time currently. Well, part of that is buffered on another machine, but that's not really relevant. [22:46] I'll have to look into what exactly is limiting me tomorrow. Might just be the bandwidth limit on the uplink, but it could also be something with the transatlantic connection and/or TCP settings. [23:13] *** HashbangI has quit IRC (Remote host closed the connection) [23:16] *** BlueMax has joined #archiveteam-bs [23:23] *** HashbangI has joined #archiveteam-bs [23:54] *** godane has quit IRC (Ping timeout: 745 seconds)