#archiveteam-bs 2019-10-08,Tue

↑back Search

Time Nickname Message
01:17 🔗 arkiver has quit IRC (Ping timeout: 745 seconds)
01:18 🔗 arkiver has joined #archiveteam-bs
01:18 🔗 Fusl sets mode: +o arkiver
01:18 🔗 Fusl____ sets mode: +o arkiver
01:18 🔗 Fusl_ sets mode: +o arkiver
01:24 🔗 acridAxid has quit IRC (Quit: marauder)
01:35 🔗 benjinss has joined #archiveteam-bs
01:38 🔗 superkuh_ is now known as superkuh
01:41 🔗 benjinsmi has quit IRC (Read error: Operation timed out)
03:05 🔗 odemgi has joined #archiveteam-bs
03:07 🔗 DogsRNice has quit IRC (Read error: Connection reset by peer)
03:08 🔗 odemgi_ has quit IRC (Ping timeout: 252 seconds)
03:16 🔗 qw3rty2 has joined #archiveteam-bs
03:24 🔗 qw3rty has quit IRC (Ping timeout: 745 seconds)
04:17 🔗 HashbangI has quit IRC (Remote host closed the connection)
04:27 🔗 HashbangI has joined #archiveteam-bs
04:29 🔗 BlueMax has quit IRC (Read error: Connection reset by peer)
04:30 🔗 BlueMax has joined #archiveteam-bs
06:24 🔗 Yurume has quit IRC (Quit: No Ping reply in 180 seconds.)
06:27 🔗 DopefishJ has joined #archiveteam-bs
06:31 🔗 Yurume has joined #archiveteam-bs
06:37 🔗 kiska18 has quit IRC (Remote host closed the connection)
06:37 🔗 Ryz has quit IRC (Remote host closed the connection)
06:37 🔗 DFJustin has quit IRC (Ping timeout: 745 seconds)
06:37 🔗 kiska18 has joined #archiveteam-bs
06:37 🔗 Fusl____ sets mode: +o kiska18
06:37 🔗 Fusl sets mode: +o kiska18
06:37 🔗 Fusl_ sets mode: +o kiska18
06:37 🔗 Ryz has joined #archiveteam-bs
07:34 🔗 ReimuHaku has joined #archiveteam-bs
08:11 🔗 ReimuHaku has quit IRC (Ping timeout: 492 seconds)
08:35 🔗 terry1 has quit IRC (Quit: WeeChat 2.4)
09:54 🔗 kiska18 has quit IRC (Read error: Operation timed out)
09:55 🔗 kiska18 has joined #archiveteam-bs
09:55 🔗 Fusl____ sets mode: +o kiska18
09:55 🔗 Fusl sets mode: +o kiska18
09:55 🔗 Fusl_ sets mode: +o kiska18
10:33 🔗 deevious has quit IRC (Quit: deevious)
10:53 🔗 deevious has joined #archiveteam-bs
11:00 🔗 JAA My picosong grab is about halfway done. 1.3 TiB so far.
11:03 🔗 JAA Halfway through the IDs, I should add. Based on Dash's ID list from Disqus, there are many more occupied IDs in the higher ranges; more precisely, my crawl would be at about one quarter of all existing songs.
11:22 🔗 markedL there's a large empty gap between your current crawl range and the high range picking up again?
11:29 🔗 JAA That as well. But more of the w???? codes are occupied compared to ???? and lower (where each ? is [0-9A-Za-z]).
11:30 🔗 JAA Hopefully the gap will let the uploader catch up a bit though. It's still fighting with the backlog from yesterday's problems.
11:35 🔗 systwi_ has joined #archiveteam-bs
11:39 🔗 systwi has quit IRC (Ping timeout: 612 seconds)
12:47 🔗 schbirid has joined #archiveteam-bs
12:48 🔗 benjinss has quit IRC (Quit: Leaving)
12:49 🔗 benjins has joined #archiveteam-bs
13:07 🔗 BlueMax has quit IRC (Quit: Leaving)
13:33 🔗 Yurume has quit IRC (No Ping reply in 180 seconds.)
13:34 🔗 Yurume has joined #archiveteam-bs
13:39 🔗 Mateon1 has quit IRC (Remote host closed the connection)
13:39 🔗 Mateon1 has joined #archiveteam-bs
14:30 🔗 Yurume has quit IRC (No Ping reply in 180 seconds.)
14:30 🔗 Yurume has joined #archiveteam-bs
14:54 🔗 sep332 has joined #archiveteam-bs
15:01 🔗 fredgido_ has joined #archiveteam-bs
15:08 🔗 fredgido has quit IRC (Read error: Operation timed out)
15:13 🔗 DopefishJ is now known as DFJustin
16:01 🔗 killsushi has joined #archiveteam-bs
16:27 🔗 DogsRNice has joined #archiveteam-bs
16:31 🔗 Smiley has quit IRC (Read error: Operation timed out)
16:33 🔗 Smiley has joined #archiveteam-bs
17:30 🔗 JAA As expected, the item completion rate on picosong has dropped massively now that it's doing items with more songs than before. In fact, the drop is exactly as large as I expected from the numbers mentioned above (about 3 times slower).
17:31 🔗 JAA I'm occasionally hitting 500s from S3 now.
17:35 🔗 JAA But even at the slower rate, it should finish in time. Rough estimate puts it at 6 days remaining if it stays at this speed. And it looks like the song density is about constant for the remaining codes to be scanned.
17:35 🔗 JAA So there's a buffer of another week in case of problems.
18:11 🔗 markedL could I get more attention, help, or feedback on yourshot? There's a 25TB dataset of images that we could start with now on tracker/warrior. I suspect if we don't start this we won't get the site completely.
20:01 🔗 dxrt has quit IRC (Ping timeout: 246 seconds)
20:40 🔗 achip has joined #archiveteam-bs
20:49 🔗 ats has quit IRC (Quit: An emu10k1 in 2019??)
21:01 🔗 VADemon markedL: is there a wiki page yet? whats the link
21:02 🔗 markedL https://www.archiveteam.org/index.php?title=Your_Shot
21:06 🔗 VADemon I'll have time to look into it tomorrow ✔
21:44 🔗 ats has joined #archiveteam-bs
22:00 🔗 ndiddy has quit IRC (Quit: WeeChat 1.4)
22:02 🔗 ndiddy has joined #archiveteam-bs
22:20 🔗 JAA The upload backlog is slowly but steadily growing as I can't get the data off this machine quickly enough. Good thing I have that buffer of a week...
22:40 🔗 markedL what's the total disk space you'd need to not be limited by upload rate?
22:44 🔗 JAA markedL: To be completely independent of the upload, I'd have to be able to store everything at once, so 5-6 TiB. But part of that is already done, and I can upload about three quarters of the data in real time currently. Well, part of that is buffered on another machine, but that's not really relevant.
22:46 🔗 JAA I'll have to look into what exactly is limiting me tomorrow. Might just be the bandwidth limit on the uplink, but it could also be something with the transatlantic connection and/or TCP settings.
23:13 🔗 HashbangI has quit IRC (Remote host closed the connection)
23:16 🔗 BlueMax has joined #archiveteam-bs
23:23 🔗 HashbangI has joined #archiveteam-bs
23:54 🔗 godane has quit IRC (Ping timeout: 745 seconds)

irclogger-viewer