[00:05] *** ndiddy has joined #archiveteam-bs [00:43] *** BlueMax has joined #archiveteam-bs [01:29] *** Soni has quit IRC (Remote host closed the connection) [01:37] *** Soni has joined #archiveteam-bs [01:49] *** ndiddy has quit IRC (Ping timeout: 260 seconds) [01:58] *** ndiddy has joined #archiveteam-bs [01:59] *** ndiddy has quit IRC (Client Quit) [02:05] HCross: yeah there´s quite some project on there now, I agree we should do some cleaning up [03:07] *** twigfoot has joined #archiveteam-bs [03:42] *** odemg has quit IRC (Ping timeout: 260 seconds) [03:54] *** bithippo has quit IRC (My MacBook Air has gone to sleep. ZZZzzz…) [03:55] *** odemg has joined #archiveteam-bs [04:28] *** Arctic has joined #archiveteam-bs [05:10] *** Arctic has quit IRC (Quit: Page closed) [06:15] *** kiska has quit IRC (Quit: The Lounge - https://thelounge.github.io) [06:16] *** kiska has joined #archiveteam-bs [06:16] *** dxrt has quit IRC (Ping timeout: 252 seconds) [06:16] *** dxrt- has joined #archiveteam-bs [06:20] *** faoling__ has joined #archiveteam-bs [06:20] *** faoling__ has quit IRC (Killed (se.hub (Nick collision (new)))) [06:20] *** medowar has quit IRC (Ping timeout: 252 seconds) [06:20] *** hook54321 has quit IRC (Ping timeout: 252 seconds) [06:20] *** faolingfa has quit IRC (Ping timeout: 252 seconds) [06:21] *** betamax_ has joined #archiveteam-bs [06:21] *** faolingfa has joined #archiveteam-bs [06:22] *** Zebranky_ has joined #archiveteam-bs [06:22] *** astrid has joined #archiveteam-bs [06:22] *** swebb sets mode: +o astrid [06:22] *** betamax has quit IRC (Ping timeout: 252 seconds) [06:22] *** medowar has joined #archiveteam-bs [06:22] *** Zebranky has quit IRC (Ping timeout: 252 seconds) [06:23] *** second has quit IRC (Ping timeout: 252 seconds) [06:23] *** hook54321 has joined #archiveteam-bs [06:25] *** second has joined #archiveteam-bs [06:28] *** hook54321 has quit IRC (se.hub irc.underworld.no) [06:28] *** medowar has quit IRC (se.hub irc.underworld.no) [06:28] *** kiska has quit IRC (se.hub irc.underworld.no) [06:28] *** Frogging has quit IRC (se.hub irc.underworld.no) [06:28] *** rektide_ has quit IRC (se.hub irc.underworld.no) [06:28] *** joepie91 has quit IRC (se.hub irc.underworld.no) [06:28] *** Flashfire has quit IRC (se.hub irc.underworld.no) [06:28] *** DragonMon has quit IRC (se.hub irc.underworld.no) [06:28] *** Ing3b0rg has quit IRC (se.hub irc.underworld.no) [06:28] *** ReimuHaku has quit IRC (se.hub irc.underworld.no) [06:28] *** w0rmhole has quit IRC (se.hub irc.underworld.no) [06:28] *** i0npulse has quit IRC (se.hub irc.underworld.no) [06:32] *** kiska1 has joined #archiveteam-bs [06:33] * astrid beeps quietly [06:34] *** joepie91_ has joined #archiveteam-bs [06:35] *** LeG0ax has joined #archiveteam-bs [06:44] *** LeG0ax is now known as Ing3b0rg [07:01] *** phuzion has quit IRC (Read error: Operation timed out) [07:01] *** phuzion has joined #archiveteam-bs [07:03] *** faolingfa has quit IRC (Read error: Operation timed out) [07:04] *** tyzoid has quit IRC (Read error: Operation timed out) [07:04] *** faolingfa has joined #archiveteam-bs [07:06] *** unlobito has quit IRC (Ping timeout: 611 seconds) [07:06] *** unlobito has joined #archiveteam-bs [07:09] *** K4k_ has quit IRC (Ping timeout: 621 seconds) [07:09] *** K4k_ has joined #archiveteam-bs [07:11] *** wp494 has quit IRC (Read error: Operation timed out) [07:11] *** PotcFdk has quit IRC (Ping timeout: 602 seconds) [07:11] *** underscor has quit IRC (Ping timeout: 602 seconds) [07:11] *** TigerbotH has quit IRC (Read error: Operation timed out) [07:11] *** beardicus has quit IRC (Read error: Operation timed out) [07:13] *** arkiver has quit IRC (Ping timeout: 607 seconds) [07:16] *** C4K3 has quit IRC (Ping timeout: 605 seconds) [07:17] *** arkiver has joined #archiveteam-bs [07:17] *** RedType has quit IRC (Read error: Connection reset by peer) [07:25] arkiver: weve got govcatalog, newspapers, tindeck, zetaboards, accuweather, jammedforums, quizget, wikispaces and zifboards [07:29] *** wp494 has joined #archiveteam-bs [07:29] *** beardicus has joined #archiveteam-bs [07:30] *** kiska1 has quit IRC (Ping timeout: 600 seconds) [07:31] *** kiska1 has joined #archiveteam-bs [07:33] *** TigerbotH has joined #archiveteam-bs [07:35] *** tyzoid has joined #archiveteam-bs [07:45] *** RedType has joined #archiveteam-bs [07:46] *** C4K3 has joined #archiveteam-bs [07:55] *** Frogging has joined #archiveteam-bs [07:55] *** rektide_ has joined #archiveteam-bs [07:55] *** DragonMon has joined #archiveteam-bs [07:55] *** ReimuHaku has joined #archiveteam-bs [07:58] *** i0npulse has joined #archiveteam-bs [08:09] *** PotcFdk has joined #archiveteam-bs [08:33] *** schbirid has joined #archiveteam-bs [08:46] *** Flashfire has joined #archiveteam-bs [09:00] *** C4K3 has quit IRC (Lost terminal) [10:28] *** kiska has joined #archiveteam-bs [10:44] *** Dark_Star has quit IRC (Ping timeout: 633 seconds) [10:45] *** Dark_Star has joined #archiveteam-bs [11:11] *** Dark_Star has quit IRC (Ping timeout: 506 seconds) [11:17] *** dxrt- is now known as dxrt [11:17] *** dxrt has quit IRC (Quit: ZNC - http://znc.sourceforge.net) [11:17] *** dxrt has joined #archiveteam-bs [11:25] *** Dark_Star has joined #archiveteam-bs [11:44] *** BlueMax has quit IRC (Quit: Leaving) [11:46] *** Dark_Star has quit IRC (Ping timeout: 506 seconds) [11:47] *** Dark_Star has joined #archiveteam-bs [11:54] *** C4K3 has joined #archiveteam-bs [12:24] *** Dark_Star has quit IRC (Ping timeout: 492 seconds) [12:29] *** Dark_Star has joined #archiveteam-bs [12:41] *** zino has quit IRC (Quit: Leaving) [12:42] *** zino has joined #archiveteam-bs [12:55] PurpleSym: Looks like purplebot died a few days ago. [13:12] *** purplebot has joined #archiveteam-bs [13:12] JAA: Yeah, restarted the server, but not the bot. [13:29] PurpleSym: Thanks! [13:35] *** JAA sets mode: +o PurpleSym [14:06] *** wp494 has quit IRC (Read error: Operation timed out) [14:07] *** wp494 has joined #archiveteam-bs [14:10] second: the guardian frontend git repo contains a .pack file that is 600 MB, whereas the uncompressed checkout contents are only ~250MB so i wonder what's hiding in there [14:31] do you take bets? [14:31] because a brazillion times leftpad and other node modules are my bet [14:34] guardian_frontend.zip 114MB (downloaded from github) guardian_frontend/ 930MB (cloned from github) guardian_frontend.txz 613MB (tar -J of the clone) [14:45] A 'git clone --mirror' is 626 MiB, and a bundle of that mirror is 601 MiB. [14:45] *** ebel__ has quit IRC (Quit: WeeChat 0.4.2) [14:52] fenn: git contains revisions :P [14:52] a release zip does not [15:03] *** sknebel_ has quit IRC (Read error: Operation timed out) [15:43] *** superkuh_ is now known as superkuh [15:44] *** sknebel has joined #archiveteam-bs [16:20] second: started a grab-site crawl to get the browser viewable content over the entire guardian github [16:28] Oh dear, I hope you have a good ignore list. [16:37] it doesnt seem to be getting much crap [16:41] Not much "crap", but a lot of redundant views, e.g. diffs in normal and unified view, contents of each file on each commit (which can be combined from the root commit and the diffs), commit history starting from each commit for each file, etc. [16:42] Also the various filters on issues and PRs (which happen to also be heavily rate-limited). [16:47] *** ndiddy has joined #archiveteam-bs [17:16] *** Jon has quit IRC (Ping timeout: 268 seconds) [17:17] *** jmtd has joined #archiveteam-bs [17:28] *** adinbied has quit IRC (Ping timeout: 255 seconds) [17:31] *** second has quit IRC (Read error: Connection reset by peer) [17:32] *** second has joined #archiveteam-bs [18:00] *** Mateon1 has quit IRC (Ping timeout: 492 seconds) [18:00] *** Mateon1 has joined #archiveteam-bs [18:06] *** chferfa has joined #archiveteam-bs [18:40] *** adinbied has joined #archiveteam-bs [18:52] *** caff has joined #archiveteam-bs [18:55] *** adinbied_ has joined #archiveteam-bs [18:55] *** adinbied has quit IRC (Ping timeout: 260 seconds) [19:09] *** hook54321 has joined #archiveteam-bs [19:15] *** adinbied_ is now known as adinbied [20:54] *** chferfa has quit IRC () [21:07] *** ndiddy_ has joined #archiveteam-bs [21:08] *** ndiddy has quit IRC (Ping timeout: 255 seconds) [21:39] i'm having trouble grabbing this pdf: http://www.dtic.mil/docs/citations/ADA567603 [21:39] * http://www.dtic.mil/dtic/tr/fulltext/u2/a567603.pdf [21:48] their HTTP server doesn't say how big it is [21:48] 2018-09-03 21:48:13 (976 KB/s) - Read error at byte 25578820 (Connection reset by peer).Retrying. [21:48] 2018-09-03 21:48:39 (1023 KB/s) - Read error at byte 25582615 (Connection reset by peer).Retrying. [21:48] it cannot be grabbed, server is busted [21:54] *** schbirid has quit IRC (Remote host closed the connection) [22:49] *** jspiros has quit IRC (Read error: Operation timed out) [23:01] *** jspiros has joined #archiveteam-bs [23:21] *** RichardG has quit IRC (Read error: Operation timed out) [23:21] *** RichardG_ has joined #archiveteam-bs [23:22] *** caff has quit IRC (Read error: Connection reset by peer) [23:23] ivan: thats what i figured [23:29] anyways i'm to 135.9TB now [23:29] for all my uploads [23:30] size: 135,909,988,620 KB [23:50] Holy crap