[00:01] *** BlueMax has quit IRC (Read error: Connection reset by peer) [00:02] *** BlueMax has joined #archiveteam-bs [00:24] *** Ryz has joined #archiveteam-bs [00:55] *** godane has joined #archiveteam-bs [00:55] so i finally got a iphone [01:37] *** systwi_ is now known as systwi [02:24] *** balrog has quit IRC (Read error: Operation timed out) [02:24] *** balrog has joined #archiveteam-bs [02:25] *** fredgido has quit IRC (Remote host closed the connection) [02:25] *** alex73_ has quit IRC (Read error: Connection reset by peer) [02:26] *** fredgido has joined #archiveteam-bs [02:27] *** Raccoon has quit IRC (Read error: Connection reset by peer) [02:28] *** equant has joined #archiveteam-bs [02:28] *** equant_ has quit IRC (Read error: Connection reset by peer) [02:28] *** qw3rty has joined #archiveteam-bs [02:29] *** NIC007a83 has quit IRC (Read error: Operation timed out) [02:29] *** NIC007a83 has joined #archiveteam-bs [02:32] *** Raccoon` has joined #archiveteam-bs [02:32] *** systwi_ has joined #archiveteam-bs [02:32] *** Dj-Wawa has quit IRC (Read error: Operation timed out) [02:32] *** gandalf has quit IRC (Read error: Operation timed out) [02:32] *** paul2520 has quit IRC (Read error: Operation timed out) [02:32] *** alex73_ has joined #archiveteam-bs [02:32] *** gandalf has joined #archiveteam-bs [02:32] *** paul2520 has joined #archiveteam-bs [02:33] *** kiska has quit IRC (Ping timeout: 622 seconds) [02:34] *** Dj-Wawa has joined #archiveteam-bs [02:35] *** qw3rty__ has quit IRC (Ping timeout: 622 seconds) [02:36] *** paul2520 has quit IRC (Read error: Operation timed out) [02:37] *** paul2520 has joined #archiveteam-bs [02:37] *** systwi__ has joined #archiveteam-bs [02:38] *** logchfoo2 starts logging #archiveteam-bs at Wed Mar 11 02:38:31 2020 [02:38] *** logchfoo2 has joined #archiveteam-bs [02:39] *** Wingy has quit IRC (Read error: Operation timed out) [02:39] *** Coderjo_ has quit IRC (Ping timeout: 622 seconds) [02:40] *** systwi has quit IRC (Ping timeout: 622 seconds) [02:40] *** benjinsmi has quit IRC (Read error: Operation timed out) [02:41] *** HP_Archiv has quit IRC (Read error: Operation timed out) [02:41] *** benjins has joined #archiveteam-bs [02:41] *** Coderjo has joined #archiveteam-bs [02:41] *** systwi_ has quit IRC (Read error: Operation timed out) [02:42] *** kiska3 has joined #archiveteam-bs [02:44] *** HP_Archiv has joined #archiveteam-bs [02:45] *** halt_ has quit IRC (Ping timeout: 610 seconds) [02:46] *** kiskaWee has quit IRC (Ping timeout: 610 seconds) [02:50] *** atphoenix has quit IRC (Read error: Operation timed out) [02:51] *** atphoenix has joined #archiveteam-bs [02:51] *** systwi__ is now known as systwi [02:56] *** halt_ has joined #archiveteam-bs [03:35] *** HP_Archiv has quit IRC (Leaving) [03:36] *** HP_Archiv has joined #archiveteam-bs [04:03] *** girst has quit IRC (Read error: Operation timed out) [04:18] *** qw3rty_ has joined #archiveteam-bs [04:21] *** nicolas17 has quit IRC (Quit: Konversation terminated!) [04:23] *** qw3rty has quit IRC (Ping timeout: 276 seconds) [04:38] *** girst has joined #archiveteam-bs [04:42] *** RichardG has quit IRC (Read error: Operation timed out) [04:42] *** RichardG has joined #archiveteam-bs [05:01] *** alex73_ has quit IRC (Quit: Leaving) [05:43] *** Dimtree has quit IRC () [06:10] *** Jens has quit IRC (Remote host closed the connection) [06:10] *** Jens has joined #archiveteam-bs [06:16] *** bsmith093 has quit IRC (Quit: Leaving.) [06:18] Woo, JAA, I managed to finish my article - https://www.archiveteam.org/index.php?title=Company_acquisitions_and_mergers [06:19] I wanna put more reasons on why archive company acquirements, but I couldn't put the words in a way that doesn't sound like rambling for me [07:36] *** kiska has joined #archiveteam-bs [07:36] *** svchfoo1 sets mode: +o kiska [08:17] *** Stilett0 has quit IRC () [08:24] *** tapedriv1 is now known as tapedrive [08:26] *** Stiletto has joined #archiveteam-bs [08:47] *** morgandaw has joined #archiveteam-bs [08:48] *** MeeDee has quit IRC (Read error: Operation timed out) [08:49] *** equant has quit IRC (Read error: Operation timed out) [08:49] *** Kenshin has quit IRC (Read error: Connection reset by peer) [08:49] *** kiska has quit IRC (Read error: Operation timed out) [08:49] *** Yurume has quit IRC (Read error: Operation timed out) [08:49] *** Kenshin has joined #archiveteam-bs [08:49] *** kiska has joined #archiveteam-bs [08:50] *** svchfoo1 sets mode: +o kiska [08:52] *** kiska has quit IRC (Read error: Operation timed out) [08:54] *** kiska has joined #archiveteam-bs [08:54] *** svchfoo1 sets mode: +o kiska [09:02] *** equant has joined #archiveteam-bs [09:08] *** Yurume has joined #archiveteam-bs [09:18] *** Craigle has quit IRC (Quit: Ping timeout (120 seconds)) [09:21] *** MeeDee has joined #archiveteam-bs [09:21] *** morgandaw has quit IRC (Ping timeout: 276 seconds) [09:22] *** britmob has joined #archiveteam-bs [09:23] *** dxrt has quit IRC (Ping timeout: 276 seconds) [09:24] *** qw3rty has joined #archiveteam-bs [09:26] *** britmob_ has quit IRC (Ping timeout: 276 seconds) [09:27] *** themadpro has joined #archiveteam-bs [09:28] *** qw3rty_ has quit IRC (Ping timeout: 276 seconds) [09:28] *** dxrt has joined #archiveteam-bs [09:29] *** svchfoo3 sets mode: +o dxrt [10:22] *** themadpro has quit IRC (Quit: This computer has gone to sleep) [10:38] *** ShellyRol has quit IRC (Read error: Connection reset by peer) [10:44] *** ShellyRol has joined #archiveteam-bs [10:54] *** icedice has joined #archiveteam-bs [11:00] *** themadpro has joined #archiveteam-bs [11:19] *** themadpro has quit IRC (Quit: This computer has gone to sleep) [11:29] *** Ctrl has quit IRC (Read error: Operation timed out) [12:21] *** Ctrl has joined #archiveteam-bs [12:35] *** BlueMax has quit IRC (Read error: Connection reset by peer) [13:18] *** themadpro has joined #archiveteam-bs [13:53] *** icedice2 has joined #archiveteam-bs [13:57] *** icedice has quit IRC (Read error: Connection reset by peer) [13:58] *** MRX3 has joined #archiveteam-bs [13:58] *** MRX3 has quit IRC (Client Quit) [14:04] *** icedice2 has quit IRC (Read error: Operation timed out) [14:09] *** Datechnom has quit IRC (Ping timeout: 496 seconds) [14:57] *** themadpro has quit IRC (Quit: This computer has gone to sleep) [15:56] *** betamax_ has joined #archiveteam-bs [16:02] *** betamax has quit IRC (Ping timeout: 745 seconds) [16:12] *** Craigle has joined #archiveteam-bs [16:28] *** Mayonaise has quit IRC (Read error: Operation timed out) [16:51] *** d5f4a3622 has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) [16:55] *** d5f4a3622 has joined #archiveteam-bs [17:00] *** ahmetone has joined #archiveteam-bs [17:38] *** HP_Archiv has quit IRC (Quit: Leaving) [18:04] *** ahmetone has quit IRC (Quit: This computer has gone to sleep) [18:10] *** ahmetone has joined #archiveteam-bs [18:37] *** bsmith093 has joined #archiveteam-bs [18:41] *** bsmith093 has quit IRC (Client Quit) [18:42] *** bsmith093 has joined #archiveteam-bs [18:45] *** Stiletto has quit IRC (Read error: Operation timed out) [18:48] *** bsmith093 has quit IRC (Quit: Leaving.) [18:49] *** bsmith093 has joined #archiveteam-bs [18:53] *** Stiletto has joined #archiveteam-bs [18:56] *** bashNinja has quit IRC () [18:56] *** bashNinja has joined #archiveteam-bs [19:16] *** Stilett0 has joined #archiveteam-bs [19:18] *** Stiletto has quit IRC (Ping timeout: 610 seconds) [19:44] *** bitbit has joined #archiveteam-bs [20:03] *** arkiver has quit IRC (Remote host closed the connection) [20:03] *** arkiver has joined #archiveteam-bs [20:17] *** betamax_ is now known as betamax [20:30] *** d5f4a3622 has quit IRC (Quit: https://i.imgur.com/xacQ09F.mp4) [20:33] *** Datechnom has joined #archiveteam-bs [20:34] *** bitbit has quit IRC (Leaving) [20:34] *** d5f4a3622 has joined #archiveteam-bs [20:35] so i'm slowly going to be upload gamewave [20:36] a japanese video game show [20:49] *** HP_Archiv has joined #archiveteam-bs [21:07] Hmm, interesting, looks like the old LoL forums are static files hosted on S3, maybe? http://forums.na.leagueoflegends.com/board/showthread.php?t=4923220 [21:11] *** Raccoon has quit IRC (Ping timeout: 622 seconds) [21:11] From headers, looks like S3 and Cloudflare [21:15] Cloudflare not caching [21:15] Also, there are URLs like http://www.leagueoflegends.com/board/showthread.php?t=THREADID which redirect to the corresponding thread in the requesting IP's region. [21:15] (On the forums, not the boards) [21:17] So if you browse the US forums and come across such a link, you might get redirected to a completely unrelated thread on the EU forums. Fun. [21:25] I'm already getting timeouts with a single connection. This won't go well. [21:31] *** Mayonaise has joined #archiveteam-bs [21:51] It's actually running okay at higher concurrencies. The timeouts are going to be slightly annoying but not a major issue. [21:53] First rough estimate puts the NA forums at around 5-6 GB of WARC. Note that I'm *only* grabbing the thread pages; no avatars, embedded images, etc. [21:54] So the forums crawl is ready, now looking into boards. [22:04] forums.na.leagueoflegends.com So the NS is aws but the ip that resolves to is Cloudflare, why not just use cloudfront... [22:05] Is there a good cli tool where I can say like `gimme-all-da-info "forums.na.leagueoflegends.com" ' and it'll tell me like NS, ip, ISP, ASN etc. etc. ? [22:13] Oops, missed an order of magnitude above, ~50 GB for the NA forums. Estimated runtime is something like 13 hours. [22:13] (The other forums are smaller obviously.) [22:31] *** ThisAsYou has quit IRC (Remote host closed the connection) [22:31] *** tech234a has quit IRC (Remote host closed the connection) [22:31] *** alex73 has quit IRC (Remote host closed the connection) [22:34] *** Ikata has joined #archiveteam-bs [22:34] *** jrwr has joined #archiveteam-bs [22:35] hi all [22:36] how can i help with this project [22:36] *** JSharp___ has quit IRC (Remote host closed the connection) [22:36] *** Kaz has quit IRC (Remote host closed the connection) [22:36] *** revi has quit IRC (Remote host closed the connection) [22:36] *** picklefac has quit IRC (Remote host closed the connection) [22:36] *** Vito`__ has quit IRC (Remote host closed the connection) [22:36] *** starlord has quit IRC (Remote host closed the connection) [22:36] *** amelia386 has quit IRC (Remote host closed the connection) [22:37] *** JSharp___ has joined #archiveteam-bs [22:37] *** alex73 has joined #archiveteam-bs [22:37] *** Vito`__ has joined #archiveteam-bs [22:38] *** revi has joined #archiveteam-bs [22:38] *** ThisAsYou has joined #archiveteam-bs [22:39] *** starlord has joined #archiveteam-bs [22:40] *** tech234a has joined #archiveteam-bs [22:40] *** SJon__ has joined #archiveteam-bs [22:40] *** Kaz has joined #archiveteam-bs [22:40] *** DogsRNice has joined #archiveteam-bs [22:40] *** svchfoo1 sets mode: +o Kaz [22:41] *** amelia386 has joined #archiveteam-bs [22:42] *** picklefac has joined #archiveteam-bs [22:46] *** HCross has quit IRC (Remote host closed the connection) [22:46] *** abartov__ has quit IRC (Remote host closed the connection) [22:46] *** bashNinja has quit IRC (Remote host closed the connection) [22:47] *** abartov__ has joined #archiveteam-bs [22:48] *** HCross has joined #archiveteam-bs [22:50] *** Ctrl-S___ has quit IRC (Remote host closed the connection) [22:50] *** Ivy has quit IRC (Remote host closed the connection) [22:50] *** kyledrake has quit IRC (Remote host closed the connection) [22:50] *** hook54321 has quit IRC (Remote host closed the connection) [22:50] *** octarine has quit IRC (Remote host closed the connection) [22:50] *** lenary has quit IRC (Remote host closed the connection) [22:50] *** mattl has quit IRC (Write error: Broken pipe) [22:50] *** bashNinja has joined #archiveteam-bs [22:51] *** octarine has joined #archiveteam-bs [22:51] *** lenary has joined #archiveteam-bs [22:51] *** mattl has joined #archiveteam-bs [22:53] *** kyledrake has joined #archiveteam-bs [22:53] *** Ctrl-S___ has joined #archiveteam-bs [22:53] *** godane has quit IRC (Ping timeout: 255 seconds) [22:53] *** hook54321 has joined #archiveteam-bs [22:54] *** Iglooop1 sets mode: +o hook54321 [22:55] *** Ivy has joined #archiveteam-bs [22:55] *** BlueMax has joined #archiveteam-bs [22:56] *** fallenoak has quit IRC (Remote host closed the connection) [22:56] *** c0mpass has quit IRC (Remote host closed the connection) [22:56] *** tchaypo_ has quit IRC (Remote host closed the connection) [22:56] *** jesse-s has quit IRC (Remote host closed the connection) [22:58] *** tchaypo_ has joined #archiveteam-bs [22:59] *** jesse-s has joined #archiveteam-bs [23:03] *** c0mpass has joined #archiveteam-bs [23:03] *** fallenoak has joined #archiveteam-bs [23:18] *** godane has joined #archiveteam-bs [23:21] *** godane has quit IRC (Read error: Connection reset by peer) [23:50] *** ahmetone has quit IRC (Quit: Leaving) [23:56] *** arkiver_ has joined #archiveteam-bs [23:58] *** arkiver has quit IRC (Ping timeout: 276 seconds)