[00:08] seems online now [00:20] *** bwn has joined #archiveteam-bs [00:22] I'm brute forcing WERU community radio's archives, or trying to at any rate [00:22] 17% done, found 30GB of audio [00:25] *** SimpBrain has quit IRC (Read error: Operation timed out) [00:34] *** Marcelo has quit IRC (Ping timeout: 240 seconds) [00:37] *** Marcelo has joined #archiveteam-bs [01:19] *** Start has joined #archiveteam-bs [01:21] *** SimpBrain has joined #archiveteam-bs [01:24] *** nightpool has quit IRC (Ping timeout: 183 seconds) [01:35] Given a json list of files and directories, is there a way to traverse through them? [01:35] like, with a browser addon or something [01:36] Eh, that's a really unclear question [01:36] * kyan is unsure how to ask what he's trying to ask... [01:37] i know what you are trying to ask [01:37] perhaps a treeview [01:37] i did it with xml, but i made the prog myself [01:37] there are xml viewers, so i assume there is json ones too [01:38] *** remsen has joined #archiveteam-bs [01:39] https://chrome.google.com/webstore/detail/jsonview/chklaanhfefbnpoihckbnefhakgolnmc?hl=en ? [01:40] joepie91, trying it but it's not doing anything... maybe the data's not json? [01:41] mind if I PM you? [01:43] go ahead [01:54] *** primus104 has quit IRC (Leaving.) [02:02] *** JesseW has joined #archiveteam-bs [02:04] *** Marcelo has quit IRC (Ping timeout: 240 seconds) [02:25] *** nightpool has joined #archiveteam-bs [02:29] *** bwn has quit IRC (Ping timeout: 252 seconds) [02:47] *** nightpool has quit IRC (Ping timeout: 183 seconds) [02:47] *** nightpool has joined #archiveteam-bs [02:57] here's a github repo detailing how SilverPush (the creepy cross-device tracking technology) works: https://github.com/MAVProxyUser/SilverPushUnmasked [02:58] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [02:59] *** nightpool has quit IRC (Ping timeout: 615 seconds) [02:59] *** Lord_Nigh has joined #archiveteam-bs [02:59] *** nightpool has joined #archiveteam-bs [03:01] *** Coderjoe_ has joined #archiveteam-bs [03:02] *** JesseW has quit IRC (Leaving.) [03:03] *** Coderjoe has quit IRC (Read error: Operation timed out) [03:16] *** vitzli has joined #archiveteam-bs [03:24] *** nightpool has quit IRC (Ping timeout: 258 seconds) [03:25] *** Marcelo has joined #archiveteam-bs [03:35] *** nightpool has joined #archiveteam-bs [03:39] https://pbs.twimg.com/media/CVHDrblWcAAtlAo.png:large this is such an aggrevating bug [03:54] *** BlueMaxim has joined #archiveteam-bs [04:07] *** nightpool has quit IRC (Ping timeout: 183 seconds) [04:27] *** Marcelo has quit IRC (Quit: Page closed) [04:31] *** Coderjoe_ has quit IRC (Read error: Operation timed out) [04:34] *** Coderjoe has joined #archiveteam-bs [04:35] do you guys think that docsoc will be backed up before it closes? [04:35] it's gonna be december 1st in like 25 minutes [04:44] it might be close, but most places don't go to the trouble of setting a script or whatever to go exactly at midnight. [04:56] *** Coderjoe has quit IRC (Read error: Connection reset by peer) [05:01] *** Coderjoe has joined #archiveteam-bs [05:03] *** Marcelo has joined #archiveteam-bs [05:08] *** Marcelo has quit IRC (Quit: http://chat.efnet.org (Ping timeout)) [05:12] *** vitzli has quit IRC (Leaving) [05:16] *** aaaaaaaaa has quit IRC (Leaving) [05:18] *** nightpool has joined #archiveteam-bs [05:23] *** superkuh has quit IRC (Read error: Connection reset by peer) [05:24] *** nightpool has quit IRC (Ping timeout: 360 seconds) [05:27] *** superkuh has joined #archiveteam-bs [05:29] *** JesseW has joined #archiveteam-bs [05:30] *** nightpool has joined #archiveteam-bs [05:48] *** ndiddy has quit IRC (Quit: Leaving) [05:48] *** nightpool has quit IRC (Read error: Operation timed out) [05:57] *** vitzli has joined #archiveteam-bs [05:59] *** nightpool has joined #archiveteam-bs [05:59] *** Sk1d has quit IRC (Read error: Operation timed out) [06:10] *** nightpool has quit IRC (Ping timeout: 255 seconds) [06:14] *** DMackey- has joined #archiveteam-bs [06:16] *** DMackey has quit IRC (Ping timeout: 310 seconds) [06:27] *** nightpool has joined #archiveteam-bs [06:40] Is there a view-arbitrary warcs online tool around right now? [06:54] Looks like we're steadily going through the items [06:54] oh [06:54] that was for effteepee [07:05] *** nightpool has quit IRC (Ping timeout: 183 seconds) [07:12] Docstoc's closing today [07:12] arkiver ^ [07:12] according to the site [08:18] Docstoc's dead. :( [08:18] http://www.docstoc.com/goodbye [08:22] arkiver, tracker is going mad - 0.4 mb elemnts [08:23] joepie91, are you around? [08:25] http://tracker.archiveteam.org/docstoc/ - bunch of 0.4 items, likely the shutdown message [08:29] *** primus104 has joined #archiveteam-bs [08:34] *** bwn has joined #archiveteam-bs [08:40] *** kyan has quit IRC (Ping timeout: 258 seconds) [08:52] *** afics has quit IRC (Quit: Quit.) [08:52] *** afics has joined #archiveteam-bs [09:11] *** JesseW has quit IRC (Leaving.) [09:12] *** JesseW has joined #archiveteam-bs [09:13] *** JesseW has quit IRC (Client Quit) [09:25] *** arkiver2 has joined #archiveteam-bs [09:36] *** RedType has quit IRC (Read error: Operation timed out) [09:52] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [09:57] *** arkiver2 has joined #archiveteam-bs [10:02] *** nightpool has joined #archiveteam-bs [10:06] *** nightpool has quit IRC (Ping timeout: 258 seconds) [10:20] *** DMackey has joined #archiveteam-bs [10:20] *** Sk1d has joined #archiveteam-bs [10:23] *** DMackey- has quit IRC (Ping timeout: 310 seconds) [10:32] *** schbirid has joined #archiveteam-bs [10:46] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [10:46] *** arkiver2 has joined #archiveteam-bs [11:06] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [11:38] *** BlueMaxim has quit IRC (Quit: Leaving) [11:41] *** Stiletto has quit IRC (Read error: Connection reset by peer) [11:42] *** Stiletto has joined #archiveteam-bs [12:08] *** Stiletto has quit IRC (Read error: Connection reset by peer) [12:09] *** Stiletto has joined #archiveteam-bs [12:33] *** remsen has quit IRC (Read error: Operation timed out) [12:39] *** remsen has joined #archiveteam-bs [12:50] vitzli: semi around [12:50] wow, that's a fucking low-effort shutdown page [12:51] thanks, kk, bye [12:51] joepie91: they have an image [12:51] with three different fonts [12:53] *** RedType has joined #archiveteam-bs [12:53] check out the source code :) they stuffed a beacon there anyway [12:55] beacon! [12:55] "errorBeacon" [13:04] *** DMackey- has joined #archiveteam-bs [13:07] *** DMackey has quit IRC (Ping timeout: 310 seconds) [13:17] *** primus104 has quit IRC (Leaving.) [14:40] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [15:00] *** DMackey has joined #archiveteam-bs [15:01] *** DMackey- has quit IRC (Ping timeout: 310 seconds) [15:11] i'm at 524k items now [15:25] *** Start has quit IRC (Quit: Disconnected.) [15:26] *** Stiletto has quit IRC (Read error: Operation timed out) [15:32] *** primus104 has joined #archiveteam-bs [15:40] arkiver: err, bacon. :P [15:53] *** Start has joined #archiveteam-bs [15:56] rutracker.org will perform emergency training on December 6, from 00:00 to 23:59 MSK (UTC+3). On this day all access from Russian IP addresses will be blocked. The intent is to prepare users for imminent country-wide block by ISPs. [15:56] source, in russian: http://rutracker.org/forum/viewtopic.php?t=5125186 [16:03] http://baike.baidu.com/robots.txt [16:03] laamme [16:04] *** nightpool has joined #archiveteam-bs [16:04] I don't get it [16:04] can baike be high priority for the wiki project? [16:04] the last one is disallow for all [16:05] i.e. blocks the wayback [16:05] *** primus104 has quit IRC (Leaving.) [16:07] how is baike a wiki? [16:08] in the broad sense of the word? ¯\_(ツ)_/¯ [16:08] it doesn't look like a wiki [16:09] it's a collaborative encyclopedia? [16:27] *** nightpool has quit IRC (Read error: Operation timed out) [16:41] i'm uploading uk lego katalogs [16:49] https://paragonie.com/files/blog/base64_a_password.png [16:50] arkiver: it does look like a wiki :P [16:50] look at the numbers on the frontpage [17:01] *** vitzli has quit IRC (Quit: Leaving) [17:03] *** Start has quit IRC (Quit: Disconnected.) [17:11] *** JesseW has joined #archiveteam-bs [17:19] *** Start has joined #archiveteam-bs [17:35] *** JesseW has quit IRC (Leaving.) [17:45] *** primus104 has joined #archiveteam-bs [18:17] *** nightpool has joined #archiveteam-bs [18:22] *** RichardG has quit IRC (Read error: Connection reset by peer) [18:24] *** RichardG has joined #archiveteam-bs [18:39] *** Start has quit IRC (Quit: Disconnected.) [18:44] *** Stiletto has joined #archiveteam-bs [18:54] *** nightpool has quit IRC (Read error: Operation timed out) [19:10] *** nightpool has joined #archiveteam-bs [19:11] *** primus105 has joined #archiveteam-bs [19:13] *** primus104 has quit IRC (Read error: Operation timed out) [19:34] *** bwn has quit IRC (Ping timeout: 606 seconds) [19:37] *** Start has joined #archiveteam-bs [20:01] *** bwn has joined #archiveteam-bs [20:37] Perhaps a dumb question, but has anyone here tried using Amazon Cloud Drive as the storage backend for an rsync target? [20:42] *** Start has quit IRC (Quit: Disconnected.) [20:48] *** Start has joined #archiveteam-bs [20:58] *** aaaaaaaaa has joined #archiveteam-bs [21:01] *** nightpool has quit IRC (Ping timeout: 310 seconds) [21:05] uploaded: https://archive.org/details/worldbricks.com-download-id-1-to-1000-20151201 [21:07] *** GLaDOS has quit IRC (Read error: Operation timed out) [21:09] *** GLaDOS has joined #archiveteam-bs [21:09] *** midas sets mode: +o GLaDOS [21:09] godane: You're awesome and insane. [21:10] i know [21:12] they use urls like this: http://worldbricks.com/en/catalog-year/1990/catalogs-1990.raw?task=download&fid=1000 [21:12] Right, which makes it really easy to go "for i in {1..1000}; do wget http://worldbricks.com/sadfasdf/foo/bar/$i; done" [21:12] whats funny is that path is meant for download id 2877 [21:13] thats mostly want i'm doing [21:14] but since i'm using content-disposition i make sure it enter a file that name as the download id [21:15] http://pastebin.com/NUgww1v7 [21:16] by putting them in folders i don't risk downloading over something [21:16] also its a way to keep track of the download ids [21:18] you can even get pdfs using this url: http://worldbricks.com/en/en.raw?task=download&fid=1984 [21:38] Does anyone know if the warrior stuff/scripts work over IPv6? [21:54] so i found the Japan version of Sega Saturn Magazine [22:00] *** remsen has quit IRC (Read error: Operation timed out) [22:02] *** BlueMaxim has joined #archiveteam-bs [22:03] HCross: I can't remember either way, but I would think so. I believe all the parts have support for it. Probably the main issue is if wget-lua has support compiled in. [22:04] But it probably isn't a priority, as much of the web is IPv4 or dual stack. [22:06] generally you don't want to experiment with unusual configurations when running a warrior in case it fucks up the results [22:06] there are probably still websites out there that behave unexpectedly or show errors when retrieved over ipv6 [22:07] true, was just curious as that could help with IP limiting/rating [22:11] *** nightpool has joined #archiveteam-bs [22:16] *** Start has quit IRC (Quit: Disconnected.) [22:22] *** nightpool has quit IRC (Read error: Operation timed out) [22:23] *** bwn has quit IRC (Ping timeout: 606 seconds) [22:49] *** Lord_Nigh has joined #archiveteam-bs [23:16] *** schbirid has quit IRC (Quit: Leaving) [23:17] *** Start has joined #archiveteam-bs [23:26] *** nightpool has joined #archiveteam-bs [23:33] *** bwn has joined #archiveteam-bs [23:47] *** remsen has joined #archiveteam-bs [23:49] *** nightpool has quit IRC (Read error: Operation timed out)