[00:09] *** mistym has quit IRC (Remote host closed the connection) [00:23] *** mistym has joined #archiveteam-bs [00:32] *** wp494 has quit IRC (LOUD UNNECESSARY QUIT MESSAGES) [00:43] *** wp494 has joined #archiveteam-bs [00:48] *** aaaaaaaaa has quit IRC (Ping timeout: 370 seconds) [00:56] *** aaaaaaaaa has joined #archiveteam-bs [00:56] *** swebb sets mode: +o aaaaaaaaa [01:20] *** username1 has joined #archiveteam-bs [01:22] *** schbirid has quit IRC (Read error: Operation timed out) [01:22] *** schbirid2 has quit IRC (Write error: Broken pipe) [01:22] *** schbirid has joined #archiveteam-bs [01:27] *** JesseW has joined #archiveteam-bs [01:34] *** primus104 has quit IRC (Leaving.) [02:14] so i fixed a usb stick twice [02:14] its not copying files on ext4 format so i'm going with ext2 for it [02:16] *** BlueMaxim has joined #archiveteam-bs [02:43] *** JesseW has quit IRC (Quit: Leaving.) [02:45] *** Start has quit IRC (Disconnected.) [02:59] *** mistym has quit IRC (Remote host closed the connection) [03:00] *** Coderjoe has quit IRC (Read error: Operation timed out) [03:02] *** Coderjoe has joined #archiveteam-bs [03:04] *** bzc6p_ has joined #archiveteam-bs [03:04] *** swebb sets mode: +o bzc6p_ [03:06] *** bzc6p has quit IRC (Read error: Operation timed out) [03:11] *** lytv has quit IRC (Ping timeout: 306 seconds) [03:14] *** lytv has joined #archiveteam-bs [03:20] *** mistym has joined #archiveteam-bs [03:24] *** Start has joined #archiveteam-bs [03:27] *** Sue_ has quit IRC (Remote host closed the connection) [03:36] *** JesseW has joined #archiveteam-bs [03:49] E-mail inbox from 60 to 21 [04:03] *** mistym has quit IRC (Remote host closed the connection) [04:06] *** mistym has joined #archiveteam-bs [04:34] *** aaaaaaaaa has quit IRC (Leaving) [04:54] so i'm not using that usb stick [05:20] so there over 30k urls in November 2013 for medium.com [05:21] btw 4145 urls have 410 gone errors in October 2013 [05:30] *** mistym_ has joined #archiveteam-bs [05:30] *** mistym has quit IRC (Read error: Connection reset by peer) [05:47] *** McGEE has quit IRC (Quit: Connection closed for inactivity) [06:06] i'm really glad i'm grabbing medium.com [06:40] *** thechip_ has quit IRC (Ping timeout: 370 seconds) [06:44] *** mistym_ has quit IRC (Remote host closed the connection) [07:27] *** JesseW has quit IRC (Read error: Operation timed out) [07:46] *** mistym has joined #archiveteam-bs [07:50] *** mistym has quit IRC (Ping timeout: 252 seconds) [08:17] *** primus104 has joined #archiveteam-bs [08:27] *** Rickster has quit IRC (Quit: ZNC - http://znc.in) [08:31] i just found something interesting about fastcompany.com [08:32] for example article fastcompany.com/3045676 release may 23 2015 [08:33] for example article fastcompany.com/3045677 release may 21 2015 [08:33] i just that was funny cause there not ever doing the numbers in order [08:37] also know that there is a 1000 url limit for site map [08:44] *** primus104 has quit IRC (Leaving.) [08:44] *** Rickster has joined #archiveteam-bs [09:46] *** bzc6p_ is now known as bzc6p [09:47] *** mistym has joined #archiveteam-bs [09:53] *** mistym has quit IRC (Read error: Operation timed out) [10:36] *** primus104 has joined #archiveteam-bs [10:41] so november 2013 of medium.com has over 14k urls with 410 gone errors [10:41] so about half of that month urls are gone [10:48] *** mistym has joined #archiveteam-bs [11:01] *** mistym has quit IRC (Read error: Operation timed out) [11:49] *** mistym has joined #archiveteam-bs [11:57] *** mistym has quit IRC (Ping timeout: 492 seconds) [12:20] *** McGEE has joined #archiveteam-bs [12:23] *** schbirid has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** winr4r has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** lexicon has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** Smiley has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** boozehoun has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** closure has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** Mayonaise has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** ohhdemgir has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:23] *** Nertsy has quit IRC (ircd.choopa.net irc.teksavvy.ca) [12:24] *** schbirid has joined #archiveteam-bs [12:24] *** winr4r has joined #archiveteam-bs [12:24] *** lexicon has joined #archiveteam-bs [12:24] *** Smiley has joined #archiveteam-bs [12:24] *** boozehoun has joined #archiveteam-bs [12:24] *** Mayonaise has joined #archiveteam-bs [12:24] *** closure has joined #archiveteam-bs [12:24] *** ohhdemgir has joined #archiveteam-bs [12:24] *** Nertsy has joined #archiveteam-bs [12:37] godane: and all of those are saved? [12:41] *** sankin has joined #archiveteam-bs [13:36] *** BlueMaxim has quit IRC (Quit: Leaving) [14:00] *** Start has quit IRC (Disconnected.) [14:27] *** McGEE has quit IRC (Quit: Connection closed for inactivity) [14:31] *** DFJustinZ has joined #archiveteam-bs [14:34] *** mistym has joined #archiveteam-bs [14:41] *** Sk1d has quit IRC (Quit: ZNC - http://znc.in) [14:42] *** mistym has quit IRC (Remote host closed the connection) [14:45] *** DFJustin has quit IRC (Remote host closed the connection) [14:59] *** JesseW has joined #archiveteam-bs [15:01] *** Start has joined #archiveteam-bs [15:04] *** Sk1d has joined #archiveteam-bs [15:06] *** mistym has joined #archiveteam-bs [15:11] *** bzc6p_ has joined #archiveteam-bs [15:11] *** swebb sets mode: +o bzc6p_ [15:16] *** bzc6p has quit IRC (Read error: Operation timed out) [15:22] *** bzc6p_ is now known as bzc6p [15:24] *** JesseW has quit IRC (Read error: Operation timed out) [15:50] *** Start has quit IRC (Disconnected.) [15:51] *** mistym has quit IRC (Remote host closed the connection) [15:55] I don't know if I'm the only one who thinks that some pages on the wiki listing projects are not integrated well enough. I've come up with an idea to change this. In fact, I've also worked out this idea. [15:56] The full proposal can be read here: http://archiveteam.org/index.php?title=User:Bzc6p/Restructuring_projects_pages [15:56] and the working prototype / sample pages start here: http://archiveteam.org/index.php?title=User:Bzc6p/Projects [15:57] I'd like to know what you think about it, whether you like it, and whether this idea can be applied. [15:58] Thanks. [16:01] *** trs80 has joined #archiveteam-bs [16:06] *** Start has joined #archiveteam-bs [16:06] *** mistym has joined #archiveteam-bs [16:20] *** BlueMaxim has joined #archiveteam-bs [16:20] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [16:20] *** BlueMaxim has joined #archiveteam-bs [16:25] *** Rickster has quit IRC (Quit: ZNC - http://znc.in) [16:39] *** Rickster has joined #archiveteam-bs [16:44] *** Start has quit IRC (Disconnected.) [16:48] *** aaaaaaaaa has joined #archiveteam-bs [16:48] *** swebb sets mode: +o aaaaaaaaa [17:15] *** Start has joined #archiveteam-bs [17:42] *** Start has quit IRC (Disconnected.) [18:08] So, when should we start scraping reddit, guys?\ [18:11] We are already scraping reddit [18:11] So I'd say a week ago [18:26] Nice. [18:27] SketchCow: is there a channel for reddit? [18:28] No, we just have people grabbing it [18:29] It's shitlords being shitlords [18:29] C'est la reddit [18:30] SketchCow: furaffinity project is almost done. i plan to finish it up this weekend [18:30] Great [18:31] chfoo: can you please create an rsync for trovebox on FOS, we can finish that project then [18:32] arkiver: trovebox already has one. [18:32] It's not available anymore, SketchCow has aleady cleaned and deleted it [18:33] arkiver: it should be back now. was there anything else i was supposed to do before? [18:34] not really, yipdw helped me out with the projects.json [18:39] *** Rickster has quit IRC (Quit: ZNC - http://znc.in) [18:53] *** Start has joined #archiveteam-bs [18:56] *** Muad-Dib has joined #archiveteam-bs [19:02] *** mistym has quit IRC (Remote host closed the connection) [19:07] *** Rickster has joined #archiveteam-bs [19:10] *** rejon has joined #archiveteam-bs [19:21] *** mistym has joined #archiveteam-bs [19:25] *** Start has quit IRC (Disconnected.) [19:30] *** Start has joined #archiveteam-bs [19:39] *** Start has quit IRC (Disconnected.) [19:39] *** Start has joined #archiveteam-bs [19:42] *** Start has quit IRC (Client Quit) [19:58] *** mistym has quit IRC (Remote host closed the connection) [20:00] *** ripvanwin has quit IRC (Leaving) [20:13] *** mistym has joined #archiveteam-bs [20:53] *** rejon has quit IRC (Ping timeout: 258 seconds) [20:54] *** rejon has joined #archiveteam-bs [21:00] *** sankin has quit IRC (Leaving.) [21:11] *** rejon has quit IRC (Ping timeout: 258 seconds) [22:06] *** McGEE has joined #archiveteam-bs [22:35] *** Start has joined #archiveteam-bs [22:48] *** rejon has joined #archiveteam-bs [23:30] *** Start has quit IRC (Read error: Connection reset by peer) [23:34] *** Start has joined #archiveteam-bs