[00:19] <10K items to go on thingiverse currently [00:19] I'd probably get the next batch ready to be loaded in [00:24] thingiverse is now out of items to do [00:25] wp494: mmmm. what was the first batch? [00:25] like, up to what number [00:26] new items added. [00:26] oh [00:26] arkiver is awake [00:26] :P [00:26] * arkiver is afk for the night [00:26] arkiver: hold [00:26] nope [00:26] arkiver: if new items need adding, wat do? [00:26] (if I'm still awake) [00:27] everything up to 1000000 (million) is now in the tracker [00:27] awesome, ty [00:32] *** Deewiant has quit IRC (Ping timeout: 198 seconds) [00:32] *** tephra_ has quit IRC (Ping timeout: 240 seconds) [00:32] *** tephra has joined #archiveteam [00:33] *** Deewiant has joined #archiveteam [00:34] *** vitzli has joined #archiveteam [00:35] *** JesseW has joined #archiveteam [00:51] *** robink has quit IRC (Ping timeout: 492 seconds) [00:52] *** robink has joined #archiveteam [00:52] *** primus104 has quit IRC (Leaving.) [01:28] *** RichardG has joined #archiveteam [01:31] *** vitzli has quit IRC (Quit: Leaving) [01:40] *** dashcloud has quit IRC (Read error: Operation timed out) [01:44] *** dashcloud has joined #archiveteam [02:04] *** JesseW has quit IRC (Read error: Operation timed out) [02:04] *** BlueMaxim has joined #archiveteam [02:05] *** dashcloud has quit IRC (Read error: Operation timed out) [02:17] *** dashcloud has joined #archiveteam [02:51] *** JesseW has joined #archiveteam [02:54] *** dashcloud has quit IRC (Read error: Operation timed out) [02:57] *** dashcloud has joined #archiveteam [03:39] *** vitzli has joined #archiveteam [04:03] *** aaaaaaaa_ has joined #archiveteam [04:03] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [04:11] *** aaaaaaaa_ is now known as aaaaaaaaa [04:11] *** zenguy_pc has quit IRC (Ping timeout: 258 seconds) [04:17] *** aaaaaaaaa has quit IRC (Leaving) [04:40] *** dashcloud has quit IRC (Read error: Operation timed out) [04:43] *** dashcloud has joined #archiveteam [04:56] *** khaoohs has joined #archiveteam [05:00] *** logan has joined #archiveteam [05:01] *** khaoohs_ has quit IRC (Read error: Operation timed out) [05:03] *** logan2 has quit IRC (Ping timeout: 258 seconds) [05:04] *** Infreq_ has joined #archiveteam [05:04] *** ZeroDogg has joined #archiveteam [05:06] *** Zero_Dogg has quit IRC (hub.efnet.us irc.Prison.NET) [05:06] *** MrRadar has quit IRC (hub.efnet.us irc.Prison.NET) [05:06] *** Infreq has quit IRC (hub.efnet.us irc.Prison.NET) [05:06] *** db48x has quit IRC (hub.efnet.us irc.Prison.NET) [05:15] *** MrRadar_ has joined #archiveteam [05:25] *** sivoais has quit IRC (Ping timeout: 240 seconds) [05:28] *** Wyatts has quit IRC (Remote host closed the connection) [05:30] *** Wyatts has joined #archiveteam [05:40] *** robink has quit IRC (Ping timeout: 492 seconds) [05:41] *** robink has joined #archiveteam [05:49] *** primus104 has joined #archiveteam [05:52] *** phiren has quit IRC (Ping timeout: 506 seconds) [05:52] *** phiren has joined #archiveteam [06:01] *** db48x has joined #archiveteam [06:06] *** vitzli has quit IRC (Quit: Leaving) [06:08] *** zenguy_pc has joined #archiveteam [06:14] *** JesseW has quit IRC (Read error: Operation timed out) [06:14] *** schbirid has joined #archiveteam [06:24] *** sivoais has joined #archiveteam [06:54] *** dashcloud has quit IRC (Read error: Operation timed out) [07:00] *** dashcloud has joined #archiveteam [07:03] *** PurpleSym has joined #archiveteam [07:17] *** primus104 has quit IRC (Leaving.) [07:23] *** habi has joined #archiveteam [07:23] *** habi has left [07:35] *** dashcloud has quit IRC (Read error: Operation timed out) [07:38] *** dashcloud has joined #archiveteam [07:39] *** habi has joined #archiveteam [07:40] *** habi has quit IRC (Client Quit) [08:02] *** BlueMaxim has quit IRC (Quit: Leaving) [08:07] *** zenguy_pc has quit IRC (Read error: Operation timed out) [08:21] *** zenguy_pc has joined #archiveteam [08:26] 700000 items have been added to thingiverse, after these items we have all files. [08:26] SketchCow: so everything from thingiverse is currently going ot the gamefront rsync target on FOS [08:27] SketchCow: after these files we'll do the other stuff from thingiverse, so we'll have it complete [08:28] SketchCow: why do you think thingiverse might be going away? [08:29] Because of the problems yesterday or is more happening? [08:33] *** DopefishJ has joined #archiveteam [08:33] *** DFJustin has quit IRC (Ping timeout: 252 seconds) [08:41] No idea [08:41] Had someone mail me and tell me [08:41] Tips rarely come in that emphatic [09:03] i'm still doing my own grab of it [09:03] mostly cause i'm not 100% sure how much of it you guys grab [09:03] for real [09:10] *** johndoe_ has joined #archiveteam [09:13] hi everyone. Is the skillfeed script still working https://github.com/ArchiveTeam/skillfeed-grab/blob/master/skillfeed.lua ? [09:13] I tried to understand it to download a single course from the skillfeed site but run into problems because google cache only stores the front page for each course and not the single lecture webpages? [09:13] So I can only download the first introductory video [09:14] Did you download everything before they blocked it or does the script works with google cache? [09:14] *** habi has joined #archiveteam [09:18] *** habi has left [09:34] johndoe_, a lot of videos were grabbed before google cache was required, if the course id was sub 10k it was most likely archived fully. Past that the chances go down some but you'll need to check the data to be sure. https://archive.org/details/archiveteam_skillfeed [09:35] (probably isn't easily checkable yet) [09:42] *** primus104 has joined #archiveteam [10:07] *** zenguy_pc has quit IRC (Read error: Operation timed out) [10:13] godane: for now we're only grabbing the files (those are the most important), but we'll grab everything else too [10:20] ok [10:20] godane: so we'll do everyting [10:20] when it comes to warrior projects we really don't miss things [10:20] Flechter, Thank you for your answer I will have a look [10:21] I think you can say ArchiveTeam is perfectionism when it comes to those grabs [10:21] SketchCow: ok, got it [10:21] *** dashcloud has quit IRC (Read error: Operation timed out) [10:22] *** zenguy_pc has joined #archiveteam [10:22] hmm, I mean perfectionistic [10:22] i know what you mean :-D [10:22] i'm the same way with things [10:26] *** dashcloud has joined #archiveteam [10:34] arkiver: btw i'm grabbing the missing/lost episodes of JIBS News General [10:34] turns out vlc can get them but not mplayer [10:38] *** dashcloud has quit IRC (Read error: Operation timed out) [10:41] *** dashcloud has joined #archiveteam [10:43] *** johndoe_ has quit IRC (Quit: Page closed) [11:18] godane: sounds good! So that collection will be complete [11:23] *** primus104 has quit IRC (Leaving.) [11:28] i'm grabbing the missing 6 episodes of 2011 of jibs news general [11:32] *** Morbus has quit IRC (Quit: http://www.disobey.com/) [11:34] *** Morbus has joined #archiveteam [12:17] *** zenguy_pc has quit IRC (Read error: Operation timed out) [12:22] *** zenguy_pc has joined #archiveteam [12:34] *** primus104 has joined #archiveteam [13:39] *** PurpleSym has quit IRC (WeeChat 1.1.1) [14:01] *** vitzli has joined #archiveteam [14:02] *** PurpleSym has joined #archiveteam [14:06] *** K4k has joined #archiveteam [14:08] *** zenguy_pc has quit IRC (Read error: Operation timed out) [14:13] *** afics has quit IRC (Ping timeout: 252 seconds) [14:16] *** DopefishJ is now known as DFJustin [14:22] *** zenguy_pc has joined #archiveteam [14:25] *** nertzy has joined #archiveteam [14:26] *** zenguy_pc has quit IRC (Read error: Operation timed out) [14:41] *** zenguy_pc has joined #archiveteam [14:43] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [14:48] *** scyther has joined #archiveteam [15:00] *** primus104 has quit IRC (Leaving.) [15:05] *** JesseW has joined #archiveteam [15:28] *** yuvadm has quit IRC (Ping timeout: 240 seconds) [15:30] *** JesseW has quit IRC (Read error: Operation timed out) [15:33] *** yuvadm has joined #archiveteam [15:41] *** vitzli has quit IRC (Quit: Leaving) [16:25] *** nertzy has joined #archiveteam [16:30] *** primus104 has joined #archiveteam [16:36] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [16:37] *** robink has quit IRC (Ping timeout: 492 seconds) [16:38] *** robink has joined #archiveteam [16:40] *** dashcloud has quit IRC (Read error: Operation timed out) [16:43] *** dashcloud has joined #archiveteam [16:48] *** xk_id has quit IRC (Remote host closed the connection) [16:50] *** scyther has quit IRC (Quit: Leaving) [17:18] *** RedType has quit IRC (Quit: leaving) [17:22] *** RedType has joined #archiveteam [17:23] *** RedType has quit IRC (Client Quit) [17:23] *** RedType has joined #archiveteam [17:34] *** aaaaaaaaa has joined #archiveteam [17:37] fyi: Thingiverse to out of items [17:45] *** khaoohs_ has joined #archiveteam [17:49] is there any skillfeed in the wayback machine that's not in the google cache [17:49] *** khaoohs has quit IRC (Read error: Operation timed out) [17:50] *** khaoohs has joined #archiveteam [17:54] *** khaoohs_ has quit IRC (Ping timeout: 492 seconds) [18:16] *** phuzion has quit IRC (Remote host closed the connection) [18:47] *** Zandro has quit IRC (Read error: Connection reset by peer) [18:47] *** Zandro has joined #archiveteam [18:49] *** scyther has joined #archiveteam [19:09] *** ohhdemgir has joined #archiveteam [19:35] *** habi has joined #archiveteam [19:42] *** wyatt8740 has quit IRC (Remote host closed the connection) [19:48] *** habi has left [19:49] *** schbirid has quit IRC (Quit: Leaving) [19:51] *** phuzion has joined #archiveteam [19:51] *** wyatt8740 has joined #archiveteam [19:52] *** xk_id has joined #archiveteam [20:26] *** afics has joined #archiveteam [20:56] *** PurpleSym has quit IRC (Remote host closed the connection) [20:59] *** jmad980 has quit IRC (Ping timeout: 362 seconds) [21:19] *** scyther has quit IRC (Leaving) [21:30] *** K4k has quit IRC (Ping timeout: 240 seconds) [21:32] *** jmad980 has joined #archiveteam [21:37] *** wp494 has quit IRC (Read error: Connection reset by peer) [21:41] *** wp494 has joined #archiveteam [21:44] *** vOYtEC has quit IRC (Ping timeout: 240 seconds) [21:45] SketchCow: all the items from Thingiverse have been uploaded to the GameFront rsync target, because we needed a target and couldn't wait a for a special thingiverse target [21:45] Can you please move the files from of thingiverse out of the gamefront target or upload them? [21:46] And yeah, there's a lot of tiny files, but yesterday we thought thingiverse was actually removing access to stuff and doing it the way we did was the best way to make sure we would get as much as possible [21:47] ^ also because sometimes files weren't available and sometimes they were [21:47] wow that fucks up that rsync a lot [21:47] hopefully megawarc isn't running [21:47] well done [21:48] so negative [21:48] we actually started the grab 40 minutes after SketchCow's message, whic I think was pretty fast [21:49] that's not negative, I'm looking at the directory [21:49] it's pretty fucked [21:50] luckily it looks like the packer isn't on [21:52] yeah, I think SketchCow didn't start it yet [21:53] I hope it won't be a too big problem to process the files [21:54] if you're still accepting uploads point them at /chfoo/thingiverse [21:54] er [whatever]/thingiverse [21:54] OK, done [21:57] *** vOYtEC has joined #archiveteam [21:58] tomorrow we'll start grabbing images and metadata from thingiverse, those will be done in 100 id's per item [21:58] so ~10000 files [21:59] * arkiver is afk for the night [22:00] move in progress [22:28] *** wyatt8740 has quit IRC (Read error: Operation timed out) [22:29] *** wyatt8740 has joined #archiveteam [22:35] *** aaaaaaaaa has quit IRC (Leaving) [23:15] *** RedType has quit IRC (Ping timeout: 1221 seconds) [23:16] *** xk_id has quit IRC (Read error: Operation timed out) [23:17] *** xk_id has joined #archiveteam [23:18] arkiver: moved [23:29] *** RedType has joined #archiveteam [23:42] *** khaoohs_ has joined #archiveteam [23:45] *** khaoohs has quit IRC (Read error: Operation timed out)