[00:01] *** kyan has joined #archiveteam [00:07] *** JesseW has joined #archiveteam [00:12] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:12] *** Aranje has joined #archiveteam [00:22] *** dashcloud has quit IRC (Read error: Operation timed out) [00:23] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:23] *** Aranje has joined #archiveteam [00:25] *** dashcloud has joined #archiveteam [00:27] *** Start has quit IRC (Quit: Disconnected.) [00:31] *** Start has joined #archiveteam [00:31] *** Start has quit IRC (Remote host closed the connection) [00:34] *** Start has joined #archiveteam [00:39] *** Start has quit IRC (Quit: Disconnected.) [00:41] *** Aranje has quit IRC (Read error: Connection reset by peer) [00:41] *** Aranje has joined #archiveteam [00:46] *** lytv has quit IRC (Max SendQ exceeded) [00:49] *** lytv has joined #archiveteam [01:02] *** Aranje has quit IRC (Read error: Connection reset by peer) [01:02] *** Aranje has joined #archiveteam [01:04] *** Start has joined #archiveteam [01:13] *** Start has quit IRC (Quit: Disconnected.) [01:14] *** JesseW has quit IRC (Read error: Operation timed out) [01:19] *** Aranje has quit IRC (Read error: Connection reset by peer) [01:19] *** Aranje has joined #archiveteam [01:21] *** toad2 has joined #archiveteam [01:23] *** toad1 has quit IRC (Read error: Operation timed out) [01:47] *** Aranje has quit IRC (Read error: Connection reset by peer) [01:48] *** Aranje has joined #archiveteam [01:57] *** primus104 has quit IRC (Leaving.) [02:07] *** dashcloud has quit IRC (Read error: Operation timed out) [02:08] *** VADemon has quit IRC (left4dead) [02:08] *** vitzli has joined #archiveteam [02:11] *** dashcloud has joined #archiveteam [02:19] *** Selanda_ has joined #archiveteam [02:19] *** Selanda has quit IRC (Read error: Connection reset by peer) [02:26] *** Selanda_ has quit IRC (Ping timeout: 306 seconds) [02:36] *** Selanda has joined #archiveteam [02:43] *** RichardG has quit IRC (Read error: Connection reset by peer) [03:16] *** lytv has quit IRC (Max SendQ exceeded) [03:19] *** lytv has joined #archiveteam [03:25] *** Aranje has quit IRC (Read error: Connection reset by peer) [03:25] *** db48x` has quit IRC (Ping timeout: 258 seconds) [03:25] *** Aranje has joined #archiveteam [03:26] *** Ungstein has joined #archiveteam [03:37] *** Aranje has quit IRC (Read error: Connection reset by peer) [03:38] *** Aranje has joined #archiveteam [04:01] *** vitzli_ has joined #archiveteam [04:09] *** vitzli has quit IRC (Ping timeout: 483 seconds) [04:24] *** logan2 has joined #archiveteam [04:25] *** thefinn93 has quit IRC (Read error: Operation timed out) [04:26] *** dserodio has quit IRC (Read error: Operation timed out) [04:26] *** sjm has quit IRC (Read error: Operation timed out) [04:26] *** Peetz0r_ has quit IRC (Read error: Operation timed out) [04:26] *** sjm has joined #archiveteam [04:26] *** dcmorton has quit IRC (Read error: Operation timed out) [04:26] *** Peetz0r has joined #archiveteam [04:26] *** filippo__ has quit IRC (Ping timeout: 255 seconds) [04:26] *** xk_id_ has joined #archiveteam [04:27] *** swebb has quit IRC (Ping timeout: 369 seconds) [04:27] *** thefinn93 has joined #archiveteam [04:27] *** lytv has quit IRC (Read error: Operation timed out) [04:27] *** Infreq_ has quit IRC (Read error: Operation timed out) [04:28] *** slyphic has quit IRC (Read error: Operation timed out) [04:28] *** logan has quit IRC (Read error: Operation timed out) [04:29] *** slyphic has joined #archiveteam [04:30] *** Cameron_D has quit IRC (Ping timeout: 369 seconds) [04:30] *** chazchaz has quit IRC (Ping timeout: 369 seconds) [04:30] *** atlogbot has quit IRC (Read error: Operation timed out) [04:30] *** Infreq has joined #archiveteam [04:30] *** xk_id has quit IRC (Read error: Operation timed out) [04:31] *** aschmitz has quit IRC (Ping timeout: 369 seconds) [04:31] *** Cameron_D has joined #archiveteam [04:31] *** Laverne has quit IRC (Ping timeout: 369 seconds) [04:32] *** zenguy_pc has quit IRC (Read error: Operation timed out) [04:32] *** w0rp has quit IRC (Read error: Operation timed out) [04:33] *** w0rp has joined #archiveteam [04:34] *** lytv has joined #archiveteam [04:34] *** zenguy_pc has joined #archiveteam [04:34] *** dcmorton has joined #archiveteam [04:34] *** dcmorton has quit IRC (Excess Flood) [04:34] *** dserodio has joined #archiveteam [04:34] *** koo5 has quit IRC (Read error: Operation timed out) [04:34] *** dcmorton has joined #archiveteam [04:34] *** aschmitz has joined #archiveteam [04:35] *** koo5 has joined #archiveteam [04:35] *** atlogbot has joined #archiveteam [04:35] *** chazchaz has joined #archiveteam [04:35] *** swebb has joined #archiveteam [04:35] *** Laverne has joined #archiveteam [04:47] *** filippo__ has joined #archiveteam [05:03] *** marvinw has quit IRC (Leaving) [05:15] *** marvinw has joined #archiveteam [05:54] *** Ungstein1 has joined #archiveteam [05:55] *** Ungstein has quit IRC (Ping timeout: 252 seconds) [06:49] *** Ungstein1 has quit IRC (Quit: Leaving.) [06:50] *** Ungstein has joined #archiveteam [06:51] *** Ungstein has quit IRC (Read error: Connection reset by peer) [06:53] *** Ungstein has joined #archiveteam [06:57] *** Start has joined #archiveteam [07:00] *** kyan has quit IRC (Quit: Leaving) [07:30] *** PurpleSym has joined #archiveteam [07:33] *** vitzli_ has quit IRC (Quit: Leaving) [07:36] *** Start has quit IRC (Read error: Operation timed out) [07:36] *** scyther has joined #archiveteam [07:42] *** Ungstein has quit IRC (Quit: Leaving.) [07:49] *** Ungstein has joined #archiveteam [08:03] *** Start has joined #archiveteam [08:15] *** Ungstein has quit IRC (Quit: Leaving.) [08:15] *** z00nx has joined #archiveteam [08:17] *** z00nx has quit IRC (Client Quit) [08:17] *** scyther has quit IRC (Read error: Operation timed out) [08:18] *** Ungstein has joined #archiveteam [08:19] *** z00nx has joined #archiveteam [08:26] *** z00nx has quit IRC (Quit: WeeChat 1.2) [08:27] *** z00nx has joined #archiveteam [08:29] *** z00nx has quit IRC (Client Quit) [08:29] *** z00nx has joined #archiveteam [08:31] *** z00nx has quit IRC (Client Quit) [08:32] *** z00nx has joined #archiveteam [08:33] *** primus104 has joined #archiveteam [08:33] *** Start has quit IRC (Read error: Operation timed out) [08:41] *** schbirid has joined #archiveteam [08:41] *** z00nx has quit IRC (Quit: WeeChat 1.2) [08:41] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [08:42] *** z00nx has joined #archiveteam [08:44] *** z00nx has quit IRC (Client Quit) [08:45] *** z00nx has joined #archiveteam [08:47] *** z00nx has quit IRC (Client Quit) [08:48] *** zer0c00l has quit IRC (Ping timeout: 483 seconds) [08:49] *** z00nx has joined #archiveteam [08:55] *** z00nx has quit IRC (Quit: WeeChat 1.2) [08:55] *** z00nx has joined #archiveteam [08:56] *** z00nx has quit IRC (Client Quit) [08:57] *** z00nx has joined #archiveteam [08:57] *** z00nx has quit IRC (Client Quit) [08:57] *** z00nx has joined #archiveteam [08:58] *** z00nx has quit IRC (Client Quit) [08:58] *** z00nx has joined #archiveteam [08:59] *** z00nx has quit IRC (Client Quit) [09:00] *** zer0c00l has joined #archiveteam [09:04] *** primus104 has quit IRC (Leaving.) [09:33] *** Start has joined #archiveteam [09:34] *** Start has quit IRC (Read error: Operation timed out) [09:47] *** primus104 has joined #archiveteam [10:08] *** khaoohs_ has joined #archiveteam [10:14] *** z00nx has joined #archiveteam [10:14] *** khaoohs has quit IRC (Read error: Operation timed out) [10:14] *** z00nx has quit IRC (Client Quit) [10:14] *** z00nx has joined #archiveteam [10:15] I'm going to add support for Google Cache to skillfeed today. [10:15] so more grabbing? [10:15] I'll also add a big delay for the google links, sine google gives a catcha when you're going too fast [10:17] *** z00nx has quit IRC (Client Quit) [10:20] *** scyther has joined #archiveteam [10:22] HCross: yes [10:22] Alright, I need to get through this set of uploads first :P [10:23] I think Comcast can be done by archivebot if not a lot more sites are discovered [10:23] I am wondering if I should take these university grabs into my own hands, or am I being a little greedy with ArchiveBot [10:24] Which university grabs? [10:25] *** z00nx has joined #archiveteam [10:25] the uhra.herts.ac.uk - I want to start saving a load of the big paper archives to the IA [10:25] How many papers are we talking and what do you think will be the size of it all? [10:25] Saving scientific information is important. [10:26] Not sure at the moment, I agree that saving it is important. I want to see how many other big british universities have big archives like herts [10:27] If we're talking around 200000 articles I think archivebot is able to do that [10:27] If we're talking a few million document you'll have to split it up, or I can write a small project for it. [10:28] Ok. Thing is, I am not sure how to work out how many there are [10:28] This one hnas 14596 texts [10:28] yeah, a lot of search links though [10:29] thing is, http://uhra.herts.ac.uk/bitstream/handle doesnt have them all listed so you have to go through the search [10:31] *** z00nx has quit IRC (Quit: WeeChat 1.2) [10:32] *** z00nx has joined #archiveteam [10:32] *** aliz has quit IRC (Ping timeout: 252 seconds) [10:34] *** z00nx has quit IRC (Client Quit) [10:34] *** z00nx has joined #archiveteam [10:45] *** aliz has joined #archiveteam [11:07] *** primus104 has quit IRC (Leaving.) [11:29] *** RichardG has joined #archiveteam [12:18] arkiver, is my herts.ac.uk job still OK for the bot or shall I take it and do it myself [12:23] *** arkiver2 has joined #archiveteam [12:27] *** MMovie2 has joined #archiveteam [12:30] *** MMovie has quit IRC (Ping timeout: 306 seconds) [12:36] *** VADemon has joined #archiveteam [12:43] *** z00nx has quit IRC (Quit: WeeChat 1.2) [12:43] *** z00nx has joined #archiveteam [13:25] *** primus104 has joined #archiveteam [13:34] *** superkuh has joined #archiveteam [13:43] SketchCow: so we can get the video of the first page of a tutorial, for example: https://www.skillfeed.com/courses/13677-create-a-comic-book-character-adobe-illustrator [13:44] But Google Cache doesn't correctly give the cache of an other video from that video series [13:45] For example https://www.skillfeed.com/courses/13677-create-a-comic-book-character-adobe-illustrator?video_id=156567-picking-the-skin-color in google cache will give the html of the url without the ? [13:45] So we can't get the videos from those kind of pages on skilfeed. [13:46] I checked the wayback machine and I will do a small crawl on it, but the wayback machine hasn't grabbed a lot from skillfeed, so I'm afraid we also won't be able to get th video through there [13:47] The only way to get all the videos we couldn't get due to the changes skillfeed is to have skillfeed undo those changes. [13:49] *** arkiver sets mode: +o arkiver2 [14:13] *** primus104 has quit IRC (Leaving.) [14:40] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [14:59] *** wp494 has quit IRC (Read error: Operation timed out) [15:30] *** arkiver2 has joined #archiveteam [15:40] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [16:33] *** scyther has quit IRC (Read error: Operation timed out) [16:37] *** JesseW has joined #archiveteam [16:56] *** scyther has joined #archiveteam [16:58] *** JesseW has quit IRC (Read error: Operation timed out) [17:05] *** scyther has quit IRC (Read error: Operation timed out) [17:18] *** robink has quit IRC (Ping timeout: 492 seconds) [17:18] *** aaaaaaaaa has joined #archiveteam [17:20] arkiver: HCross: FYI, there was an inquiry about Skillfeed on LowEndTalk: http://www.lowendtalk.com/discussion/63566/dont-miss-free-courses-till-september-30 [17:22] *** robink has joined #archiveteam [17:27] *** scyther has joined #archiveteam [17:43] *** primus104 has joined #archiveteam [17:50] joepie91: SketchCow: do you think you can somehow get skillfeed to undo the changes to their site? [17:55] *** JesseW has joined #archiveteam [18:01] *** arkiver2 has joined #archiveteam [18:09] *** aschmitz has quit IRC (Remote host closed the connection) [18:09] *** dashcloud has quit IRC (Read error: Operation timed out) [18:12] *** dashcloud has joined #archiveteam [18:23] *** aschmitz has joined #archiveteam [18:47] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [19:04] *** arkiver2 has joined #archiveteam [19:39] *** arkiver2 has quit IRC (Ping timeout: 252 seconds) [19:47] *** koo5 has quit IRC (Read error: Operation timed out) [20:04] *** superkuh_ has joined #archiveteam [20:06] *** superkuh has quit IRC (Read error: Operation timed out) [20:15] *** wp494 has joined #archiveteam [20:21] Fuck skillfeed. No. [20:27] *** dashcloud has quit IRC (Read error: Operation timed out) [20:30] *** dashcloud has joined #archiveteam [20:52] *** PurpleSym has quit IRC (Remote host closed the connection) [20:56] I'm wanding around the thing [21:19] how much of skillfeed did we get? [21:30] *** scyther has quit IRC (Read error: Connection reset by peer) [21:36] *** schbirid has quit IRC (Quit: Leaving) [21:39] *** Aranje has quit IRC (Read error: Connection reset by peer) [21:39] *** Aranje has joined #archiveteam [21:43] *** n00b274 has joined #archiveteam [21:43] *** n00b274 is now known as unnicknam [21:43] hello [21:43] alguien por aquí? [21:43] some one here? [21:44] unnicknam: yes? [21:45] ¿ any have a user in the wiki and like to edit this page : http://archiveteam.org/index.php?title=Jamendo with this information: https://en.wikipedia.org/wiki/User_talk:Emijrp#Jamendo_ArchiveTeam_Torrents ? [21:45] exactrly with this script: https://github.com/emijrp/jamendo-downloader/blob/master/jamendo-torrents.py [21:45] hello JesseW [21:45] i connect days ago [21:45] with one nick no i dont remember [21:46] you saay me to contact with this user and he make a scipt in phyton [21:46] to donwload all torrents for Archive.org [21:46] Ah, I remember you. [21:46] i i can upload the info in the wiki of archiveinfo maybe can help to others [21:46] * if you [21:47] You can create an account on the wiki yourself. The magic word is: "yahoosucks" [21:47] hooo yeeeess buuuuuuuuuuut i ' am so lazy [21:47] xD [21:47] aren't we all. :-) [21:48] emijrp may also update the page himself. He has edited it recently. [21:48] no , well... first ii advice in the irc... and in some time... maybe i create an account :P [21:48] hoo yes yes [21:48] well [21:48] i only say here beacuse can help [21:48] and it's actually already linked (if indirectly) [21:49] hooo [21:49] i dont see [21:50] maybe i have a cached version, i press f5 and now the page is updated [21:50] :D [21:50] sory or the interrupt [21:50] *for [21:51] great job the page, all projects help to the offline users [21:52] well good by, thanks!! [21:52] *** unnicknam has quit IRC (Quit: Page closed) [22:29] I'm going to requeue skillfeed items now and restart the grab [22:29] Let's see what we can still get [22:41] ive still got stuff uploading from the 1st grab, shall I carry on letting those upload [22:41] yes! [22:42] it's very important not to not loose any data since we might not be able to download the videos again [22:42] ive got 5 more tasks to upload [22:42] my FOS upload speeds are painful [22:43] everyones probably is, especially with the rsync daemon running at 100% [22:50] fos status [22:50] alard@teamarchive0:~$ w [22:50] 22:50:00 up 93 days, 2:27, 3 users, load average: 157.16, 156.31, 156.20 [22:51] *** DFJustin has quit IRC (Remote host closed the connection) [22:51] *** DFJustin has joined #archiveteam [22:57] SketchCow: videos are being downloaded! Looks like it's working for the first video of every course [23:10] *** primus105 has joined #archiveteam [23:13] *** primus104 has quit IRC (Read error: Operation timed out) [23:16] yipdw: jfc [23:17] xmc: basically [23:23] it takes about twelve seconds to start vi [23:24] on par with emacs on an unloaded machine [23:25] *** dashcloud has quit IRC (Read error: Operation timed out) [23:28] *** dashcloud has joined #archiveteam [23:30] *** JesseW has quit IRC (Read error: Operation timed out) [23:31] *** dashcloud has quit IRC (Read error: Operation timed out) [23:41] *** dashcloud has joined #archiveteam [23:48] *** JesseW has joined #archiveteam [23:59] *** arkiver2 has joined #archiveteam