[00:19] *** brayden has joined #archiveteam [01:10] *** philpem has quit IRC (Ping timeout: 252 seconds) [01:29] *** JesseW has quit IRC (Quit: Leaving.) [01:54] paste.archivingyoursh.it has been giving 503s for a while [01:55] *** xk_id has joined #archiveteam [02:09] *** brayden has quit IRC (Quit: Leaving) [02:20] *** BlueMaxim has joined #archiveteam [02:32] *** dashcloud has quit IRC (Read error: Connection reset by peer) [02:32] *** dashcloud has joined #archiveteam [03:10] *** JesseW has joined #archiveteam [03:20] *** xk_id_ has joined #archiveteam [03:27] *** xk_id has quit IRC (Read error: Operation timed out) [03:29] *** dashcloud has quit IRC (Read error: Connection reset by peer) [03:31] *** Gfy has quit IRC (Closing Link: 195-154-179-104.rev.poneytelecom.eu (Ping timeout: 364 seconds)) [03:31] *** dashcloud has joined #archiveteam [03:41] *** Gfy has joined #archiveteam [03:41] *** mistym has quit IRC (Remote host closed the connection) [03:51] *** lysobit has quit IRC (Ping timeout: 600 seconds) [03:55] *** lysobit has joined #archiveteam [03:57] *** dashcloud has quit IRC (Quit: No Ping reply in 240 seconds.) [03:58] *** dashcloud has joined #archiveteam [04:05] *** mistym has joined #archiveteam [04:09] Start: oh yeah, sorry, i've been doing maintenance on it [04:10] Start: i need to get it to a host that isn't unstable as hell [04:10] Start: and i also need to upload the JSON dump i did of it [04:13] *** SN4T14_ has quit IRC (Read error: Connection reset by peer) [04:13] *** SN4T14 has joined #archiveteam [04:48] ok, thanks for the update [04:48] *** xk_id_ has quit IRC (Read error: Connection reset by peer) [04:55] *** xk_id has joined #archiveteam [05:37] *** JesseW has quit IRC (Quit: Leaving.) [06:00] *** JesseW has joined #archiveteam [06:32] *** JesseW has quit IRC (Quit: Leaving.) [06:42] *** yipdw has quit IRC (Read error: Operation timed out) [06:42] *** xk_id has quit IRC (Read error: Connection reset by peer) [06:43] *** yipdw has joined #archiveteam [06:45] *** vOYtEC has quit IRC (Read error: Operation timed out) [07:03] *** vOYtEC has joined #archiveteam [07:05] *** cadbury_ has quit IRC (Read error: Operation timed out) [07:22] *** PurpleSym has joined #archiveteam [07:43] *** schbirid has joined #archiveteam [08:09] *** mistym has quit IRC (Remote host closed the connection) [08:22] *** philpem has joined #archiveteam [08:41] *** alfalover has joined #archiveteam [08:44] I so sorry to ask, but there is an estimated date when gitorious.org read only copy will be available ? [08:59] *** alfalover has quit IRC (Ping timeout: 240 seconds) [09:54] *** primus104 has joined #archiveteam [10:07] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [10:14] *** dashcloud has quit IRC (Read error: Connection reset by peer) [10:16] *** dashcloud has joined #archiveteam [10:51] *** kukutz has joined #archiveteam [11:39] *** dashcloud has quit IRC (Read error: Connection reset by peer) [11:49] *** dashcloud has joined #archiveteam [11:51] *** schbirid has quit IRC (Leaving) [12:12] *** brayden has joined #archiveteam [12:15] *** primus104 has quit IRC (Leaving.) [12:34] *** skiy has joined #archiveteam [12:35] *** skiy has quit IRC (Client Quit) [12:36] *** skiy has joined #archiveteam [12:36] *** skiy has quit IRC (Client Quit) [12:37] *** skiy has joined #archiveteam [12:37] *** skiy has quit IRC (Client Quit) [12:37] *** skiy has joined #archiveteam [12:53] *** habi has joined #archiveteam [12:54] *** habi has left [13:00] *** skiy_ has joined #archiveteam [13:01] *** skiy__ has joined #archiveteam [13:03] *** skiy_ has quit IRC (Read error: Operation timed out) [13:08] *** skiy has quit IRC (Read error: Operation timed out) [13:13] *** mistym has joined #archiveteam [13:19] *** brayden has quit IRC (Read error: Operation timed out) [13:20] *** skiy__ has quit IRC (Read error: Operation timed out) [13:21] *** mistym has quit IRC (Ping timeout: 492 seconds) [13:37] *** skiy has joined #archiveteam [13:58] *** Ravenloft has joined #archiveteam [14:16] *** skiy_ has joined #archiveteam [14:18] *** primus104 has joined #archiveteam [14:22] *** skiy_ has quit IRC (Read error: Operation timed out) [14:24] *** skiy has quit IRC (Read error: Operation timed out) [14:58] *** dashcloud has quit IRC (Read error: Connection reset by peer) [14:58] *** dashcloud has joined #archiveteam [15:05] *** gui77 has joined #archiveteam [15:41] *** xk_id has joined #archiveteam [15:43] SketchCow: can you create a collection for blip as soon as possible? [15:43] Can you please give yipdw access to it? We'l start the upload of blip to IA as soon as possible [15:44] Xfire is almost done (a few TB remaining) [15:46] pretty sure he got the first message [15:57] yipdw: if u ever find time can you see if twitpic can be cleaned up and completed [16:09] *** Luckcolor has joined #archiveteam [16:09] hello [16:10] *** Ravenloft has quit IRC (Ping timeout: 252 seconds) [16:11] guys anybody had experience with Heritrix 3.2.0 on windows? [16:11] a bit [16:11] used it a few months ago [16:12] i'm trying to find a nice program that can create warc files [16:12] wpull [16:12] archiver [16:12] https://github.com/chfoo/wpull [16:12] checking ut out [16:12] ok [16:13] anyway have you had any problems running Heritrix because it keep giving me java error [16:13] I had it running. [16:14] Looking for the scripts I used [16:14] ok thanks [16:15] *** mistym has joined #archiveteam [16:16] anyway wich crawler do you usually use for create warc files? wpull? [16:16] yes I use wpull [16:18] anyway did you find the scripts you where talking about? [16:20] *** mistym has quit IRC (Read error: Operation timed out) [16:20] *** kukutz has quit IRC (Read error: Operation timed out) [16:21] *** kukutz has joined #archiveteam [16:25] I haven't found them yet [16:26] they should be somewhere, or I deleted them after I stopped using heritrix [16:26] if you say that wpull is better i will not use heritrix [16:26] :) [16:26] I think wpull is better [16:27] but you need linux for it [16:27] ok [16:27] i'll setup a quick vm [16:28] ok [16:28] *** Kenshin has quit IRC (Ping timeout: 246 seconds) [16:32] *** Kenshin has joined #archiveteam [16:35] *** mistym has joined #archiveteam [16:54] *** pwnsrv has joined #archiveteam [17:08] *** ohhdemgir has joined #archiveteam [17:09] *** JesseW has joined #archiveteam [17:15] Kenshin: I think it might be about as done as it can be [17:15] Kenshin: I guess I can toss the rest of the WARCs into an "undateable" category [17:16] yeah i guess that's for the best [17:17] i have a bit of an OCD about leaving archiveteam data on the servers [17:17] ok [17:17] since the data gets moved around a lot and possibly destroyed [17:17] since there's no backups [17:17] so yeah, if u can clean up that and any leftover xfire would be great [17:18] i'll let u know when blip is ready for packing, meanwhile i'm moving it from the international rsyncs into the 60TB server [17:21] *** primus104 has quit IRC (Leaving.) [17:21] *** habi has joined #archiveteam [17:28] *** habi has quit IRC (Quit: Leaving.) [17:37] *** scyther has joined #archiveteam [17:48] *** zhongfu has quit IRC (Ping timeout: 240 seconds) [17:49] *** wm_ has quit IRC (Ping timeout: 240 seconds) [17:50] *** zhongfu has joined #archiveteam [17:52] *** kniffy has quit IRC (Ping timeout: 240 seconds) [17:52] *** dashcloud has quit IRC (Ping timeout: 240 seconds) [17:54] *** kniffy has joined #archiveteam [17:55] *** Luckcolor has quit IRC (Ping timeout: 240 seconds) [17:57] *** dashcloud has joined #archiveteam [18:09] *** SketchCow has quit IRC (Ping timeout: 240 seconds) [18:09] *** SketchCow has joined #archiveteam [18:13] *** xk_id has quit IRC (Remote host closed the connection) [18:15] *** wm_ has joined #archiveteam [18:16] *** Luckcolor has joined #archiveteam [18:27] *** schbirid has joined #archiveteam [18:38] *** aaaaaaaaa has joined #archiveteam [18:45] *** primus104 has joined #archiveteam [18:51] *** Sanqui|go is now known as Sanqui [19:12] *** JesseW has quit IRC (Quit: Leaving.) [19:32] *** scyther has quit IRC (Leaving) [19:42] *** Luckcolor has quit IRC (Quit: Page closed) [19:52] *** PurpleSym has quit IRC (Quit: WeeChat 1.1.1) [19:59] *** aaaaaaaaa has quit IRC (Leaving) [20:07] *** aaaaaaaaa has joined #archiveteam [20:33] *** JesseW has joined #archiveteam [20:47] *** Jonimus has quit IRC (Ping timeout: 252 seconds) [20:53] *** schbirid has quit IRC (Leaving) [20:58] *** habi has joined #archiveteam [20:58] *** habi has left [21:03] *** Jonimus has joined #archiveteam [21:29] *** mistym has quit IRC (Remote host closed the connection) [21:44] http://thisismyjam.tumblr.com/post/126260430022/jam-preserves [21:53] *** Emcy_ has quit IRC (Read error: Connection reset by peer) [21:55] is it possible to, for a project like blip, have more than --concurrent 20 on a machine? [21:57] I'm asking because it seems to be running fine with 20 (for this project that is) and I still have bw available [21:57] DFJustin -- we should probably make a wiki entry for that, but it doesn't seem (at the moment) like we need to do a grab... [22:00] *** dashcloud has quit IRC (Read error: Operation timed out) [22:03] *** dashcloud has joined #archiveteam [22:05] yeah [22:09] gui77: its usually not recommended to run too many concurrent jobs at the same time as seesaw gets unstable. Instead, you can clone into a different directory with a different name and start another pipeline [22:22] *** Emcy has joined #archiveteam [22:28] *** RichardG_ is now known as RichardG [22:30] *** mistym has joined #archiveteam [22:39] *** mistym has quit IRC (Ping timeout: 483 seconds) [22:41] DFJustin: I made a page: http://archiveteam.org/index.php?title=This_Is_My_Jam [22:43] *** dashcloud has quit IRC (Read error: Operation timed out) [22:53] *** dashcloud has joined #archiveteam [22:54] *** kukutz has quit IRC (Read error: Operation timed out) [23:03] *** xk_id has joined #archiveteam [23:24] *** xk_id has quit IRC (Read error: Connection reset by peer)