#archiveteam 2015-08-09,Sun

↑back Search

Time Nickname Message
00:19 🔗 brayden has joined #archiveteam
01:10 🔗 philpem has quit IRC (Ping timeout: 252 seconds)
01:29 🔗 JesseW has quit IRC (Quit: Leaving.)
01:54 🔗 Start paste.archivingyoursh.it has been giving 503s for a while
01:55 🔗 xk_id has joined #archiveteam
02:09 🔗 brayden has quit IRC (Quit: Leaving)
02:20 🔗 BlueMaxim has joined #archiveteam
02:32 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
02:32 🔗 dashcloud has joined #archiveteam
03:10 🔗 JesseW has joined #archiveteam
03:20 🔗 xk_id_ has joined #archiveteam
03:27 🔗 xk_id has quit IRC (Read error: Operation timed out)
03:29 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
03:31 🔗 Gfy has quit IRC (Closing Link: 195-154-179-104.rev.poneytelecom.eu (Ping timeout: 364 seconds))
03:31 🔗 dashcloud has joined #archiveteam
03:41 🔗 Gfy has joined #archiveteam
03:41 🔗 mistym has quit IRC (Remote host closed the connection)
03:51 🔗 lysobit has quit IRC (Ping timeout: 600 seconds)
03:55 🔗 lysobit has joined #archiveteam
03:57 🔗 dashcloud has quit IRC (Quit: No Ping reply in 240 seconds.)
03:58 🔗 dashcloud has joined #archiveteam
04:05 🔗 mistym has joined #archiveteam
04:09 🔗 GLaDOS Start: oh yeah, sorry, i've been doing maintenance on it
04:10 🔗 GLaDOS Start: i need to get it to a host that isn't unstable as hell
04:10 🔗 GLaDOS Start: and i also need to upload the JSON dump i did of it
04:13 🔗 SN4T14_ has quit IRC (Read error: Connection reset by peer)
04:13 🔗 SN4T14 has joined #archiveteam
04:48 🔗 Start ok, thanks for the update
04:48 🔗 xk_id_ has quit IRC (Read error: Connection reset by peer)
04:55 🔗 xk_id has joined #archiveteam
05:37 🔗 JesseW has quit IRC (Quit: Leaving.)
06:00 🔗 JesseW has joined #archiveteam
06:32 🔗 JesseW has quit IRC (Quit: Leaving.)
06:42 🔗 yipdw has quit IRC (Read error: Operation timed out)
06:42 🔗 xk_id has quit IRC (Read error: Connection reset by peer)
06:43 🔗 yipdw has joined #archiveteam
06:45 🔗 vOYtEC has quit IRC (Read error: Operation timed out)
07:03 🔗 vOYtEC has joined #archiveteam
07:05 🔗 cadbury_ has quit IRC (Read error: Operation timed out)
07:22 🔗 PurpleSym has joined #archiveteam
07:43 🔗 schbirid has joined #archiveteam
08:09 🔗 mistym has quit IRC (Remote host closed the connection)
08:22 🔗 philpem has joined #archiveteam
08:41 🔗 alfalover has joined #archiveteam
08:44 🔗 alfalover I so sorry to ask, but there is an estimated date when gitorious.org read only copy will be available ?
08:59 🔗 alfalover has quit IRC (Ping timeout: 240 seconds)
09:54 🔗 primus104 has joined #archiveteam
10:07 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
10:14 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
10:16 🔗 dashcloud has joined #archiveteam
10:51 🔗 kukutz has joined #archiveteam
11:39 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
11:49 🔗 dashcloud has joined #archiveteam
11:51 🔗 schbirid has quit IRC (Leaving)
12:12 🔗 brayden has joined #archiveteam
12:15 🔗 primus104 has quit IRC (Leaving.)
12:34 🔗 skiy has joined #archiveteam
12:35 🔗 skiy has quit IRC (Client Quit)
12:36 🔗 skiy has joined #archiveteam
12:36 🔗 skiy has quit IRC (Client Quit)
12:37 🔗 skiy has joined #archiveteam
12:37 🔗 skiy has quit IRC (Client Quit)
12:37 🔗 skiy has joined #archiveteam
12:53 🔗 habi has joined #archiveteam
12:54 🔗 habi has left
13:00 🔗 skiy_ has joined #archiveteam
13:01 🔗 skiy__ has joined #archiveteam
13:03 🔗 skiy_ has quit IRC (Read error: Operation timed out)
13:08 🔗 skiy has quit IRC (Read error: Operation timed out)
13:13 🔗 mistym has joined #archiveteam
13:19 🔗 brayden has quit IRC (Read error: Operation timed out)
13:20 🔗 skiy__ has quit IRC (Read error: Operation timed out)
13:21 🔗 mistym has quit IRC (Ping timeout: 492 seconds)
13:37 🔗 skiy has joined #archiveteam
13:58 🔗 Ravenloft has joined #archiveteam
14:16 🔗 skiy_ has joined #archiveteam
14:18 🔗 primus104 has joined #archiveteam
14:22 🔗 skiy_ has quit IRC (Read error: Operation timed out)
14:24 🔗 skiy has quit IRC (Read error: Operation timed out)
14:58 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
14:58 🔗 dashcloud has joined #archiveteam
15:05 🔗 gui77 has joined #archiveteam
15:41 🔗 xk_id has joined #archiveteam
15:43 🔗 arkiver SketchCow: can you create a collection for blip as soon as possible?
15:43 🔗 arkiver Can you please give yipdw access to it? We'l start the upload of blip to IA as soon as possible
15:44 🔗 arkiver Xfire is almost done (a few TB remaining)
15:46 🔗 yipdw pretty sure he got the first message
15:57 🔗 Kenshin yipdw: if u ever find time can you see if twitpic can be cleaned up and completed
16:09 🔗 Luckcolor has joined #archiveteam
16:09 🔗 Luckcolor hello
16:10 🔗 Ravenloft has quit IRC (Ping timeout: 252 seconds)
16:11 🔗 Luckcolor guys anybody had experience with Heritrix 3.2.0 on windows?
16:11 🔗 arkiver a bit
16:11 🔗 arkiver used it a few months ago
16:12 🔗 Luckcolor i'm trying to find a nice program that can create warc files
16:12 🔗 arkiver wpull
16:12 🔗 Luckcolor archiver
16:12 🔗 arkiver https://github.com/chfoo/wpull
16:12 🔗 Luckcolor checking ut out
16:12 🔗 arkiver ok
16:13 🔗 Luckcolor anyway have you had any problems running Heritrix because it keep giving me java error
16:13 🔗 arkiver I had it running.
16:14 🔗 arkiver Looking for the scripts I used
16:14 🔗 Luckcolor ok thanks
16:15 🔗 mistym has joined #archiveteam
16:16 🔗 Luckcolor anyway wich crawler do you usually use for create warc files? wpull?
16:16 🔗 arkiver yes I use wpull
16:18 🔗 Luckcolor anyway did you find the scripts you where talking about?
16:20 🔗 mistym has quit IRC (Read error: Operation timed out)
16:20 🔗 kukutz has quit IRC (Read error: Operation timed out)
16:21 🔗 kukutz has joined #archiveteam
16:25 🔗 arkiver I haven't found them yet
16:26 🔗 arkiver they should be somewhere, or I deleted them after I stopped using heritrix
16:26 🔗 Luckcolor if you say that wpull is better i will not use heritrix
16:26 🔗 Luckcolor :)
16:26 🔗 arkiver I think wpull is better
16:27 🔗 arkiver but you need linux for it
16:27 🔗 Luckcolor ok
16:27 🔗 Luckcolor i'll setup a quick vm
16:28 🔗 arkiver ok
16:28 🔗 Kenshin has quit IRC (Ping timeout: 246 seconds)
16:32 🔗 Kenshin has joined #archiveteam
16:35 🔗 mistym has joined #archiveteam
16:54 🔗 pwnsrv has joined #archiveteam
17:08 🔗 ohhdemgir has joined #archiveteam
17:09 🔗 JesseW has joined #archiveteam
17:15 🔗 yipdw Kenshin: I think it might be about as done as it can be
17:15 🔗 yipdw Kenshin: I guess I can toss the rest of the WARCs into an "undateable" category
17:16 🔗 Kenshin yeah i guess that's for the best
17:17 🔗 Kenshin i have a bit of an OCD about leaving archiveteam data on the servers
17:17 🔗 yipdw ok
17:17 🔗 Kenshin since the data gets moved around a lot and possibly destroyed
17:17 🔗 Kenshin since there's no backups
17:17 🔗 Kenshin so yeah, if u can clean up that and any leftover xfire would be great
17:18 🔗 Kenshin i'll let u know when blip is ready for packing, meanwhile i'm moving it from the international rsyncs into the 60TB server
17:21 🔗 primus104 has quit IRC (Leaving.)
17:21 🔗 habi has joined #archiveteam
17:28 🔗 habi has quit IRC (Quit: Leaving.)
17:37 🔗 scyther has joined #archiveteam
17:48 🔗 zhongfu has quit IRC (Ping timeout: 240 seconds)
17:49 🔗 wm_ has quit IRC (Ping timeout: 240 seconds)
17:50 🔗 zhongfu has joined #archiveteam
17:52 🔗 kniffy has quit IRC (Ping timeout: 240 seconds)
17:52 🔗 dashcloud has quit IRC (Ping timeout: 240 seconds)
17:54 🔗 kniffy has joined #archiveteam
17:55 🔗 Luckcolor has quit IRC (Ping timeout: 240 seconds)
17:57 🔗 dashcloud has joined #archiveteam
18:09 🔗 SketchCow has quit IRC (Ping timeout: 240 seconds)
18:09 🔗 SketchCow has joined #archiveteam
18:13 🔗 xk_id has quit IRC (Remote host closed the connection)
18:15 🔗 wm_ has joined #archiveteam
18:16 🔗 Luckcolor has joined #archiveteam
18:27 🔗 schbirid has joined #archiveteam
18:38 🔗 aaaaaaaaa has joined #archiveteam
18:45 🔗 primus104 has joined #archiveteam
18:51 🔗 Sanqui|go is now known as Sanqui
19:12 🔗 JesseW has quit IRC (Quit: Leaving.)
19:32 🔗 scyther has quit IRC (Leaving)
19:42 🔗 Luckcolor has quit IRC (Quit: Page closed)
19:52 🔗 PurpleSym has quit IRC (Quit: WeeChat 1.1.1)
19:59 🔗 aaaaaaaaa has quit IRC (Leaving)
20:07 🔗 aaaaaaaaa has joined #archiveteam
20:33 🔗 JesseW has joined #archiveteam
20:47 🔗 Jonimus has quit IRC (Ping timeout: 252 seconds)
20:53 🔗 schbirid has quit IRC (Leaving)
20:58 🔗 habi has joined #archiveteam
20:58 🔗 habi has left
21:03 🔗 Jonimus has joined #archiveteam
21:29 🔗 mistym has quit IRC (Remote host closed the connection)
21:44 🔗 DFJustin http://thisismyjam.tumblr.com/post/126260430022/jam-preserves
21:53 🔗 Emcy_ has quit IRC (Read error: Connection reset by peer)
21:55 🔗 gui77 is it possible to, for a project like blip, have more than --concurrent 20 on a machine?
21:57 🔗 gui77 I'm asking because it seems to be running fine with 20 (for this project that is) and I still have bw available
21:57 🔗 JesseW DFJustin -- we should probably make a wiki entry for that, but it doesn't seem (at the moment) like we need to do a grab...
22:00 🔗 dashcloud has quit IRC (Read error: Operation timed out)
22:03 🔗 dashcloud has joined #archiveteam
22:05 🔗 DFJustin yeah
22:09 🔗 aaaaaaaaa gui77: its usually not recommended to run too many concurrent jobs at the same time as seesaw gets unstable. Instead, you can clone into a different directory with a different name and start another pipeline
22:22 🔗 Emcy has joined #archiveteam
22:28 🔗 RichardG_ is now known as RichardG
22:30 🔗 mistym has joined #archiveteam
22:39 🔗 mistym has quit IRC (Ping timeout: 483 seconds)
22:41 🔗 JesseW DFJustin: I made a page: http://archiveteam.org/index.php?title=This_Is_My_Jam
22:43 🔗 dashcloud has quit IRC (Read error: Operation timed out)
22:53 🔗 dashcloud has joined #archiveteam
22:54 🔗 kukutz has quit IRC (Read error: Operation timed out)
23:03 🔗 xk_id has joined #archiveteam
23:24 🔗 xk_id has quit IRC (Read error: Connection reset by peer)

irclogger-viewer