#archiveteam 2013-06-21,Fri

↑back Search

Time Nickname Message
08:01 🔗 namespace ...
08:01 🔗 namespace My grab is done.
08:02 🔗 Smiley grab of what?
08:02 🔗 namespace A website I'd rather not name. Sadly I think the connection just timed out.
08:02 🔗 Smiley k, upload to IA?
08:03 🔗 namespace Maybe, need to make sure it's relatively complete/doesn't have my username at the top of every page.
08:03 🔗 Smiley you know about warc-proxy?
08:04 🔗 namespace That wouldn't help here, forum grab.
08:04 🔗 Smiley hmmm, so you didn't make a warc?
08:04 🔗 namespace I did.
08:04 🔗 namespace I think I did anyway.
08:04 🔗 Smiley lol
08:04 🔗 namespace I used --warc-file
08:04 🔗 Smiley yah
08:04 🔗 namespace Though I'm still not exactly sure what that option is supposed to do.
08:04 🔗 Smiley well if you use warc proxy, you can "see" what's in the warc
08:05 🔗 namespace Ah.
08:05 🔗 Smiley as if it was live
08:05 🔗 namespace Less won't do it?
08:05 🔗 Smiley --warc-file="$WARC_NAME"
08:05 🔗 Smiley less will show you the code.
08:05 🔗 Smiley SO you can grep and stuff
08:07 🔗 namespace I think it saved it as raw html files and then as a warc.
08:07 🔗 namespace Anyway, where do I get this warc-proxy utility?
08:08 🔗 Smiley github has instructions i believe
08:08 🔗 Smiley yah, it will do both a mirror + the warc
08:09 🔗 namespace Thanks.
08:10 🔗 winr4r morning folks
09:17 🔗 Smiley WE NEED MORE SPEED ON XANGA.
10:01 🔗 winr4r are they throttling?
13:27 🔗 Smiley not that I've noticed.
15:01 🔗 frogainci Hi, is there a possibility to kill specific threads in the warrior?
15:02 🔗 frogainci I get the following error:
15:02 🔗 frogainci Traceback (most recent call last): File "/usr/local/lib/python2.6/dist-packages/tornado/stack_context.py", line 258, in _nested File "/usr/local/lib/python2.6/dist-packages/tornado/stack_context.py", line 228, in wrapped File "<string>", line 102, in handle_response IOError: [Errno 24] Too many open files:
15:02 🔗 frogainci and after I'm unable to upload anything...
15:11 🔗 Smiley reboot your warrior is prob fastest fix
15:11 🔗 Smiley you could by logging in to the warrior
15:11 🔗 Smiley but that sounds like the entire webserver fell over
15:14 🔗 omf_ reboot it
15:15 🔗 * Smiley points to 16:11:05 GMT
15:17 🔗 frogainci Smiley: there are still a couple of packages ready...
15:17 🔗 frogainci isn't there a possibilty to use run-pipeline or so?
15:18 🔗 frogainci Just to push them out?
15:21 🔗 Smiley yes
15:22 🔗 Smiley http://archiveteam.org/index.php?title=Posterous#Seesaw_script_.28for_advanced_users.29
15:22 🔗 Smiley need to swap posterous for xanga
15:23 🔗 frogainci thx
15:23 🔗 frogainci will check this
15:39 🔗 frogainci okay... i cannot figure out how to start rsync automatically.... going to kill it then...
15:40 🔗 frogainci or is there a possbility to increment concurrent uploads while running?
15:43 🔗 Smiley dunno
16:40 🔗 ivan` did you know Google Reader is actually capable of reading feeds hosted on FTP servers
16:41 🔗 ivan` https://www.google.com/reader/view/#stream/feed%2Fftp%3A%2F%2Fftp.tcrc.edu.tw%2FMySQL%2Fworkbench%2Findex.html%253Ffeed%3Drss2
17:30 🔗 Coderjoe wow. the warrior web UI is pretty nice
17:31 🔗 Coderjoe so, xanga?
17:41 🔗 omf_ #jenga Coderjoe
17:56 🔗 Coderjoe I mean should I choose that rather than one of the other options
18:45 🔗 winr4r Coderjoe: yes
21:34 🔗 dashcloud This is exciting news from LibreOffice: http://fridrich.blogspot.ch/2013/06/libreoffice-import-filter-for-legacy.html - many pre-OS X word/text formats are now supported
21:35 🔗 arrith1 nice. wonder if that can be used to automate batch conversions easily.
21:38 🔗 dashcloud probably

irclogger-viewer