#archiveteam 2013-12-01,Sun

↑back Search

Time Nickname Message
00:28 🔗 bsmith093 i was given this rsync code, to upload my stuff into your server. i havent updated the dumps in about a minth so do i run it from inside the folder im trying to upload rsync -avhczP --stats --progress . bsmith@(servername):/home/bsmith --verbose
00:28 🔗 bsmith093 *month
00:29 🔗 bsmith093 underscor
00:31 🔗 bsmith093 nvm , i just remmbered why that peroid whs in there
00:42 🔗 nico_32 463667200 43% 127.68kB/s 1:18:10 go go go rsync
03:50 🔗 ussjoin I kicked my Warrior back on... is it normal that it can't get any new items at all? (Retries over and over)
03:52 🔗 GLaDOS Is this hyves grab?
03:53 🔗 GLaDOS If so, we've ran out of users to grab.
03:53 🔗 ussjoin It's *every* grab.
03:53 🔗 GLaDOS yeah, we've ran out of things to grab..
03:54 🔗 ussjoin Hrm. That seems... sad.
03:54 🔗 GLaDOS Yeah, I'm not sure if I should be happy or sad..
03:54 🔗 GLaDOS Switch to bloopertv
03:54 🔗 GLaDOS I'll release current outstanding claims
03:55 🔗 ussjoin K.
03:56 🔗 ussjoin I'm getting all Code 8s.
03:57 🔗 GLaDOS ..server issued error response.
03:58 🔗 GLaDOS blip.tv deleted the rest of the items :c
03:58 🔗 ussjoin Well, shit.
05:50 🔗 yipdw ussjoin: there is still plenty to do on hyves-grab
05:51 🔗 yipdw just hold on a bit
05:51 🔗 yipdw head to #angerthehyve for more info
12:12 🔗 Nemo_bis https://code.google.com/p/wikiteam/issues/detail?id=59#c4
15:37 🔗 Nemo_bis any more suggestions? https://gist.github.com/nemobis/7718061#file-wiki-scraper-rb-L24
16:01 🔗 nico_32 Nemo_bis: try /w/api.php or /wiki/api.php
16:15 🔗 Nemo_bis most wikis exclude that in robots.txt, but I guess it can be added, rihgt
16:18 🔗 joepie91 hahaha robots.txt
16:18 🔗 joepie91 :D
16:19 🔗 joepie91 also, Nemo_bis, I should note that 503s on Google are temporary
16:19 🔗 joepie91 when you get banned for a Google dork
16:19 🔗 joepie91 you can generally pause for about a day, and you'll be unbanned
16:19 🔗 joepie91 (from my experience in writing a calibre scraper)
16:54 🔗 D-Mad hi?
16:55 🔗 D-Mad Failed tinyback for Item
16:55 🔗 D-Mad I just set up the archive warrior but apparently it isnt doing anything
16:56 🔗 Marcelo Go to the choose project page
16:56 🔗 D-Mad yeah im now on the URL project
16:56 🔗 Marcelo We need help in Hyves Discovery
16:56 🔗 D-Mad okay.. but i see 4 download speeds on the local host page
16:56 🔗 D-Mad the top ones are on 600kb/s
16:56 🔗 D-Mad but the bottom ones are on 0.1kb/s
16:57 🔗 D-Mad so it is not doing anything?
16:57 🔗 Marcelo They're small.
16:57 🔗 D-Mad ok it's now on the hyves discovery
16:58 🔗 Nemo_bis IIRC tinyback is mostly CPU-bound, rather than bandwidth-bound
16:58 🔗 Nemo_bis and some of those services are extremely slow
16:58 🔗 D-Mad okay but what do the top and bottom bandwith speeds exactly mean?
16:58 🔗 Marcelo D-Mad: #angerthehyve
18:54 🔗 ussjoin yipdw: Thanks for the tip; I reactivated my warrior. (I had it on that before, but it didn't get any tasks.)
18:55 🔗 yipdw ussjoin: np
20:30 🔗 D-Mad hi
21:36 🔗 SketchCow Now.... to write my presentation
22:08 🔗 godane SketchCow: all of NGC magazine that i got is uploaded
22:08 🔗 godane only 1 more issue and its a complete set
22:09 🔗 godane but its not scanned yet by kiwi
22:34 🔗 SketchCow Fantastic
22:34 🔗 SketchCow Are you putting these in the inbox?
22:34 🔗 godane yes
22:36 🔗 SketchCow Great.
22:45 🔗 godane SketchCow: here is a ftp for you: ftp://ftp.qmags.com
22:46 🔗 godane i decide to stop mirroring that cause its very big
22:47 🔗 BlueMax jesus you weren't kidding
22:47 🔗 godane i only at the C files and its 13gb big
22:56 🔗 godane here is a picture of one of my kids: https://scontent-a-lga.xx.fbcdn.net/hphotos-prn2/1474623_620420401351457_1562545873_n.jpg
23:01 🔗 Sellyme godane: have these people never heard of folders?
23:03 🔗 godane it maybe worser
23:04 🔗 godane ftp://ftp.qmags.com/others/
23:04 🔗 Sellyme Oh, they have
23:04 🔗 godane looks like they have but i not sure everything is in the others folder
23:04 🔗 Sellyme Well that's actually reasonable enough
23:06 🔗 godane for example ACG pdfs are not all in this subfolder: ftp://ftp.qmags.com/others/ACG/
23:08 🔗 godane but i think that most past 2007 pdfs are saying there ecrypted
23:12 🔗 godane some figure out if this one works or not: ftp://ftp.qmags.com/ACG_20070401_Apr_2007.pdf
23:15 🔗 underscor ivan`: https://archive.org/help/wayback_api.php
23:16 🔗 ivan` ah, thanks
23:18 🔗 nico_32 hey that's cool
23:18 🔗 nico_32 http://web.archive.org/cdx/search/cdx?url=sid.rstack.org
23:19 🔗 nico_32 ho no http://web.archive.org/cdx/search/cdx?url=hyves.nl
23:26 🔗 balrog not like we can do anything but: http://en.pokemon-gl.com/about/e_notice/
23:27 🔗 balrog http://en.pokemon-gl.com/#/information/839
23:40 🔗 deathy archiveteam.org down?
23:41 🔗 SketchCow You are correct.
23:44 🔗 ivan` SketchCow: do you upload /archivebot/ .warc.gz's that have no corresponding .json file?
23:44 🔗 ivan` I have a few of them
23:44 🔗 SketchCow Yeah, that machine is down hard.
23:44 🔗 SketchCow Of course.
23:44 🔗 ivan` thanks
23:56 🔗 SketchCow I opened a support ticket on the downed machine.

irclogger-viewer