Time |
Nickname |
Message |
00:28
🔗
|
bsmith093 |
i was given this rsync code, to upload my stuff into your server. i havent updated the dumps in about a minth so do i run it from inside the folder im trying to upload rsync -avhczP --stats --progress . bsmith@(servername):/home/bsmith --verbose |
00:28
🔗
|
bsmith093 |
*month |
00:29
🔗
|
bsmith093 |
underscor |
00:31
🔗
|
bsmith093 |
nvm , i just remmbered why that peroid whs in there |
00:42
🔗
|
nico_32 |
463667200 43% 127.68kB/s 1:18:10 go go go rsync |
03:50
🔗
|
ussjoin |
I kicked my Warrior back on... is it normal that it can't get any new items at all? (Retries over and over) |
03:52
🔗
|
GLaDOS |
Is this hyves grab? |
03:53
🔗
|
GLaDOS |
If so, we've ran out of users to grab. |
03:53
🔗
|
ussjoin |
It's *every* grab. |
03:53
🔗
|
GLaDOS |
yeah, we've ran out of things to grab.. |
03:54
🔗
|
ussjoin |
Hrm. That seems... sad. |
03:54
🔗
|
GLaDOS |
Yeah, I'm not sure if I should be happy or sad.. |
03:54
🔗
|
GLaDOS |
Switch to bloopertv |
03:54
🔗
|
GLaDOS |
I'll release current outstanding claims |
03:55
🔗
|
ussjoin |
K. |
03:56
🔗
|
ussjoin |
I'm getting all Code 8s. |
03:57
🔗
|
GLaDOS |
..server issued error response. |
03:58
🔗
|
GLaDOS |
blip.tv deleted the rest of the items :c |
03:58
🔗
|
ussjoin |
Well, shit. |
05:50
🔗
|
yipdw |
ussjoin: there is still plenty to do on hyves-grab |
05:51
🔗
|
yipdw |
just hold on a bit |
05:51
🔗
|
yipdw |
head to #angerthehyve for more info |
12:12
🔗
|
Nemo_bis |
https://code.google.com/p/wikiteam/issues/detail?id=59#c4 |
15:37
🔗
|
Nemo_bis |
any more suggestions? https://gist.github.com/nemobis/7718061#file-wiki-scraper-rb-L24 |
16:01
🔗
|
nico_32 |
Nemo_bis: try /w/api.php or /wiki/api.php |
16:15
🔗
|
Nemo_bis |
most wikis exclude that in robots.txt, but I guess it can be added, rihgt |
16:18
🔗
|
joepie91 |
hahaha robots.txt |
16:18
🔗
|
joepie91 |
:D |
16:19
🔗
|
joepie91 |
also, Nemo_bis, I should note that 503s on Google are temporary |
16:19
🔗
|
joepie91 |
when you get banned for a Google dork |
16:19
🔗
|
joepie91 |
you can generally pause for about a day, and you'll be unbanned |
16:19
🔗
|
joepie91 |
(from my experience in writing a calibre scraper) |
16:54
🔗
|
D-Mad |
hi? |
16:55
🔗
|
D-Mad |
Failed tinyback for Item |
16:55
🔗
|
D-Mad |
I just set up the archive warrior but apparently it isnt doing anything |
16:56
🔗
|
Marcelo |
Go to the choose project page |
16:56
🔗
|
D-Mad |
yeah im now on the URL project |
16:56
🔗
|
Marcelo |
We need help in Hyves Discovery |
16:56
🔗
|
D-Mad |
okay.. but i see 4 download speeds on the local host page |
16:56
🔗
|
D-Mad |
the top ones are on 600kb/s |
16:56
🔗
|
D-Mad |
but the bottom ones are on 0.1kb/s |
16:57
🔗
|
D-Mad |
so it is not doing anything? |
16:57
🔗
|
Marcelo |
They're small. |
16:57
🔗
|
D-Mad |
ok it's now on the hyves discovery |
16:58
🔗
|
Nemo_bis |
IIRC tinyback is mostly CPU-bound, rather than bandwidth-bound |
16:58
🔗
|
Nemo_bis |
and some of those services are extremely slow |
16:58
🔗
|
D-Mad |
okay but what do the top and bottom bandwith speeds exactly mean? |
16:58
🔗
|
Marcelo |
D-Mad: #angerthehyve |
18:54
🔗
|
ussjoin |
yipdw: Thanks for the tip; I reactivated my warrior. (I had it on that before, but it didn't get any tasks.) |
18:55
🔗
|
yipdw |
ussjoin: np |
20:30
🔗
|
D-Mad |
hi |
21:36
🔗
|
SketchCow |
Now.... to write my presentation |
22:08
🔗
|
godane |
SketchCow: all of NGC magazine that i got is uploaded |
22:08
🔗
|
godane |
only 1 more issue and its a complete set |
22:09
🔗
|
godane |
but its not scanned yet by kiwi |
22:34
🔗
|
SketchCow |
Fantastic |
22:34
🔗
|
SketchCow |
Are you putting these in the inbox? |
22:34
🔗
|
godane |
yes |
22:36
🔗
|
SketchCow |
Great. |
22:45
🔗
|
godane |
SketchCow: here is a ftp for you: ftp://ftp.qmags.com |
22:46
🔗
|
godane |
i decide to stop mirroring that cause its very big |
22:47
🔗
|
BlueMax |
jesus you weren't kidding |
22:47
🔗
|
godane |
i only at the C files and its 13gb big |
22:56
🔗
|
godane |
here is a picture of one of my kids: https://scontent-a-lga.xx.fbcdn.net/hphotos-prn2/1474623_620420401351457_1562545873_n.jpg |
23:01
🔗
|
Sellyme |
godane: have these people never heard of folders? |
23:03
🔗
|
godane |
it maybe worser |
23:04
🔗
|
godane |
ftp://ftp.qmags.com/others/ |
23:04
🔗
|
Sellyme |
Oh, they have |
23:04
🔗
|
godane |
looks like they have but i not sure everything is in the others folder |
23:04
🔗
|
Sellyme |
Well that's actually reasonable enough |
23:06
🔗
|
godane |
for example ACG pdfs are not all in this subfolder: ftp://ftp.qmags.com/others/ACG/ |
23:08
🔗
|
godane |
but i think that most past 2007 pdfs are saying there ecrypted |
23:12
🔗
|
godane |
some figure out if this one works or not: ftp://ftp.qmags.com/ACG_20070401_Apr_2007.pdf |
23:15
🔗
|
underscor |
ivan`: https://archive.org/help/wayback_api.php |
23:16
🔗
|
ivan` |
ah, thanks |
23:18
🔗
|
nico_32 |
hey that's cool |
23:18
🔗
|
nico_32 |
http://web.archive.org/cdx/search/cdx?url=sid.rstack.org |
23:19
🔗
|
nico_32 |
ho no http://web.archive.org/cdx/search/cdx?url=hyves.nl |
23:26
🔗
|
balrog |
not like we can do anything but: http://en.pokemon-gl.com/about/e_notice/ |
23:27
🔗
|
balrog |
http://en.pokemon-gl.com/#/information/839 |
23:40
🔗
|
deathy |
archiveteam.org down? |
23:41
🔗
|
SketchCow |
You are correct. |
23:44
🔗
|
ivan` |
SketchCow: do you upload /archivebot/ .warc.gz's that have no corresponding .json file? |
23:44
🔗
|
ivan` |
I have a few of them |
23:44
🔗
|
SketchCow |
Yeah, that machine is down hard. |
23:44
🔗
|
SketchCow |
Of course. |
23:44
🔗
|
ivan` |
thanks |
23:56
🔗
|
SketchCow |
I opened a support ticket on the downed machine. |