| Time |
Nickname |
Message |
|
04:02
🔗
|
SketchCow |
Morning. |
|
06:09
🔗
|
SketchCow |
Archive.org Fund Drive began. |
|
06:09
🔗
|
SketchCow |
3-1 matching, etc |
|
13:33
🔗
|
arkiver |
I see some of you are working on this one here: |
|
13:33
🔗
|
arkiver |
http://archiveteam.org/index.php?title=Gamespy,_1up,_UGO,_IGN |
|
13:33
🔗
|
arkiver |
can I help? |
|
13:34
🔗
|
arkiver |
can I just select a domain, create a WARC and then add finished to it? |
|
13:51
🔗
|
arkiver |
Is it true that this one hasn't even started? |
|
13:51
🔗
|
arkiver |
http://archiveteam.org/index.php?title=Warhammer |
|
13:51
🔗
|
arkiver |
I've started to download it now |
|
13:51
🔗
|
arkiver |
I can do the website itself I think |
|
13:52
🔗
|
arkiver |
but we need a bit more power for the forums... |
|
14:48
🔗
|
joepie91 |
acquihire of eBuddy by Booking.com |
|
14:48
🔗
|
joepie91 |
(this time it's in the right channel) |
|
14:48
🔗
|
joepie91 |
service likely to disappear |
|
15:03
🔗
|
arkiver |
how are you sure booking.com is going to disappear? |
|
15:04
🔗
|
Cameron_D |
ebuddy will dissapear, not booking.com |
|
15:10
🔗
|
arkiver |
what's the website link of ebuddy? |
|
15:11
🔗
|
arkiver |
ah this one right? |
|
15:11
🔗
|
arkiver |
http://www.ebuddy.com/ |
|
15:11
🔗
|
arkiver |
will put a quick crawl on that webiste... ;) |
|
15:11
🔗
|
arkiver |
website* |
|
15:14
🔗
|
arkiver |
they also have this website: http://xms.me/ |
|
15:14
🔗
|
arkiver |
will do that one too |
|
15:14
🔗
|
arkiver |
and this |
|
15:14
🔗
|
arkiver |
http://www.ebuddyxms.com/ |
|
15:24
🔗
|
arkiver |
----- |
|
15:24
🔗
|
arkiver |
www.ebuddyxms.com «Finished: FINISHED» 1 launches |
|
15:24
🔗
|
arkiver |
161 downloaded + 0 queued = 161 total |
|
15:24
🔗
|
arkiver |
2.2 MiB crawled (2.2 MiB novel, 0 B dupByHash, 0 B notModified) |
|
15:24
🔗
|
arkiver |
----- |
|
15:24
🔗
|
arkiver |
xms.me «Finished: FINISHED» 1 launches |
|
15:25
🔗
|
arkiver |
157 downloaded + 0 queued = 157 total |
|
15:25
🔗
|
arkiver |
2.2 MiB crawled (2.2 MiB novel, 0 B dupByHash, 0 B notModified) |
|
15:25
🔗
|
arkiver |
----- |
|
17:42
🔗
|
arkiver |
looks like http://www.warhammeronline.com/ might be finished downloading tomorrow |
|
17:42
🔗
|
arkiver |
I need some help though on the forums!!! |
|
18:36
🔗
|
m1das |
arkiver: do you have a script i can use for the forums? |
|
18:36
🔗
|
xmc |
there's a couple of wget-warc-lua forum scripts on the archiveteam github |
|
18:36
🔗
|
m1das |
preferrible pipeline ;-) |
|
18:36
🔗
|
xmc |
not pipeline |
|
18:36
🔗
|
arkiver |
nope that's the problem |
|
18:36
🔗
|
arkiver |
the forum of warhammer is a subforum of that forum |
|
18:37
🔗
|
arkiver |
so I have no idea how to only download that subforum... |
|
18:37
🔗
|
BiggieJon |
do I need an account to grab forums ? |
|
18:37
🔗
|
m1das |
i have the storage if needed |
|
18:37
🔗
|
arkiver |
downloading the whole forum would be a too big job to quickly complete |
|
18:37
🔗
|
arkiver |
yes, I can crawl it too |
|
18:37
🔗
|
arkiver |
but I just don't know how to only crawl that subforum |
|
20:41
🔗
|
ersi |
SketchCow: Fuck yeah, donated |
|
21:30
🔗
|
ivan` |
http://emergentseas.tumblr.com/robots.txt there are probably a few million tumblrs that block robots |
|
21:32
🔗
|
balrog |
yahoo did that to a lot of tumblrs after the acquisition |
|
21:33
🔗
|
ivan` |
I could run through every tumblr I know |
|
21:33
🔗
|
ivan` |
then we can tell archivebot to do all of them ;) |
|
21:52
🔗
|
balrog |
http://ge.tt/blog/17 // http://ge.tt/press/gett-acquired-by-economic-accounting |
|
21:52
🔗
|
balrog |
fyi |
|
21:56
🔗
|
ivan` |
seems they have a lot of stuff https://encrypted.google.com/search?q=site%3Age.tt |
|
21:56
🔗
|
balrog |
people still use ge.tt |
|
22:01
🔗
|
joepie91 |
ge.tt... |
|
22:01
🔗
|
joepie91 |
that rings a bell.. |
|
22:01
🔗
|
balrog |
I'm not saying they're going away, just that they got acquired |
|
22:03
🔗
|
BlueMax |
it's a URL shortener, and that should trigger every AT member's "shit on this website" reflex |
|
22:03
🔗
|
BlueMax |
much like yahoo. |
|
22:03
🔗
|
balrog |
BlueMax: it's not a shortener, it's more like cloudapp |
|
22:04
🔗
|
balrog |
a file upload service |
|
22:04
🔗
|
balrog |
cloudapp is cl.ly |
|
22:04
🔗
|
BlueMax |
ah. short URL confuddled me |
|
22:25
🔗
|
ivan` |
does anyone have a linode in the NJ datacenter? I have a tumblr script for you to run |
|
22:25
🔗
|
ivan` |
my linode is there but its memory is clogged with wgets |
|
22:47
🔗
|
ivan` |
okay, checking 21M tumblr robots.txt's, should be done in a week |
|
22:49
🔗
|
ivan` |
there will be about 1.25M of these that block all robots |
|
23:40
🔗
|
nico_32 |
2,8G /mnt/archiveteam/wiki/tcrfnet-20131130-wikidump/images |
|
23:41
🔗
|
nico_32 |
backup of the cutting floor wiki in progress |
|
23:41
🔗
|
nico_32 |
running since 5 days :) |
|
23:57
🔗
|
ex-parrot |
nico_32: awesome, thanks |