#archiveteam 2015-09-16,Wed

↑back Search

Time Nickname Message
00:19 🔗 nico_32_ is now known as nico_32
00:20 🔗 MMovie2 has joined #archiveteam
00:21 🔗 MMovie has quit IRC (Read error: Operation timed out)
00:33 🔗 balrog has quit IRC (Quit: Bye)
00:34 🔗 balrog has joined #archiveteam
00:34 🔗 swebb sets mode: +o balrog
00:37 🔗 balrog sets mode: +o Lord_Nigh
00:45 🔗 MMovie has joined #archiveteam
00:48 🔗 MMovie2 has quit IRC (Ping timeout: 306 seconds)
00:57 🔗 primus104 has quit IRC (Read error: Connection reset by peer)
01:17 🔗 garyrh_ has joined #archiveteam
01:54 🔗 SketchCow http://52.21.173.249:9020/mosaic/1996/http://yahoo.com/
01:58 🔗 jspiros why does this remind me of IRIX
02:08 🔗 mafrasi2 has quit IRC (Remote host closed the connection)
02:09 🔗 mafrasi2 has joined #archiveteam
02:15 🔗 Fletcher has joined #archiveteam
02:15 🔗 zhongfu has joined #archiveteam
02:15 🔗 afics has joined #archiveteam
02:15 🔗 diacope has joined #archiveteam
02:15 🔗 HCross has joined #archiveteam
02:15 🔗 kevin has joined #archiveteam
02:15 🔗 dan- has joined #archiveteam
02:15 🔗 Ungstein has joined #archiveteam
02:15 🔗 pikhq has joined #archiveteam
02:15 🔗 rizzzz has joined #archiveteam
02:15 🔗 aliz has joined #archiveteam
02:15 🔗 Wyatts has joined #archiveteam
02:15 🔗 _0x2A has joined #archiveteam
02:15 🔗 lhobas has joined #archiveteam
02:15 🔗 GLaDOS has joined #archiveteam
02:15 🔗 Boltsie has joined #archiveteam
02:15 🔗 JSharp has joined #archiveteam
02:15 🔗 karissa has joined #archiveteam
02:15 🔗 _desu_ has joined #archiveteam
02:15 🔗 Ctrl-S has joined #archiveteam
02:15 🔗 russss__ has joined #archiveteam
02:15 🔗 zyphlar has joined #archiveteam
02:15 🔗 codl has joined #archiveteam
02:15 🔗 deathy has joined #archiveteam
02:15 🔗 sigkell has joined #archiveteam
02:15 🔗 irl1 has joined #archiveteam
02:15 🔗 Rickster has joined #archiveteam
02:15 🔗 Muad-Dib has joined #archiveteam
02:15 🔗 efnet.port80.se sets mode: +o GLaDOS
02:15 🔗 GLaDOS sets mode: +o SketchCow
02:43 🔗 garyrh_ has quit IRC (Read error: Operation timed out)
03:18 🔗 Famicoman has joined #archiveteam
03:23 🔗 dan- has quit IRC (Ping timeout: 252 seconds)
03:35 🔗 dan- has joined #archiveteam
03:40 🔗 xk_id has quit IRC (Remote host closed the connection)
04:07 🔗 zyphlar has quit IRC (Ping timeout: 252 seconds)
04:08 🔗 zyphlar has joined #archiveteam
04:13 🔗 JesseW has joined #archiveteam
04:23 🔗 garyrh_ has joined #archiveteam
04:29 🔗 aaaaaaaaa has quit IRC (Leaving)
04:33 🔗 Emcy has quit IRC (Ping timeout: 306 seconds)
04:38 🔗 Ungstein has quit IRC (Quit: Leaving.)
04:43 🔗 trs80 has quit IRC (Ping timeout: 186 seconds)
04:44 🔗 Emcy has joined #archiveteam
04:46 🔗 scyther has joined #archiveteam
05:02 🔗 wednesday has quit IRC (Quit: Be the change that you wish to see in the world.)
05:03 🔗 wednesday has joined #archiveteam
05:07 🔗 trs80 has joined #archiveteam
05:09 🔗 habi has joined #archiveteam
05:10 🔗 habi has quit IRC (Client Quit)
05:33 🔗 scyther has quit IRC (Leaving)
06:09 🔗 wyatt874- has joined #archiveteam
06:09 🔗 wyatt8740 has quit IRC (Read error: Connection reset by peer)
07:05 🔗 wednesday has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 dan- has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 mafrasi2 has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 Sue_ has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 khaoohs_ has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 beardicus has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 DFJustin has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 Froggypwn has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 wacky has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 ohhdemgir has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 Sanqui has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 bentpins has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 Atom__ has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 chfoo- has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 matthusby has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 SadDM has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 DFJustinZ has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 zer0c00l has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 PotcFdk has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 kniffy has quit IRC (ny.us.hub west.us.hub)
07:05 🔗 xmc has quit IRC (ny.us.hub west.us.hub)
07:14 🔗 PurpleSym has joined #archiveteam
07:46 🔗 JesseW has quit IRC (Read error: Operation timed out)
07:48 🔗 cadbury_ has quit IRC (Read error: Operation timed out)
07:49 🔗 xmc has joined #archiveteam
07:49 🔗 kniffy has joined #archiveteam
07:49 🔗 PotcFdk has joined #archiveteam
07:49 🔗 zer0c00l has joined #archiveteam
07:49 🔗 DFJustinZ has joined #archiveteam
07:49 🔗 SadDM has joined #archiveteam
07:49 🔗 matthusby has joined #archiveteam
07:49 🔗 chfoo- has joined #archiveteam
07:49 🔗 Atom__ has joined #archiveteam
07:49 🔗 bentpins has joined #archiveteam
07:49 🔗 Sanqui has joined #archiveteam
07:49 🔗 ohhdemgir has joined #archiveteam
07:49 🔗 wacky has joined #archiveteam
07:49 🔗 Froggypwn has joined #archiveteam
07:49 🔗 DFJustin has joined #archiveteam
07:49 🔗 beardicus has joined #archiveteam
07:49 🔗 khaoohs_ has joined #archiveteam
07:49 🔗 Sue_ has joined #archiveteam
07:49 🔗 mafrasi2 has joined #archiveteam
07:49 🔗 dan- has joined #archiveteam
07:49 🔗 wednesday has joined #archiveteam
07:49 🔗 west.us.hub sets mode: +ooo xmc SadDM DFJustin
07:49 🔗 swebb sets mode: +o xmc
07:49 🔗 swebb sets mode: +o SadDM
07:49 🔗 swebb sets mode: +o DFJustin
07:59 🔗 schbirid has joined #archiveteam
08:14 🔗 primus104 has joined #archiveteam
08:18 🔗 atomotic has joined #archiveteam
08:30 🔗 garyrh has joined #archiveteam
08:40 🔗 MMovie2 has joined #archiveteam
08:43 🔗 MMovie has quit IRC (Ping timeout: 306 seconds)
08:46 🔗 Ungstein has joined #archiveteam
09:30 🔗 MMovie2 has quit IRC (Ping timeout: 306 seconds)
09:34 🔗 MMovie has joined #archiveteam
09:40 🔗 MMovie has quit IRC (Ping timeout: 306 seconds)
09:43 🔗 MMovie has joined #archiveteam
09:47 🔗 garyrh_ has quit IRC (Quit: Leaving)
09:47 🔗 dashcloud has quit IRC (Read error: Operation timed out)
09:49 🔗 dashcloud has joined #archiveteam
10:02 🔗 RedType has quit IRC (Ping timeout: 240 seconds)
10:03 🔗 RedType has joined #archiveteam
10:06 🔗 MMovie has quit IRC (Ping timeout: 306 seconds)
10:13 🔗 koo5 has quit IRC (Read error: Operation timed out)
10:16 🔗 MMovie has joined #archiveteam
10:38 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
10:44 🔗 dan- has quit IRC (Ping timeout: 483 seconds)
10:46 🔗 dan- has joined #archiveteam
11:00 🔗 anomie has quit IRC (Read error: Connection reset by peer)
11:04 🔗 anomie has joined #archiveteam
11:34 🔗 DFJustin has quit IRC (Read error: Connection reset by peer)
11:34 🔗 DFJustin has joined #archiveteam
11:34 🔗 swebb sets mode: +o DFJustin
11:49 🔗 atomotic has joined #archiveteam
12:00 🔗 vitzli has joined #archiveteam
12:06 🔗 vitzli has quit IRC (Client Quit)
12:13 🔗 nertzy has joined #archiveteam
12:29 🔗 mafrasi2 has quit IRC (Remote host closed the connection)
12:29 🔗 anomie has quit IRC (Read error: Connection reset by peer)
12:31 🔗 mafrasi2 has joined #archiveteam
12:32 🔗 anomie has joined #archiveteam
13:00 🔗 nertzy has quit IRC (Quit: This computer has gone to sleep)
13:05 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
13:15 🔗 vitzli has joined #archiveteam
13:17 🔗 primus104 has quit IRC (Leaving.)
13:31 🔗 PurpleSym has quit IRC (Remote host closed the connection)
13:40 🔗 scyther has joined #archiveteam
13:40 🔗 signius has quit IRC (Ping timeout: 306 seconds)
13:44 🔗 sep332 has quit IRC (bye)
13:50 🔗 xk_id has joined #archiveteam
13:51 🔗 mafrasi2 has quit IRC (Remote host closed the connection)
13:52 🔗 mafrasi2 has joined #archiveteam
13:52 🔗 signius has joined #archiveteam
13:56 🔗 Start has quit IRC (Quit: Disconnected.)
14:08 🔗 mafrasi2 has quit IRC (Remote host closed the connection)
14:10 🔗 mafrasi2 has joined #archiveteam
14:18 🔗 mafrasi2 has quit IRC (Remote host closed the connection)
14:20 🔗 mafrasi2 has joined #archiveteam
14:37 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
14:42 🔗 Start has joined #archiveteam
14:46 🔗 cadbury_ has joined #archiveteam
14:57 🔗 SketchCow OMNI Magazine on the Archive took it in the face today.
14:57 🔗 SketchCow Bummerrrrrrrrrrr
14:58 🔗 MrRadar What do you mean? DMCA'd?
15:00 🔗 SketchCow A little more than DMCA'd but the place that owns it finally decided they want it down.
15:00 🔗 MrRadar Yeah, just checked your twitter
15:09 🔗 SketchCow http://magic.wizards.com/en/articles/archive/news/wizards-coast-community-forums-be-shut-down-2015-09-16
15:09 🔗 SketchCow Awwwwwww SHIT son
15:09 🔗 SketchCow (The headline entry is off - it's actually shut down in October)
15:10 🔗 Coderjoe has quit IRC (Ping timeout: 186 seconds)
15:11 🔗 MrRadar Argh, can't all these site owners give us a break?
15:16 🔗 Coderjoe has joined #archiveteam
15:22 🔗 PurpleSym has joined #archiveteam
15:32 🔗 JesseW has joined #archiveteam
15:34 🔗 Aranje has joined #archiveteam
15:56 🔗 SketchCow Well, FOS is definitely hammered
15:57 🔗 MrRadar There are still up to 5000 items for Skillfeed that haven't been queued yet (it looks like only items 0 through 9999 were queued but there are valid items up through 14500)
15:57 🔗 MrRadar Are you planning to let FOS catch up before queueing them
15:58 🔗 HCross Probably the best bet. I am still going to be uploading for a while
15:59 🔗 SketchCow I'm going to try something.
15:59 🔗 SketchCow So, normally we megawarc.
15:59 🔗 SketchCow Because we are HEROES
15:59 🔗 SketchCow This makes no sense here. This stuff is mega compressed.
15:59 🔗 SketchCow And it's only a few dozen, or a couple hundred files.
16:01 🔗 JesseW has quit IRC (Read error: Operation timed out)
16:03 🔗 SketchCow Doing it. First one will be shortly.
16:03 🔗 SketchCow This MAY save us.
16:05 🔗 SketchCow (Trying it now.)
16:07 🔗 Start has quit IRC (Quit: Disconnected.)
16:09 🔗 SketchCow https://archive.org/details/archiveteam_skillfeed_20150915150652
16:09 🔗 SketchCow It LOOKS like they're populating nicely.
16:09 🔗 SketchCow (And removing themselves off the FOS server as they go.)
16:09 🔗 arkiver SketchCow: not packing them anymore?
16:10 🔗 SketchCow Not into megawarcs.
16:10 🔗 SketchCow They don't need to be megawarcs. At this size, they're well below the "make IA blow up" threshold.
16:10 🔗 SketchCow I see between 20-200 files per 40gb item.
16:10 🔗 arkiver There might be one or two 40 GB items, those would be handled ok?
16:10 🔗 SketchCow Don't change anything on your end - this just makes FOS work less.
16:10 🔗 SketchCow Yes, it means that item will have one file
16:11 🔗 SketchCow The system doesn't truncate at 40gb - it goes "is this larger than 40gb? make a new item"
16:11 🔗 SketchCow So it can be 1tb after a single file copy. It just takes it.
16:11 🔗 arkiver Ok, got it
16:11 🔗 arkiver So ArchiveBot might be fast enough for the wizards coast forums
16:12 🔗 arkiver If turns out it is not I can make a little project for it
16:13 🔗 Start has joined #archiveteam
16:14 🔗 arkiver !a http://community.wizards.com/ --no-offsite-links
16:14 🔗 arkiver oops, sorry
16:15 🔗 Start has quit IRC (Client Quit)
16:17 🔗 vitzli has quit IRC (Quit: Leaving)
16:28 🔗 SketchCow https://archive.org/details/archiveteam_skillfeed_20150915150652 appears to be filling nicely. I am 99.9% sure the system will know what to do with it.
16:29 🔗 SketchCow I will upload that single item, let the site process it, and if it processes it right, will start an automatic upload.
16:29 🔗 SketchCow But with FOS a little behind, we might hit a problem with the disk filling. It's at 70% now
16:31 🔗 arkiver We have two more weeks to archive this site, so depending on how fast FOS can upload to IA we can wait a few days and resume.
16:33 🔗 primus104 has joined #archiveteam
17:01 🔗 nertzy has joined #archiveteam
17:08 🔗 balrog !a http://ed-thelen.org/comp-hist/
17:08 🔗 balrog oops
17:24 🔗 Aranje has quit IRC (Read error: Connection reset by peer)
17:25 🔗 Aranje has joined #archiveteam
17:39 🔗 aaaaaaaaa has joined #archiveteam
17:39 🔗 swebb sets mode: +o aaaaaaaaa
17:50 🔗 nertzy has quit IRC (Quit: This computer has gone to sleep)
17:53 🔗 nertzy has joined #archiveteam
17:55 🔗 SimpBrain has joined #archiveteam
18:09 🔗 aaaaaaaa_ has joined #archiveteam
18:09 🔗 aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
18:09 🔗 swebb sets mode: +o aaaaaaaa_
18:12 🔗 Aranje has quit IRC (Read error: Connection reset by peer)
18:12 🔗 Aranje has joined #archiveteam
18:15 🔗 aaaaaaaa_ is now known as aaaaaaaaa
18:20 🔗 jspiros has quit IRC (Ping timeout: 186 seconds)
18:24 🔗 Aranje has quit IRC (Read error: Connection reset by peer)
18:25 🔗 Aranje has joined #archiveteam
18:36 🔗 slyphic has joined #archiveteam
18:43 🔗 SketchCow OK, so, it's working.
19:07 🔗 aaaaaaaaa has quit IRC (Leaving)
19:09 🔗 Start has joined #archiveteam
19:12 🔗 SimpBrain has quit IRC (Quit: Leaving)
19:15 🔗 SketchCow https://archive.org/details/archiveteam_skillfeed_20150915150652
19:15 🔗 SketchCow BOOM
19:15 🔗 aaaaaaaaa has joined #archiveteam
19:15 🔗 swebb sets mode: +o aaaaaaaaa
19:22 🔗 SketchCow Chugging along. I'll let you know if we hit 90%
19:22 🔗 SketchCow We're hovering at 70
19:35 🔗 Start has quit IRC (Quit: Disconnected.)
19:40 🔗 odie5533 has joined #archiveteam
19:46 🔗 odie5533 Wizards of the Coast, producer of Magic: The Gathering and Dungeons & Dragons, is shutting down their community forums on October 29. The forums contain a few millions posts made over 10+ years. They said they will delete everything on Oct 29.
19:46 🔗 odie5533 MTG Forum: http://community.wizards.com/forums/61931 D&D Forum: http://community.wizards.com/forums/61981
19:47 🔗 aaaaaaaaa oh, I was wondering why that was in the archivebot.
19:47 🔗 odie5533 I'm glad to hear it is being archived :)
19:47 🔗 odie5533 Will the archivebot be able to take a complete snapshot?
19:49 🔗 aaaaaaaaa well, given the nature of crawling you can't really call it a "snapshot" but it will download everything it can find on that domain until it finishes, runs out of time or errors out.
19:50 🔗 odie5533 Can I watch the progress somewhere? And is it set to grab both the MTG and D&D forums?
19:52 🔗 aaaaaaaaa really, it depends on the size but it has handled sites with a few million pages.
19:53 🔗 aaaaaaaaa yes, at http://dashboard.at.ninjawedding.org/
19:53 🔗 aaaaaaaaa And yes, the entire domain.
19:53 🔗 aaaaaaaaa #archivebot is where the bot is actually controlled from
20:15 🔗 scyther has quit IRC (Leaving)
20:29 🔗 schbirid has quit IRC (Quit: Leaving)
20:44 🔗 PurpleSym has quit IRC (Remote host closed the connection)
20:59 🔗 habi has joined #archiveteam
21:00 🔗 habi has left
21:16 🔗 schbirid has joined #archiveteam
21:55 🔗 sCeege has joined #archiveteam
21:57 🔗 sCeege has quit IRC (Client Quit)
23:37 🔗 nertzy has quit IRC (Quit: This computer has gone to sleep)
23:39 🔗 khaoohs has joined #archiveteam
23:42 🔗 khaoohs__ has joined #archiveteam
23:45 🔗 khaoohs_ has quit IRC (Ping timeout: 483 seconds)
23:45 🔗 khaoohs has quit IRC (Read error: Operation timed out)

irclogger-viewer