[00:19] *** nico_32_ is now known as nico_32 [00:20] *** MMovie2 has joined #archiveteam [00:21] *** MMovie has quit IRC (Read error: Operation timed out) [00:33] *** balrog has quit IRC (Quit: Bye) [00:34] *** balrog has joined #archiveteam [00:34] *** swebb sets mode: +o balrog [00:37] *** balrog sets mode: +o Lord_Nigh [00:45] *** MMovie has joined #archiveteam [00:48] *** MMovie2 has quit IRC (Ping timeout: 306 seconds) [00:57] *** primus104 has quit IRC (Read error: Connection reset by peer) [01:17] *** garyrh_ has joined #archiveteam [01:54] http://52.21.173.249:9020/mosaic/1996/http://yahoo.com/ [01:58] why does this remind me of IRIX [02:08] *** mafrasi2 has quit IRC (Remote host closed the connection) [02:09] *** mafrasi2 has joined #archiveteam [02:15] *** Fletcher has joined #archiveteam [02:15] *** zhongfu has joined #archiveteam [02:15] *** afics has joined #archiveteam [02:15] *** diacope has joined #archiveteam [02:15] *** HCross has joined #archiveteam [02:15] *** kevin has joined #archiveteam [02:15] *** dan- has joined #archiveteam [02:15] *** Ungstein has joined #archiveteam [02:15] *** pikhq has joined #archiveteam [02:15] *** rizzzz has joined #archiveteam [02:15] *** aliz has joined #archiveteam [02:15] *** Wyatts has joined #archiveteam [02:15] *** _0x2A has joined #archiveteam [02:15] *** lhobas has joined #archiveteam [02:15] *** GLaDOS has joined #archiveteam [02:15] *** Boltsie has joined #archiveteam [02:15] *** JSharp has joined #archiveteam [02:15] *** karissa has joined #archiveteam [02:15] *** _desu_ has joined #archiveteam [02:15] *** Ctrl-S has joined #archiveteam [02:15] *** russss__ has joined #archiveteam [02:15] *** zyphlar has joined #archiveteam [02:15] *** codl has joined #archiveteam [02:15] *** deathy has joined #archiveteam [02:15] *** sigkell has joined #archiveteam [02:15] *** irl1 has joined #archiveteam [02:15] *** Rickster has joined #archiveteam [02:15] *** Muad-Dib has joined #archiveteam [02:15] *** efnet.port80.se sets mode: +o GLaDOS [02:15] *** GLaDOS sets mode: +o SketchCow [02:43] *** garyrh_ has quit IRC (Read error: Operation timed out) [03:18] *** Famicoman has joined #archiveteam [03:23] *** dan- has quit IRC (Ping timeout: 252 seconds) [03:35] *** dan- has joined #archiveteam [03:40] *** xk_id has quit IRC (Remote host closed the connection) [04:07] *** zyphlar has quit IRC (Ping timeout: 252 seconds) [04:08] *** zyphlar has joined #archiveteam [04:13] *** JesseW has joined #archiveteam [04:23] *** garyrh_ has joined #archiveteam [04:29] *** aaaaaaaaa has quit IRC (Leaving) [04:33] *** Emcy has quit IRC (Ping timeout: 306 seconds) [04:38] *** Ungstein has quit IRC (Quit: Leaving.) [04:43] *** trs80 has quit IRC (Ping timeout: 186 seconds) [04:44] *** Emcy has joined #archiveteam [04:46] *** scyther has joined #archiveteam [05:02] *** wednesday has quit IRC (Quit: Be the change that you wish to see in the world.) [05:03] *** wednesday has joined #archiveteam [05:07] *** trs80 has joined #archiveteam [05:09] *** habi has joined #archiveteam [05:10] *** habi has quit IRC (Client Quit) [05:33] *** scyther has quit IRC (Leaving) [06:09] *** wyatt874- has joined #archiveteam [06:09] *** wyatt8740 has quit IRC (Read error: Connection reset by peer) [07:05] *** wednesday has quit IRC (ny.us.hub west.us.hub) [07:05] *** dan- has quit IRC (ny.us.hub west.us.hub) [07:05] *** mafrasi2 has quit IRC (ny.us.hub west.us.hub) [07:05] *** Sue_ has quit IRC (ny.us.hub west.us.hub) [07:05] *** khaoohs_ has quit IRC (ny.us.hub west.us.hub) [07:05] *** beardicus has quit IRC (ny.us.hub west.us.hub) [07:05] *** DFJustin has quit IRC (ny.us.hub west.us.hub) [07:05] *** Froggypwn has quit IRC (ny.us.hub west.us.hub) [07:05] *** wacky has quit IRC (ny.us.hub west.us.hub) [07:05] *** ohhdemgir has quit IRC (ny.us.hub west.us.hub) [07:05] *** Sanqui has quit IRC (ny.us.hub west.us.hub) [07:05] *** bentpins has quit IRC (ny.us.hub west.us.hub) [07:05] *** Atom__ has quit IRC (ny.us.hub west.us.hub) [07:05] *** chfoo- has quit IRC (ny.us.hub west.us.hub) [07:05] *** matthusby has quit IRC (ny.us.hub west.us.hub) [07:05] *** SadDM has quit IRC (ny.us.hub west.us.hub) [07:05] *** DFJustinZ has quit IRC (ny.us.hub west.us.hub) [07:05] *** zer0c00l has quit IRC (ny.us.hub west.us.hub) [07:05] *** PotcFdk has quit IRC (ny.us.hub west.us.hub) [07:05] *** kniffy has quit IRC (ny.us.hub west.us.hub) [07:05] *** xmc has quit IRC (ny.us.hub west.us.hub) [07:14] *** PurpleSym has joined #archiveteam [07:46] *** JesseW has quit IRC (Read error: Operation timed out) [07:48] *** cadbury_ has quit IRC (Read error: Operation timed out) [07:49] *** xmc has joined #archiveteam [07:49] *** kniffy has joined #archiveteam [07:49] *** PotcFdk has joined #archiveteam [07:49] *** zer0c00l has joined #archiveteam [07:49] *** DFJustinZ has joined #archiveteam [07:49] *** SadDM has joined #archiveteam [07:49] *** matthusby has joined #archiveteam [07:49] *** chfoo- has joined #archiveteam [07:49] *** Atom__ has joined #archiveteam [07:49] *** bentpins has joined #archiveteam [07:49] *** Sanqui has joined #archiveteam [07:49] *** ohhdemgir has joined #archiveteam [07:49] *** wacky has joined #archiveteam [07:49] *** Froggypwn has joined #archiveteam [07:49] *** DFJustin has joined #archiveteam [07:49] *** beardicus has joined #archiveteam [07:49] *** khaoohs_ has joined #archiveteam [07:49] *** Sue_ has joined #archiveteam [07:49] *** mafrasi2 has joined #archiveteam [07:49] *** dan- has joined #archiveteam [07:49] *** wednesday has joined #archiveteam [07:49] *** west.us.hub sets mode: +ooo xmc SadDM DFJustin [07:49] *** swebb sets mode: +o xmc [07:49] *** swebb sets mode: +o SadDM [07:49] *** swebb sets mode: +o DFJustin [07:59] *** schbirid has joined #archiveteam [08:14] *** primus104 has joined #archiveteam [08:18] *** atomotic has joined #archiveteam [08:30] *** garyrh has joined #archiveteam [08:40] *** MMovie2 has joined #archiveteam [08:43] *** MMovie has quit IRC (Ping timeout: 306 seconds) [08:46] *** Ungstein has joined #archiveteam [09:30] *** MMovie2 has quit IRC (Ping timeout: 306 seconds) [09:34] *** MMovie has joined #archiveteam [09:40] *** MMovie has quit IRC (Ping timeout: 306 seconds) [09:43] *** MMovie has joined #archiveteam [09:47] *** garyrh_ has quit IRC (Quit: Leaving) [09:47] *** dashcloud has quit IRC (Read error: Operation timed out) [09:49] *** dashcloud has joined #archiveteam [10:02] *** RedType has quit IRC (Ping timeout: 240 seconds) [10:03] *** RedType has joined #archiveteam [10:06] *** MMovie has quit IRC (Ping timeout: 306 seconds) [10:13] *** koo5 has quit IRC (Read error: Operation timed out) [10:16] *** MMovie has joined #archiveteam [10:38] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [10:44] *** dan- has quit IRC (Ping timeout: 483 seconds) [10:46] *** dan- has joined #archiveteam [11:00] *** anomie has quit IRC (Read error: Connection reset by peer) [11:04] *** anomie has joined #archiveteam [11:34] *** DFJustin has quit IRC (Read error: Connection reset by peer) [11:34] *** DFJustin has joined #archiveteam [11:34] *** swebb sets mode: +o DFJustin [11:49] *** atomotic has joined #archiveteam [12:00] *** vitzli has joined #archiveteam [12:06] *** vitzli has quit IRC (Client Quit) [12:13] *** nertzy has joined #archiveteam [12:29] *** mafrasi2 has quit IRC (Remote host closed the connection) [12:29] *** anomie has quit IRC (Read error: Connection reset by peer) [12:31] *** mafrasi2 has joined #archiveteam [12:32] *** anomie has joined #archiveteam [13:00] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [13:05] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [13:15] *** vitzli has joined #archiveteam [13:17] *** primus104 has quit IRC (Leaving.) [13:31] *** PurpleSym has quit IRC (Remote host closed the connection) [13:40] *** scyther has joined #archiveteam [13:40] *** signius has quit IRC (Ping timeout: 306 seconds) [13:44] *** sep332 has quit IRC (bye) [13:50] *** xk_id has joined #archiveteam [13:51] *** mafrasi2 has quit IRC (Remote host closed the connection) [13:52] *** mafrasi2 has joined #archiveteam [13:52] *** signius has joined #archiveteam [13:56] *** Start has quit IRC (Quit: Disconnected.) [14:08] *** mafrasi2 has quit IRC (Remote host closed the connection) [14:10] *** mafrasi2 has joined #archiveteam [14:18] *** mafrasi2 has quit IRC (Remote host closed the connection) [14:20] *** mafrasi2 has joined #archiveteam [14:37] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:42] *** Start has joined #archiveteam [14:46] *** cadbury_ has joined #archiveteam [14:57] OMNI Magazine on the Archive took it in the face today. [14:57] Bummerrrrrrrrrrr [14:58] What do you mean? DMCA'd? [15:00] A little more than DMCA'd but the place that owns it finally decided they want it down. [15:00] Yeah, just checked your twitter [15:09] http://magic.wizards.com/en/articles/archive/news/wizards-coast-community-forums-be-shut-down-2015-09-16 [15:09] Awwwwwww SHIT son [15:09] (The headline entry is off - it's actually shut down in October) [15:10] *** Coderjoe has quit IRC (Ping timeout: 186 seconds) [15:11] Argh, can't all these site owners give us a break? [15:16] *** Coderjoe has joined #archiveteam [15:22] *** PurpleSym has joined #archiveteam [15:32] *** JesseW has joined #archiveteam [15:34] *** Aranje has joined #archiveteam [15:56] Well, FOS is definitely hammered [15:57] There are still up to 5000 items for Skillfeed that haven't been queued yet (it looks like only items 0 through 9999 were queued but there are valid items up through 14500) [15:57] Are you planning to let FOS catch up before queueing them [15:58] Probably the best bet. I am still going to be uploading for a while [15:59] I'm going to try something. [15:59] So, normally we megawarc. [15:59] Because we are HEROES [15:59] This makes no sense here. This stuff is mega compressed. [15:59] And it's only a few dozen, or a couple hundred files. [16:01] *** JesseW has quit IRC (Read error: Operation timed out) [16:03] Doing it. First one will be shortly. [16:03] This MAY save us. [16:05] (Trying it now.) [16:07] *** Start has quit IRC (Quit: Disconnected.) [16:09] https://archive.org/details/archiveteam_skillfeed_20150915150652 [16:09] It LOOKS like they're populating nicely. [16:09] (And removing themselves off the FOS server as they go.) [16:09] SketchCow: not packing them anymore? [16:10] Not into megawarcs. [16:10] They don't need to be megawarcs. At this size, they're well below the "make IA blow up" threshold. [16:10] I see between 20-200 files per 40gb item. [16:10] There might be one or two 40 GB items, those would be handled ok? [16:10] Don't change anything on your end - this just makes FOS work less. [16:10] Yes, it means that item will have one file [16:11] The system doesn't truncate at 40gb - it goes "is this larger than 40gb? make a new item" [16:11] So it can be 1tb after a single file copy. It just takes it. [16:11] Ok, got it [16:11] So ArchiveBot might be fast enough for the wizards coast forums [16:12] If turns out it is not I can make a little project for it [16:13] *** Start has joined #archiveteam [16:14] !a http://community.wizards.com/ --no-offsite-links [16:14] oops, sorry [16:15] *** Start has quit IRC (Client Quit) [16:17] *** vitzli has quit IRC (Quit: Leaving) [16:28] https://archive.org/details/archiveteam_skillfeed_20150915150652 appears to be filling nicely. I am 99.9% sure the system will know what to do with it. [16:29] I will upload that single item, let the site process it, and if it processes it right, will start an automatic upload. [16:29] But with FOS a little behind, we might hit a problem with the disk filling. It's at 70% now [16:31] We have two more weeks to archive this site, so depending on how fast FOS can upload to IA we can wait a few days and resume. [16:33] *** primus104 has joined #archiveteam [17:01] *** nertzy has joined #archiveteam [17:08] !a http://ed-thelen.org/comp-hist/ [17:08] oops [17:24] *** Aranje has quit IRC (Read error: Connection reset by peer) [17:25] *** Aranje has joined #archiveteam [17:39] *** aaaaaaaaa has joined #archiveteam [17:39] *** swebb sets mode: +o aaaaaaaaa [17:50] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [17:53] *** nertzy has joined #archiveteam [17:55] *** SimpBrain has joined #archiveteam [18:09] *** aaaaaaaa_ has joined #archiveteam [18:09] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer) [18:09] *** swebb sets mode: +o aaaaaaaa_ [18:12] *** Aranje has quit IRC (Read error: Connection reset by peer) [18:12] *** Aranje has joined #archiveteam [18:15] *** aaaaaaaa_ is now known as aaaaaaaaa [18:20] *** jspiros has quit IRC (Ping timeout: 186 seconds) [18:24] *** Aranje has quit IRC (Read error: Connection reset by peer) [18:25] *** Aranje has joined #archiveteam [18:36] *** slyphic has joined #archiveteam [18:43] OK, so, it's working. [19:07] *** aaaaaaaaa has quit IRC (Leaving) [19:09] *** Start has joined #archiveteam [19:12] *** SimpBrain has quit IRC (Quit: Leaving) [19:15] https://archive.org/details/archiveteam_skillfeed_20150915150652 [19:15] BOOM [19:15] *** aaaaaaaaa has joined #archiveteam [19:15] *** swebb sets mode: +o aaaaaaaaa [19:22] Chugging along. I'll let you know if we hit 90% [19:22] We're hovering at 70 [19:35] *** Start has quit IRC (Quit: Disconnected.) [19:40] *** odie5533 has joined #archiveteam [19:46] Wizards of the Coast, producer of Magic: The Gathering and Dungeons & Dragons, is shutting down their community forums on October 29. The forums contain a few millions posts made over 10+ years. They said they will delete everything on Oct 29. [19:46] MTG Forum: http://community.wizards.com/forums/61931 D&D Forum: http://community.wizards.com/forums/61981 [19:47] oh, I was wondering why that was in the archivebot. [19:47] I'm glad to hear it is being archived :) [19:47] Will the archivebot be able to take a complete snapshot? [19:49] well, given the nature of crawling you can't really call it a "snapshot" but it will download everything it can find on that domain until it finishes, runs out of time or errors out. [19:50] Can I watch the progress somewhere? And is it set to grab both the MTG and D&D forums? [19:52] really, it depends on the size but it has handled sites with a few million pages. [19:53] yes, at http://dashboard.at.ninjawedding.org/ [19:53] And yes, the entire domain. [19:53] #archivebot is where the bot is actually controlled from [20:15] *** scyther has quit IRC (Leaving) [20:29] *** schbirid has quit IRC (Quit: Leaving) [20:44] *** PurpleSym has quit IRC (Remote host closed the connection) [20:59] *** habi has joined #archiveteam [21:00] *** habi has left [21:16] *** schbirid has joined #archiveteam [21:55] *** sCeege has joined #archiveteam [21:57] *** sCeege has quit IRC (Client Quit) [23:37] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [23:39] *** khaoohs has joined #archiveteam [23:42] *** khaoohs__ has joined #archiveteam [23:45] *** khaoohs_ has quit IRC (Ping timeout: 483 seconds) [23:45] *** khaoohs has quit IRC (Read error: Operation timed out)