[00:17] *** wp494 has quit IRC (Ping timeout: 268 seconds)
[00:17] *** wp494 has joined #archiveteam-bs
[00:27] *** ReimuHaku has quit IRC (Read error: Operation timed out)
[00:35] *** ReimuHaku has joined #archiveteam-bs
[00:36] *** Flashfire has joined #archiveteam-bs
[00:37] <Flashfire> JAA did we get all the runes of magic boards?
[00:38] *** kiska has joined #archiveteam-bs
[00:38] *** redlizard has quit IRC (Read error: Connection reset by peer)
[00:39] *** redlizard has joined #archiveteam-bs
[00:39] *** Flashfire has quit IRC (Client Quit)
[00:40] *** Flashfire has joined #archiveteam-bs
[00:43] *** Flashfire has quit IRC (Client Quit)
[00:44] *** Flashfire has joined #archiveteam-bs
[00:59] *** ta9le has quit IRC (Quit: Connection closed for inactivity)
[01:00] *** Mateon1 has quit IRC (Read error: Operation timed out)
[01:00] *** Mateon1 has joined #archiveteam-bs
[01:02] *** m007a83 has quit IRC (Quit: Leaving)
[01:04] *** m007a83 has joined #archiveteam-bs
[01:32] <SketchCow> HCross: Done
[01:32] <Flashfire> Purevolume has done an overhaul
[01:32] <Flashfire> most stuff appears to be hone
[03:09] *** phirephly has quit IRC (Read error: Operation timed out)
[03:09] *** phirephly has joined #archiveteam-bs
[03:10] *** wp494 has quit IRC (west.us.hub irc.Prison.NET)
[03:10] *** Soni has quit IRC (west.us.hub irc.Prison.NET)
[03:10] *** achip has quit IRC (west.us.hub irc.Prison.NET)
[03:13] *** SoniEx2 has joined #archiveteam-bs
[03:26] *** wp494 has joined #archiveteam-bs
[03:31] *** rcunning has joined #archiveteam-bs
[03:41] *** achip has joined #archiveteam-bs
[03:49] *** odemg has quit IRC (Ping timeout: 268 seconds)
[03:52] *** archodg has quit IRC (Read error: Operation timed out)
[03:59] *** archodg has joined #archiveteam-bs
[04:01] *** odemg has joined #archiveteam-bs
[04:52] *** kiska has quit IRC (Read error: Connection reset by peer)
[04:52] *** kiska has joined #archiveteam-bs
[04:55] *** kiska has quit IRC (Remote host closed the connection)
[05:15] *** kiska has joined #archiveteam-bs
[05:17] *** RichardG_ has joined #archiveteam-bs
[05:22] *** RichardG has quit IRC (Ping timeout: 506 seconds)
[06:10] *** Mateon1 has quit IRC (Ping timeout: 252 seconds)
[06:10] *** Mateon1 has joined #archiveteam-bs
[06:40] *** Mateon1 has quit IRC (Ping timeout: 252 seconds)
[06:41] *** Mateon1 has joined #archiveteam-bs
[07:20] *** kimmer has quit IRC (Read error: Operation timed out)
[08:10] *** Sporefan has joined #archiveteam-bs
[08:14] *** schbirid has joined #archiveteam-bs
[08:15] *** Sporefan has quit IRC (Ping timeout: 260 seconds)
[08:27] <Flashfire> Ok the Sporum is shutting down
[08:27] <Flashfire> it has sessionIDs but works without them as well
[08:27] *** Badnews has joined #archiveteam-bs
[08:27] <Flashfire> Goes read only on the 15th of august apparently
[08:27] <Flashfire> We have a while but it wont be good to dilly dally thats over 10 years of content
[08:28] <Flashfire> Ok the Sporum is shutting down
[08:28] <Flashfire> it has sessionIDs but works without them as well
[08:28] <Flashfire> JAA you had a way around session IDs didnt you?
[08:29] <Flashfire> Our users have posted a total of 4,087,959 messages 
[08:29] <Flashfire> Thats a lot lol
[08:30] *** Badnews_ has joined #archiveteam-bs
[08:30] <Badnews_> Ok, back.
[08:31] *** Badnews__ has joined #archiveteam-bs
[08:32] *** Badnews has quit IRC (Ping timeout: 260 seconds)
[08:33] <Badnews__> The reason why I wanted to find someone to archive the contents of the Sporum, is that many people quit the game, and may not know that the Sporum is shutting down.
[08:33] <Badnews__> Which would thus leave their content inaccessible because they wouldn’t be online to archive it.
[08:34] *** Badnews_ has quit IRC (Ping timeout: 260 seconds)
[08:38] *** Badnews has joined #archiveteam-bs
[08:38] *** Badnews__ has quit IRC (Ping timeout: 260 seconds)
[08:39] *** Badnews has quit IRC (Client Quit)
[08:40] *** Flashfir_ has joined #archiveteam-bs
[08:40] *** Flashfire has quit IRC (Read error: Operation timed out)
[08:43] *** Flashfir_ has quit IRC (Client Quit)
[08:43] *** Flashfire has joined #archiveteam-bs
[08:48] *** Stilett0 has quit IRC (Read error: Connection reset by peer)
[08:48] *** Stilett0 has joined #archiveteam-bs
[08:53] *** Badnews has joined #archiveteam-bs
[08:54] <Flashfire> So the warrior requires someone with techknow how to program the job
[08:54] <Flashfire> Id run it through archivebot but with session IDs it makes it harder for me as I never learned how to use ignore patterns
[08:54] <Badnews> So it’s length can vary?
[08:55] <Flashfire> A warrior program can take a while to put together and then it just depends on whether the site will block IP addresses and if lots of people run the project
[08:55] <Badnews> Ok, cool
[08:55] <Flashfire> But I am not the best person to be answering these questioins
[08:56] <Flashfire> if any of the OPs were around they would be qualified to talk to you about all this and more
[08:57] <Badnews> Ok, I’ll come back tommorrow, thanks 
[08:57] <Flashfire> STick around
[08:57] <Flashfire> they shouldnt be long
[08:58] <Badnews> Ok
[08:58] <HCross> Badnews: what is the site you are looking at downloading?
[08:59] *** Badnews_ has joined #archiveteam-bs
[08:59] <Flashfire> Is the sporum
[08:59] <Flashfire> http://forum.spore.com/jforum/
[08:59] <Badnews_> Yes
[08:59] <Flashfire> HCross
[08:59] <Flashfire> Many years of history
[08:59] <Badnews_> Many.
[09:00] <Badnews_> Even though the game was a flop, it had an active community around 2009 and 2010
[09:00] <HCross> hmm.. i might be able to singlehandedly do it
[09:01] <Badnews_> Our users have posted a total of 4,087,960 messages We have 99,984 registered users
[09:01] <Badnews_> it says that on the bottom
[09:01] <Flashfire> HCross I would have already put it through the archivebot but it has sessionIDs
[09:01] <Badnews_> sessionIDs?
[09:01] <HCross> it works for me if I take out the sessionid
[09:01] <Flashfire> Not sure whether we should leave it till August 15th when it becomes read only to maximise captures
[09:02] <HCross> 1 now, maybe another later
[09:02] <Flashfire> HCross Yeah but I never learned how to use Ignore patterns
[09:02] *** Badnews has quit IRC (Ping timeout: 260 seconds)
[09:03] *** Badnews_ has quit IRC (Client Quit)
[09:03] *** Badnews has joined #archiveteam-bs
[09:03] <Flashfire> Welcome back
[09:04] <Badnews> Thanks, accidentally disconnected.
[09:04] <Flashfire> All Good happens to all of us
[09:05] <Badnews> So apparently, the forums are moving to EA’s discussion pages.
[09:07] <HCross> so... you can actually throw a lot of concurrent it seems
[09:08] <Badnews> the Sporum itself is very outdated. I logged into my account after about 2 years, and you can still add your AIM info
[09:13] *** Badnews has quit IRC (Ping timeout: 260 seconds)
[09:14] <HCross> so, the user count goes up to 101010 - ive started a crawl to get just user pages
[09:14] *** Badnews has joined #archiveteam-bs
[09:17] <HCross> right, am getting 11 users/sec
[09:17] <HCross> 13
[09:17] *** Badnews_ has joined #archiveteam-bs
[09:19] <Badnews_> Anyway, goodnight!
[09:19] *** Badnews has quit IRC (Ping timeout: 260 seconds)
[09:23] *** Badnews_ has quit IRC (Ping timeout: 260 seconds)
[10:15] <kiska3> HCross shouldn't we run this as a warrior project instead, to maximise on users running it
[10:17] <Flashfire> ^
[10:21] <eientei95> [21:08:56] <Badnews> the Sporum itself is very outdated. I logged into my account after about 2 years, and you can still add your AIM info
[10:21] <eientei95> That's not outdated
[10:22] <eientei95> Just probably was a custom field they put in and haven't removed
[10:22] <eientei95> Possibly due to breaking other stuff in the db
[10:22] <eientei95> Yup, not even outdated
[10:22] <eientei95> >Powered by JForum 2.1.8 © ( EA Dev Build 2018-04-13 15:37:55 ) JForum Team
[10:24] <eientei95> Granted, 2.1.8 was released in ~2009
[10:31] <JAA> Flashfire: I did get the majority of the Runes Of Magic forums, I think. see the logs around 14:30 UTC yesterday for details.
[10:33] <JAA> As for the session IDs, I think wpull filters out jsessionid (when using the appropriate option, which is active in ArchiveBot).
[10:34] <JAA> There's a hardcoded list of session ID parameter names (e.g. sid, PHPSESSID, jsessionid), but it doesn't work for other names, e.g. s=12345... as was used on the Runes of Magic forums.
[10:35] <JAA> Sometimes, you can work around it by first requesting the homepage twice, then beginning the actual crawl. The reason is that the first response sets a cookie, which then leads the server to no longer include the session ID in the links afterwards.
[10:35] <JAA> But although possible, that doesn't work well in ArchiveBot.
[10:36] <JAA> It's what I did for Runes of Magic though.
[10:36] <JAA> The same seems to work for Sporum as well.
[10:37] <Flashfire> Well once my job finishes for an image directory I found that was bigger than I thought sporum shouldnt be far off
[10:39] <JAA> I love how the new Spore forums (https://answers.ea.com/t5/Spore/ct-p/spore-en) are almost entirely bug threads.
[10:40] <Flashfire> Lol
[10:43] *** Stilett0 has quit IRC (Read error: Connection reset by peer)
[10:43] *** Stilett0 has joined #archiveteam-bs
[10:46] <eientei95> On the subject of Spore, here's the making-of doco from the Galactic Edition https://archive.org/details/TheMakingOfSpore
[10:47] <JAA> I'll look into grabbing Sporum similar to how I grabbed Runes of Magic.
[10:47] <Flashfire> Yeah do that
[10:47] <Flashfire> One job now and one when it goes read only on august 15
[10:47] <JAA> Yep
[10:48] <JAA> Fortunately, there's enough time to grab it all this time. :-)
[10:49] <Flashfire> I have stuck the job in the archivebot as well So if you could make sure it doesnt grab session IDs while I read up on ignore patterns
[10:49] <eientei95> I <3 how IA generates the chapter info for DVD iso images
[10:52] *** BlueMax has quit IRC (Leaving)
[11:11] *** Flashfire has quit IRC (Quit: Bye)
[11:20] *** ta9le has joined #archiveteam-bs
[11:23] *** Mateon1 has quit IRC (Ping timeout: 252 seconds)
[11:24] *** Mateon1 has joined #archiveteam-bs
[11:46] *** BartoCH has quit IRC (Quit: WeeChat 2.1)
[11:51] *** BartoCH has joined #archiveteam-bs
[13:44] *** vitzli has joined #archiveteam-bs
[13:51] *** ta9le has quit IRC (Quit: Connection closed for inactivity)
[13:57] *** icedice has joined #archiveteam-bs
[14:08] *** balrog has quit IRC (Bye)
[14:11] *** balrog has joined #archiveteam-bs
[14:11] *** swebb sets mode: +o balrog
[14:22] *** balrog has quit IRC (Bye)
[14:25] *** icedice has quit IRC (Quit: Leaving)
[14:25] *** fie has joined #archiveteam-bs
[15:20] *** vitzli has quit IRC (Leaving)
[15:36] *** achip has quit IRC (west.us.hub irc.Prison.NET)
[15:46] *** ta9le has joined #archiveteam-bs
[16:07] *** achip has joined #archiveteam-bs
[18:15] <archodg> HCross, arkiver nobody told me.. zetaboards done?
[18:36] *** balrog has joined #archiveteam-bs
[18:36] *** swebb sets mode: +o balrog
[19:10] <ta9le> archodg, as far as I'm aware, it's pretty much done
[19:33] *** Sk2d has joined #archiveteam-bs
[19:34] *** Sk1d has quit IRC (Read error: Operation timed out)
[19:34] *** Sk2d is now known as Sk1d
[19:42] *** Silas has joined #archiveteam-bs
[19:53] <Silas> SketchTheCow: I've got a question about that FTP I've been downloading. It's a few hundred GB, and my connection is not good enough to upload that to IA as one file, and I have a hunch uploading the files and folders as-is wouldn't work very nicely. But if I upload it as a split zip, it won't open like a normal zip in the IA interface (as far as I can tell at least). Would you (or anyone else) be able to process it t
[20:09] <JAA> Silas: Your message got cut off at "be able to process it t". (The web client sucks.)
[20:10] <Silas> Ok, the rest of it was "to be more accessible if I upload it as a split zip"
[20:18] *** Silas_ has joined #archiveteam-bs
[20:21] *** Silas has quit IRC (Ping timeout: 260 seconds)
[20:24] *** Stilett0 has quit IRC (Read error: Connection reset by peer)
[20:24] *** Stilett0 has joined #archiveteam-bs
[20:28] *** C4K3 has quit IRC (leaving)
[20:32] *** Silas_ has quit IRC (Ping timeout: 260 seconds)
[20:32] *** Silas has joined #archiveteam-bs
[20:34] *** jschwart has quit IRC (Read error: Operation timed out)
[20:35] *** C4K3 has joined #archiveteam-bs
[20:41] *** jschwart has joined #archiveteam-bs
[21:35] *** schbirid has quit IRC (Quit: Leaving)
[21:59] *** Stilett0 has quit IRC (Read error: Connection reset by peer)
[21:59] *** Stilett0 has joined #archiveteam-bs
[22:42] *** jschwart has quit IRC (Quit: Konversation terminated!)
[22:59] *** Mateon1 has quit IRC (Read error: Operation timed out)
[23:00] *** Mateon1 has joined #archiveteam-bs
[23:12] <godane> latest vhs rips: https://www.patreon.com/posts/digitize-tapes-20073267
[23:32] *** Silas has quit IRC (Ping timeout: 260 seconds)
[23:46] *** Flashfire has joined #archiveteam-bs
[23:52] *** Flashfire has quit IRC (Bye)
[23:54] *** Flashfire has joined #archiveteam-bs
[23:58] *** Flashfire has quit IRC (Client Quit)
[23:59] *** Flashfire has joined #archiveteam-bs