| Time |
Nickname |
Message |
|
00:17
🔗
|
|
wp494 has quit IRC (Ping timeout: 268 seconds) |
|
00:17
🔗
|
|
wp494 has joined #archiveteam-bs |
|
00:27
🔗
|
|
ReimuHaku has quit IRC (Read error: Operation timed out) |
|
00:35
🔗
|
|
ReimuHaku has joined #archiveteam-bs |
|
00:36
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
00:37
🔗
|
Flashfire |
JAA did we get all the runes of magic boards? |
|
00:38
🔗
|
|
kiska has joined #archiveteam-bs |
|
00:38
🔗
|
|
redlizard has quit IRC (Read error: Connection reset by peer) |
|
00:39
🔗
|
|
redlizard has joined #archiveteam-bs |
|
00:39
🔗
|
|
Flashfire has quit IRC (Client Quit) |
|
00:40
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
00:43
🔗
|
|
Flashfire has quit IRC (Client Quit) |
|
00:44
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
00:59
🔗
|
|
ta9le has quit IRC (Quit: Connection closed for inactivity) |
|
01:00
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
01:00
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
01:02
🔗
|
|
m007a83 has quit IRC (Quit: Leaving) |
|
01:04
🔗
|
|
m007a83 has joined #archiveteam-bs |
|
01:32
🔗
|
SketchCow |
HCross: Done |
|
01:32
🔗
|
Flashfire |
Purevolume has done an overhaul |
|
01:32
🔗
|
Flashfire |
most stuff appears to be hone |
|
03:09
🔗
|
|
phirephly has quit IRC (Read error: Operation timed out) |
|
03:09
🔗
|
|
phirephly has joined #archiveteam-bs |
|
03:10
🔗
|
|
wp494 has quit IRC (west.us.hub irc.Prison.NET) |
|
03:10
🔗
|
|
Soni has quit IRC (west.us.hub irc.Prison.NET) |
|
03:10
🔗
|
|
achip has quit IRC (west.us.hub irc.Prison.NET) |
|
03:13
🔗
|
|
SoniEx2 has joined #archiveteam-bs |
|
03:26
🔗
|
|
wp494 has joined #archiveteam-bs |
|
03:31
🔗
|
|
rcunning has joined #archiveteam-bs |
|
03:41
🔗
|
|
achip has joined #archiveteam-bs |
|
03:49
🔗
|
|
odemg has quit IRC (Ping timeout: 268 seconds) |
|
03:52
🔗
|
|
archodg has quit IRC (Read error: Operation timed out) |
|
03:59
🔗
|
|
archodg has joined #archiveteam-bs |
|
04:01
🔗
|
|
odemg has joined #archiveteam-bs |
|
04:52
🔗
|
|
kiska has quit IRC (Read error: Connection reset by peer) |
|
04:52
🔗
|
|
kiska has joined #archiveteam-bs |
|
04:55
🔗
|
|
kiska has quit IRC (Remote host closed the connection) |
|
05:15
🔗
|
|
kiska has joined #archiveteam-bs |
|
05:17
🔗
|
|
RichardG_ has joined #archiveteam-bs |
|
05:22
🔗
|
|
RichardG has quit IRC (Ping timeout: 506 seconds) |
|
06:10
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 252 seconds) |
|
06:10
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
06:40
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 252 seconds) |
|
06:41
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
07:20
🔗
|
|
kimmer has quit IRC (Read error: Operation timed out) |
|
08:10
🔗
|
|
Sporefan has joined #archiveteam-bs |
|
08:14
🔗
|
|
schbirid has joined #archiveteam-bs |
|
08:15
🔗
|
|
Sporefan has quit IRC (Ping timeout: 260 seconds) |
|
08:27
🔗
|
Flashfire |
Ok the Sporum is shutting down |
|
08:27
🔗
|
Flashfire |
it has sessionIDs but works without them as well |
|
08:27
🔗
|
|
Badnews has joined #archiveteam-bs |
|
08:27
🔗
|
Flashfire |
Goes read only on the 15th of august apparently |
|
08:27
🔗
|
Flashfire |
We have a while but it wont be good to dilly dally thats over 10 years of content |
|
08:28
🔗
|
Flashfire |
Ok the Sporum is shutting down |
|
08:28
🔗
|
Flashfire |
it has sessionIDs but works without them as well |
|
08:28
🔗
|
Flashfire |
JAA you had a way around session IDs didnt you? |
|
08:29
🔗
|
Flashfire |
Our users have posted a total of 4,087,959 messages |
|
08:29
🔗
|
Flashfire |
Thats a lot lol |
|
08:30
🔗
|
|
Badnews_ has joined #archiveteam-bs |
|
08:30
🔗
|
Badnews_ |
Ok, back. |
|
08:31
🔗
|
|
Badnews__ has joined #archiveteam-bs |
|
08:32
🔗
|
|
Badnews has quit IRC (Ping timeout: 260 seconds) |
|
08:33
🔗
|
Badnews__ |
The reason why I wanted to find someone to archive the contents of the Sporum, is that many people quit the game, and may not know that the Sporum is shutting down. |
|
08:33
🔗
|
Badnews__ |
Which would thus leave their content inaccessible because they wouldn’t be online to archive it. |
|
08:34
🔗
|
|
Badnews_ has quit IRC (Ping timeout: 260 seconds) |
|
08:38
🔗
|
|
Badnews has joined #archiveteam-bs |
|
08:38
🔗
|
|
Badnews__ has quit IRC (Ping timeout: 260 seconds) |
|
08:39
🔗
|
|
Badnews has quit IRC (Client Quit) |
|
08:40
🔗
|
|
Flashfir_ has joined #archiveteam-bs |
|
08:40
🔗
|
|
Flashfire has quit IRC (Read error: Operation timed out) |
|
08:43
🔗
|
|
Flashfir_ has quit IRC (Client Quit) |
|
08:43
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
08:48
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
08:48
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
08:53
🔗
|
|
Badnews has joined #archiveteam-bs |
|
08:54
🔗
|
Flashfire |
So the warrior requires someone with techknow how to program the job |
|
08:54
🔗
|
Flashfire |
Id run it through archivebot but with session IDs it makes it harder for me as I never learned how to use ignore patterns |
|
08:54
🔗
|
Badnews |
So it’s length can vary? |
|
08:55
🔗
|
Flashfire |
A warrior program can take a while to put together and then it just depends on whether the site will block IP addresses and if lots of people run the project |
|
08:55
🔗
|
Badnews |
Ok, cool |
|
08:55
🔗
|
Flashfire |
But I am not the best person to be answering these questioins |
|
08:56
🔗
|
Flashfire |
if any of the OPs were around they would be qualified to talk to you about all this and more |
|
08:57
🔗
|
Badnews |
Ok, I’ll come back tommorrow, thanks |
|
08:57
🔗
|
Flashfire |
STick around |
|
08:57
🔗
|
Flashfire |
they shouldnt be long |
|
08:58
🔗
|
Badnews |
Ok |
|
08:58
🔗
|
HCross |
Badnews: what is the site you are looking at downloading? |
|
08:59
🔗
|
|
Badnews_ has joined #archiveteam-bs |
|
08:59
🔗
|
Flashfire |
Is the sporum |
|
08:59
🔗
|
Flashfire |
http://forum.spore.com/jforum/ |
|
08:59
🔗
|
Badnews_ |
Yes |
|
08:59
🔗
|
Flashfire |
HCross |
|
08:59
🔗
|
Flashfire |
Many years of history |
|
08:59
🔗
|
Badnews_ |
Many. |
|
09:00
🔗
|
Badnews_ |
Even though the game was a flop, it had an active community around 2009 and 2010 |
|
09:00
🔗
|
HCross |
hmm.. i might be able to singlehandedly do it |
|
09:01
🔗
|
Badnews_ |
Our users have posted a total of 4,087,960 messages We have 99,984 registered users |
|
09:01
🔗
|
Badnews_ |
it says that on the bottom |
|
09:01
🔗
|
Flashfire |
HCross I would have already put it through the archivebot but it has sessionIDs |
|
09:01
🔗
|
Badnews_ |
sessionIDs? |
|
09:01
🔗
|
HCross |
it works for me if I take out the sessionid |
|
09:01
🔗
|
Flashfire |
Not sure whether we should leave it till August 15th when it becomes read only to maximise captures |
|
09:02
🔗
|
HCross |
1 now, maybe another later |
|
09:02
🔗
|
Flashfire |
HCross Yeah but I never learned how to use Ignore patterns |
|
09:02
🔗
|
|
Badnews has quit IRC (Ping timeout: 260 seconds) |
|
09:03
🔗
|
|
Badnews_ has quit IRC (Client Quit) |
|
09:03
🔗
|
|
Badnews has joined #archiveteam-bs |
|
09:03
🔗
|
Flashfire |
Welcome back |
|
09:04
🔗
|
Badnews |
Thanks, accidentally disconnected. |
|
09:04
🔗
|
Flashfire |
All Good happens to all of us |
|
09:05
🔗
|
Badnews |
So apparently, the forums are moving to EA’s discussion pages. |
|
09:07
🔗
|
HCross |
so... you can actually throw a lot of concurrent it seems |
|
09:08
🔗
|
Badnews |
the Sporum itself is very outdated. I logged into my account after about 2 years, and you can still add your AIM info |
|
09:13
🔗
|
|
Badnews has quit IRC (Ping timeout: 260 seconds) |
|
09:14
🔗
|
HCross |
so, the user count goes up to 101010 - ive started a crawl to get just user pages |
|
09:14
🔗
|
|
Badnews has joined #archiveteam-bs |
|
09:17
🔗
|
HCross |
right, am getting 11 users/sec |
|
09:17
🔗
|
HCross |
13 |
|
09:17
🔗
|
|
Badnews_ has joined #archiveteam-bs |
|
09:19
🔗
|
Badnews_ |
Anyway, goodnight! |
|
09:19
🔗
|
|
Badnews has quit IRC (Ping timeout: 260 seconds) |
|
09:23
🔗
|
|
Badnews_ has quit IRC (Ping timeout: 260 seconds) |
|
10:15
🔗
|
kiska3 |
HCross shouldn't we run this as a warrior project instead, to maximise on users running it |
|
10:17
🔗
|
Flashfire |
^ |
|
10:21
🔗
|
eientei95 |
[21:08:56] <Badnews> the Sporum itself is very outdated. I logged into my account after about 2 years, and you can still add your AIM info |
|
10:21
🔗
|
eientei95 |
That's not outdated |
|
10:22
🔗
|
eientei95 |
Just probably was a custom field they put in and haven't removed |
|
10:22
🔗
|
eientei95 |
Possibly due to breaking other stuff in the db |
|
10:22
🔗
|
eientei95 |
Yup, not even outdated |
|
10:22
🔗
|
eientei95 |
>Powered by JForum 2.1.8 © ( EA Dev Build 2018-04-13 15:37:55 ) JForum Team |
|
10:24
🔗
|
eientei95 |
Granted, 2.1.8 was released in ~2009 |
|
10:31
🔗
|
JAA |
Flashfire: I did get the majority of the Runes Of Magic forums, I think. see the logs around 14:30 UTC yesterday for details. |
|
10:33
🔗
|
JAA |
As for the session IDs, I think wpull filters out jsessionid (when using the appropriate option, which is active in ArchiveBot). |
|
10:34
🔗
|
JAA |
There's a hardcoded list of session ID parameter names (e.g. sid, PHPSESSID, jsessionid), but it doesn't work for other names, e.g. s=12345... as was used on the Runes of Magic forums. |
|
10:35
🔗
|
JAA |
Sometimes, you can work around it by first requesting the homepage twice, then beginning the actual crawl. The reason is that the first response sets a cookie, which then leads the server to no longer include the session ID in the links afterwards. |
|
10:35
🔗
|
JAA |
But although possible, that doesn't work well in ArchiveBot. |
|
10:36
🔗
|
JAA |
It's what I did for Runes of Magic though. |
|
10:36
🔗
|
JAA |
The same seems to work for Sporum as well. |
|
10:37
🔗
|
Flashfire |
Well once my job finishes for an image directory I found that was bigger than I thought sporum shouldnt be far off |
|
10:39
🔗
|
JAA |
I love how the new Spore forums (https://answers.ea.com/t5/Spore/ct-p/spore-en) are almost entirely bug threads. |
|
10:40
🔗
|
Flashfire |
Lol |
|
10:43
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
10:43
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
10:46
🔗
|
eientei95 |
On the subject of Spore, here's the making-of doco from the Galactic Edition https://archive.org/details/TheMakingOfSpore |
|
10:47
🔗
|
JAA |
I'll look into grabbing Sporum similar to how I grabbed Runes of Magic. |
|
10:47
🔗
|
Flashfire |
Yeah do that |
|
10:47
🔗
|
Flashfire |
One job now and one when it goes read only on august 15 |
|
10:47
🔗
|
JAA |
Yep |
|
10:48
🔗
|
JAA |
Fortunately, there's enough time to grab it all this time. :-) |
|
10:49
🔗
|
Flashfire |
I have stuck the job in the archivebot as well So if you could make sure it doesnt grab session IDs while I read up on ignore patterns |
|
10:49
🔗
|
eientei95 |
I <3 how IA generates the chapter info for DVD iso images |
|
10:52
🔗
|
|
BlueMax has quit IRC (Leaving) |
|
11:11
🔗
|
|
Flashfire has quit IRC (Quit: Bye) |
|
11:20
🔗
|
|
ta9le has joined #archiveteam-bs |
|
11:23
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 252 seconds) |
|
11:24
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
11:46
🔗
|
|
BartoCH has quit IRC (Quit: WeeChat 2.1) |
|
11:51
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
13:44
🔗
|
|
vitzli has joined #archiveteam-bs |
|
13:51
🔗
|
|
ta9le has quit IRC (Quit: Connection closed for inactivity) |
|
13:57
🔗
|
|
icedice has joined #archiveteam-bs |
|
14:08
🔗
|
|
balrog has quit IRC (Bye) |
|
14:11
🔗
|
|
balrog has joined #archiveteam-bs |
|
14:11
🔗
|
|
swebb sets mode: +o balrog |
|
14:22
🔗
|
|
balrog has quit IRC (Bye) |
|
14:25
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
14:25
🔗
|
|
fie has joined #archiveteam-bs |
|
15:20
🔗
|
|
vitzli has quit IRC (Leaving) |
|
15:36
🔗
|
|
achip has quit IRC (west.us.hub irc.Prison.NET) |
|
15:46
🔗
|
|
ta9le has joined #archiveteam-bs |
|
16:07
🔗
|
|
achip has joined #archiveteam-bs |
|
18:15
🔗
|
archodg |
HCross, arkiver nobody told me.. zetaboards done? |
|
18:36
🔗
|
|
balrog has joined #archiveteam-bs |
|
18:36
🔗
|
|
swebb sets mode: +o balrog |
|
19:10
🔗
|
ta9le |
archodg, as far as I'm aware, it's pretty much done |
|
19:33
🔗
|
|
Sk2d has joined #archiveteam-bs |
|
19:34
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
19:34
🔗
|
|
Sk2d is now known as Sk1d |
|
19:42
🔗
|
|
Silas has joined #archiveteam-bs |
|
19:53
🔗
|
Silas |
SketchTheCow: I've got a question about that FTP I've been downloading. It's a few hundred GB, and my connection is not good enough to upload that to IA as one file, and I have a hunch uploading the files and folders as-is wouldn't work very nicely. But if I upload it as a split zip, it won't open like a normal zip in the IA interface (as far as I can tell at least). Would you (or anyone else) be able to process it t |
|
20:09
🔗
|
JAA |
Silas: Your message got cut off at "be able to process it t". (The web client sucks.) |
|
20:10
🔗
|
Silas |
Ok, the rest of it was "to be more accessible if I upload it as a split zip" |
|
20:18
🔗
|
|
Silas_ has joined #archiveteam-bs |
|
20:21
🔗
|
|
Silas has quit IRC (Ping timeout: 260 seconds) |
|
20:24
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
20:24
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
20:28
🔗
|
|
C4K3 has quit IRC (leaving) |
|
20:32
🔗
|
|
Silas_ has quit IRC (Ping timeout: 260 seconds) |
|
20:32
🔗
|
|
Silas has joined #archiveteam-bs |
|
20:34
🔗
|
|
jschwart has quit IRC (Read error: Operation timed out) |
|
20:35
🔗
|
|
C4K3 has joined #archiveteam-bs |
|
20:41
🔗
|
|
jschwart has joined #archiveteam-bs |
|
21:35
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:59
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
21:59
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
22:42
🔗
|
|
jschwart has quit IRC (Quit: Konversation terminated!) |
|
22:59
🔗
|
|
Mateon1 has quit IRC (Read error: Operation timed out) |
|
23:00
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
23:12
🔗
|
godane |
latest vhs rips: https://www.patreon.com/posts/digitize-tapes-20073267 |
|
23:32
🔗
|
|
Silas has quit IRC (Ping timeout: 260 seconds) |
|
23:46
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
23:52
🔗
|
|
Flashfire has quit IRC (Bye) |
|
23:54
🔗
|
|
Flashfire has joined #archiveteam-bs |
|
23:58
🔗
|
|
Flashfire has quit IRC (Client Quit) |
|
23:59
🔗
|
|
Flashfire has joined #archiveteam-bs |