#archiveteam 2017-05-04,Thu

↑back Search

Time Nickname Message
00:30 🔗 jrconlin has joined #archiveteam
02:30 🔗 ndiddy has quit IRC ()
02:41 🔗 SpaffGarg has quit IRC (Read error: Operation timed out)
02:43 🔗 SpaffGarg has joined #archiveteam
02:54 🔗 zeryl has joined #archiveteam
03:12 🔗 pizzaiolo has quit IRC (pizzaiolo)
03:23 🔗 zeryl has quit IRC (Quit: Page closed)
03:23 🔗 Zeryl has joined #archiveteam
04:07 🔗 Zeryl WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD
04:07 🔗 Zeryl lol, guess it no longer works?
04:15 🔗 Sk1d has quit IRC (Ping timeout: 194 seconds)
04:16 🔗 Zeryl reason for request, is for GNA updates. Working on downloading an updated set of files, ticket attachments, etc, and want to update the page w/ the data.
04:17 🔗 arbin has quit IRC (Read error: Operation timed out)
04:19 🔗 Froggypwn has joined #archiveteam
04:21 🔗 Sk1d has joined #archiveteam
04:29 🔗 signius has quit IRC (Quit: Leaving)
05:08 🔗 fie has joined #archiveteam
06:12 🔗 arbin has joined #archiveteam
06:16 🔗 Sanqui hey Zeryl
06:36 🔗 Morbus has quit IRC (Read error: Connection reset by peer)
06:37 🔗 Morbus has joined #archiveteam
06:42 🔗 kris33 has joined #archiveteam
07:06 🔗 sivoais has quit IRC (Read error: Operation timed out)
07:07 🔗 chazchaz has quit IRC (Read error: Operation timed out)
07:07 🔗 Kenshin has quit IRC (Read error: Operation timed out)
07:08 🔗 chazchaz has joined #archiveteam
07:08 🔗 swebb sets mode: +o chazchaz
07:09 🔗 Kenshin has joined #archiveteam
07:09 🔗 sivoais has joined #archiveteam
07:12 🔗 schbirid has joined #archiveteam
07:25 🔗 SpaffGarg has quit IRC (Read error: Operation timed out)
07:28 🔗 SpaffGarg has joined #archiveteam
08:08 🔗 mls has quit IRC (Ping timeout: 250 seconds)
08:11 🔗 atomotic has joined #archiveteam
08:15 🔗 mls has joined #archiveteam
08:48 🔗 nyany has quit IRC (Ping timeout: 506 seconds)
08:52 🔗 antonizoo has quit IRC ()
08:52 🔗 antonizoo has joined #archiveteam
09:05 🔗 Jonison has joined #archiveteam
10:50 🔗 godane has quit IRC (Ping timeout: 268 seconds)
11:01 🔗 Honno has joined #archiveteam
11:03 🔗 godane has joined #archiveteam
11:04 🔗 godane has left
11:12 🔗 kris33 has quit IRC (Textual IRC Client: www.textualapp.com)
11:51 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
11:55 🔗 kris33 has joined #archiveteam
12:26 🔗 nertzy2 has joined #archiveteam
12:28 🔗 nertzy has quit IRC (Ping timeout: 255 seconds)
12:42 🔗 nertzy2 has quit IRC (Ping timeout: 255 seconds)
12:43 🔗 nertzy has joined #archiveteam
13:00 🔗 atomotic has joined #archiveteam
13:05 🔗 nertzy2 has joined #archiveteam
13:06 🔗 BlueMaxim has quit IRC (Quit: Leaving)
13:11 🔗 nertzy has quit IRC (Read error: Operation timed out)
13:12 🔗 nertzy3 has joined #archiveteam
13:15 🔗 nertzy2 has quit IRC (Read error: Operation timed out)
13:30 🔗 nertzy3 has quit IRC (Quit: This computer has gone to sleep)
13:31 🔗 nertzy3 has joined #archiveteam
14:01 🔗 atomotic has quit IRC (ny.us.hub hub.se)
14:01 🔗 Jonison has quit IRC (ny.us.hub hub.se)
14:01 🔗 SpaffGarg has quit IRC (ny.us.hub hub.se)
14:01 🔗 Kenshin has quit IRC (ny.us.hub hub.se)
14:01 🔗 K4k has quit IRC (ny.us.hub hub.se)
14:01 🔗 SketchCow has quit IRC (ny.us.hub hub.se)
14:01 🔗 Kaz has quit IRC (ny.us.hub hub.se)
14:01 🔗 pfallenop has quit IRC (ny.us.hub hub.se)
14:01 🔗 Ctrl-S___ has quit IRC (ny.us.hub hub.se)
14:01 🔗 alembic has quit IRC (ny.us.hub hub.se)
14:01 🔗 hive-mind has quit IRC (ny.us.hub hub.se)
14:01 🔗 FalconK has quit IRC (ny.us.hub hub.se)
14:01 🔗 floogulin has quit IRC (ny.us.hub hub.se)
14:01 🔗 dimeshake has quit IRC (ny.us.hub hub.se)
14:01 🔗 octarine has quit IRC (ny.us.hub hub.se)
14:01 🔗 maxogden has quit IRC (ny.us.hub hub.se)
14:01 🔗 HCross2 has quit IRC (ny.us.hub hub.se)
14:01 🔗 deathy has quit IRC (ny.us.hub hub.se)
14:01 🔗 alfie has quit IRC (ny.us.hub hub.se)
14:01 🔗 BartoCH has quit IRC (ny.us.hub hub.se)
14:01 🔗 ThisAsYou has quit IRC (ny.us.hub hub.se)
14:01 🔗 deetwelve has quit IRC (ny.us.hub hub.se)
14:01 🔗 tklk has quit IRC (ny.us.hub hub.se)
14:01 🔗 Sue_ has quit IRC (ny.us.hub hub.se)
14:01 🔗 Muad-Dib has quit IRC (ny.us.hub hub.se)
14:01 🔗 Sanqui has quit IRC (ny.us.hub hub.se)
14:01 🔗 scyther has quit IRC (ny.us.hub hub.se)
14:01 🔗 Meroje has quit IRC (ny.us.hub hub.se)
14:01 🔗 mona has quit IRC (ny.us.hub hub.se)
14:01 🔗 raphidae has quit IRC (ny.us.hub hub.se)
14:01 🔗 Deewiant has quit IRC (ny.us.hub hub.se)
14:01 🔗 Boppen has quit IRC (ny.us.hub hub.se)
14:01 🔗 mls has quit IRC (ny.us.hub hub.se)
14:01 🔗 Sk1d has quit IRC (ny.us.hub hub.se)
14:01 🔗 xhdr has quit IRC (ny.us.hub hub.se)
14:01 🔗 andai has quit IRC (ny.us.hub hub.se)
14:01 🔗 Aoede has quit IRC (ny.us.hub hub.se)
14:01 🔗 nightpool has quit IRC (ny.us.hub hub.se)
14:01 🔗 lesderid has quit IRC (ny.us.hub hub.se)
14:01 🔗 hook54321 has quit IRC (ny.us.hub hub.se)
14:01 🔗 VeganMars has quit IRC (ny.us.hub hub.se)
14:01 🔗 Riviera has quit IRC (ny.us.hub hub.se)
14:01 🔗 SN4T14 has quit IRC (ny.us.hub hub.se)
14:01 🔗 tuluu_ has quit IRC (ny.us.hub hub.se)
14:01 🔗 QBcrusher has quit IRC (ny.us.hub hub.se)
14:01 🔗 JensRex has quit IRC (ny.us.hub hub.se)
14:01 🔗 andersju has quit IRC (ny.us.hub hub.se)
14:01 🔗 tammy_ has quit IRC (ny.us.hub hub.se)
14:01 🔗 i0npulse has quit IRC (ny.us.hub hub.se)
14:01 🔗 Nemo_bis has quit IRC (ny.us.hub hub.se)
14:01 🔗 Marc has quit IRC (ny.us.hub hub.se)
14:01 🔗 Hecatz has quit IRC (ny.us.hub hub.se)
14:01 🔗 Rai-chan has quit IRC (ny.us.hub hub.se)
14:01 🔗 medowar has quit IRC (ny.us.hub hub.se)
14:01 🔗 kris33 has quit IRC (ny.us.hub hub.se)
14:01 🔗 Rondom has quit IRC (ny.us.hub hub.se)
14:01 🔗 atluxity has quit IRC (ny.us.hub hub.se)
14:01 🔗 Ymgve has quit IRC (ny.us.hub hub.se)
14:01 🔗 Madchen has quit IRC (ny.us.hub hub.se)
14:01 🔗 toddf has quit IRC (ny.us.hub hub.se)
14:01 🔗 Meeh has quit IRC (ny.us.hub hub.se)
14:01 🔗 PurpleSym has quit IRC (ny.us.hub hub.se)
14:01 🔗 altlabel has quit IRC (ny.us.hub hub.se)
14:01 🔗 Froggypwn has quit IRC (ny.us.hub hub.se)
14:01 🔗 Zeryl has quit IRC (ny.us.hub hub.se)
14:01 🔗 Jon- has quit IRC (ny.us.hub hub.se)
14:01 🔗 Stilett0 has quit IRC (ny.us.hub hub.se)
14:01 🔗 dashcloud has quit IRC (ny.us.hub hub.se)
14:01 🔗 espes__ has quit IRC (ny.us.hub hub.se)
14:01 🔗 Darkstar has quit IRC (ny.us.hub hub.se)
14:01 🔗 topdownji has quit IRC (ny.us.hub hub.se)
14:01 🔗 Lord_Nigh has quit IRC (ny.us.hub hub.se)
14:01 🔗 brayden_ has quit IRC (ny.us.hub hub.se)
14:01 🔗 RichardG has quit IRC (ny.us.hub hub.se)
14:01 🔗 kurt has quit IRC (ny.us.hub hub.se)
14:01 🔗 Odd0002 has quit IRC (ny.us.hub hub.se)
14:01 🔗 ploop has quit IRC (ny.us.hub hub.se)
14:01 🔗 DFJustin has quit IRC (ny.us.hub hub.se)
14:01 🔗 SilSte has quit IRC (ny.us.hub hub.se)
14:01 🔗 Fletcher has quit IRC (ny.us.hub hub.se)
14:01 🔗 klg has quit IRC (ny.us.hub hub.se)
14:01 🔗 nico_32 has quit IRC (ny.us.hub hub.se)
14:01 🔗 antonizoo has quit IRC (ny.us.hub hub.se)
14:01 🔗 fie has quit IRC (ny.us.hub hub.se)
14:01 🔗 tsr has quit IRC (ny.us.hub hub.se)
14:01 🔗 yuitimoth has quit IRC (ny.us.hub hub.se)
14:01 🔗 flyingzum has quit IRC (ny.us.hub hub.se)
14:01 🔗 luckcolor has quit IRC (ny.us.hub hub.se)
14:01 🔗 tephra has quit IRC (ny.us.hub hub.se)
14:01 🔗 antomatic has quit IRC (ny.us.hub hub.se)
14:01 🔗 SmileyG has quit IRC (ny.us.hub hub.se)
14:01 🔗 kevinr has quit IRC (ny.us.hub hub.se)
14:01 🔗 Frogging has quit IRC (ny.us.hub hub.se)
14:01 🔗 johnny4 has quit IRC (ny.us.hub hub.se)
14:01 🔗 bsmith093 has quit IRC (ny.us.hub hub.se)
14:01 🔗 ats has quit IRC (ny.us.hub hub.se)
14:01 🔗 kisspunch has quit IRC (ny.us.hub hub.se)
14:01 🔗 tapedrive has quit IRC (ny.us.hub hub.se)
14:01 🔗 oli has quit IRC (ny.us.hub hub.se)
14:01 🔗 wolfpld has quit IRC (ny.us.hub hub.se)
14:02 🔗 antonizoo has joined #archiveteam
14:02 🔗 fie has joined #archiveteam
14:02 🔗 tsr has joined #archiveteam
14:02 🔗 yuitimoth has joined #archiveteam
14:02 🔗 flyingzum has joined #archiveteam
14:02 🔗 luckcolor has joined #archiveteam
14:02 🔗 tephra has joined #archiveteam
14:02 🔗 SmileyG has joined #archiveteam
14:02 🔗 antomatic has joined #archiveteam
14:02 🔗 kevinr has joined #archiveteam
14:02 🔗 Frogging has joined #archiveteam
14:02 🔗 irc.efnet.nl sets mode: +oooo luckcolor SmileyG antomatic Frogging
14:02 🔗 johnny4 has joined #archiveteam
14:02 🔗 bsmith093 has joined #archiveteam
14:02 🔗 ats has joined #archiveteam
14:02 🔗 kisspunch has joined #archiveteam
14:02 🔗 tapedrive has joined #archiveteam
14:02 🔗 oli has joined #archiveteam
14:02 🔗 wolfpld has joined #archiveteam
14:02 🔗 irc.efnet.nl sets mode: +o bsmith093
14:02 🔗 swebb sets mode: +o antomatic
14:02 🔗 Frogging sets mode: +o yipdw
14:02 🔗 SmileyG has quit IRC (Write error: Broken pipe)
14:02 🔗 Smiley has joined #archiveteam
14:15 🔗 kris33 has joined #archiveteam
14:15 🔗 Froggypwn has joined #archiveteam
14:15 🔗 Zeryl has joined #archiveteam
14:15 🔗 Stilett0 has joined #archiveteam
14:15 🔗 Riviera has joined #archiveteam
14:15 🔗 dashcloud has joined #archiveteam
14:15 🔗 SN4T14 has joined #archiveteam
14:15 🔗 espes__ has joined #archiveteam
14:15 🔗 tuluu_ has joined #archiveteam
14:15 🔗 Darkstar has joined #archiveteam
14:15 🔗 QBcrusher has joined #archiveteam
14:15 🔗 Rondom has joined #archiveteam
14:15 🔗 JensRex has joined #archiveteam
14:15 🔗 topdownji has joined #archiveteam
14:15 🔗 andersju has joined #archiveteam
14:15 🔗 tammy_ has joined #archiveteam
14:15 🔗 i0npulse has joined #archiveteam
14:15 🔗 Nemo_bis has joined #archiveteam
14:15 🔗 Marc has joined #archiveteam
14:15 🔗 Hecatz has joined #archiveteam
14:15 🔗 medowar has joined #archiveteam
14:15 🔗 Rai-chan has joined #archiveteam
14:15 🔗 Lord_Nigh has joined #archiveteam
14:15 🔗 brayden_ has joined #archiveteam
14:15 🔗 hub.dk sets mode: +oooo Nemo_bis medowar Lord_Nigh brayden_
14:15 🔗 kurt has joined #archiveteam
14:15 🔗 Odd0002 has joined #archiveteam
14:15 🔗 atluxity has joined #archiveteam
14:15 🔗 ploop has joined #archiveteam
14:15 🔗 DFJustin has joined #archiveteam
14:15 🔗 Ymgve has joined #archiveteam
14:15 🔗 SilSte has joined #archiveteam
14:15 🔗 klg has joined #archiveteam
14:15 🔗 Fletcher has joined #archiveteam
14:15 🔗 Madchen has joined #archiveteam
14:15 🔗 nico_32 has joined #archiveteam
14:15 🔗 toddf has joined #archiveteam
14:15 🔗 altlabel has joined #archiveteam
14:15 🔗 hub.dk sets mode: +oooo atluxity DFJustin Fletcher altlabel
14:15 🔗 PurpleSym has joined #archiveteam
14:15 🔗 Meeh has joined #archiveteam
14:15 🔗 hub.dk sets mode: +o PurpleSym
14:15 🔗 swebb sets mode: +o brayden_
14:15 🔗 swebb sets mode: +o atluxity
14:15 🔗 swebb sets mode: +o DFJustin
14:15 🔗 swebb sets mode: +o altlabel
14:15 🔗 jmtd has joined #archiveteam
14:20 🔗 anhedonis has quit IRC (Read error: Operation timed out)
14:24 🔗 Deewiant has joined #archiveteam
14:24 🔗 Boppen has joined #archiveteam
14:32 🔗 atomotic has joined #archiveteam
14:32 🔗 Jonison has joined #archiveteam
14:32 🔗 Kenshin has joined #archiveteam
14:32 🔗 K4k has joined #archiveteam
14:32 🔗 SketchCow has joined #archiveteam
14:32 🔗 Kaz has joined #archiveteam
14:32 🔗 pfallenop has joined #archiveteam
14:32 🔗 Ctrl-S___ has joined #archiveteam
14:32 🔗 alembic has joined #archiveteam
14:32 🔗 hive-mind has joined #archiveteam
14:32 🔗 FalconK has joined #archiveteam
14:32 🔗 floogulin has joined #archiveteam
14:32 🔗 octarine has joined #archiveteam
14:32 🔗 dimeshake has joined #archiveteam
14:32 🔗 maxogden has joined #archiveteam
14:32 🔗 HCross2 has joined #archiveteam
14:32 🔗 efnet.port80.se sets mode: +oooo SketchCow Kaz FalconK HCross2
14:32 🔗 deathy has joined #archiveteam
14:32 🔗 alfie has joined #archiveteam
14:32 🔗 BartoCH has joined #archiveteam
14:32 🔗 tklk has joined #archiveteam
14:32 🔗 raphidae has joined #archiveteam
14:32 🔗 ThisAsYou has joined #archiveteam
14:32 🔗 Muad-Dib has joined #archiveteam
14:32 🔗 Meroje has joined #archiveteam
14:32 🔗 deetwelve has joined #archiveteam
14:32 🔗 Sue_ has joined #archiveteam
14:32 🔗 Sanqui has joined #archiveteam
14:32 🔗 scyther has joined #archiveteam
14:32 🔗 mona has joined #archiveteam
14:32 🔗 efnet.port80.se sets mode: +o Sanqui
14:32 🔗 swebb sets mode: +o SketchCow
14:34 🔗 Jonison has quit IRC (Read error: Connection reset by peer)
14:36 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
14:52 🔗 nyany has joined #archiveteam
15:18 🔗 Ymgve has quit IRC (Ping timeout: 506 seconds)
15:30 🔗 Aranje has joined #archiveteam
15:42 🔗 SpaffGarg has joined #archiveteam
15:42 🔗 RichardG_ has joined #archiveteam
15:42 🔗 mls has joined #archiveteam
15:42 🔗 Sk1d has joined #archiveteam
15:42 🔗 xhdr has joined #archiveteam
15:42 🔗 andai has joined #archiveteam
15:42 🔗 Aoede has joined #archiveteam
15:42 🔗 nightpool has joined #archiveteam
15:42 🔗 lesderid has joined #archiveteam
15:42 🔗 hook54321 has joined #archiveteam
15:42 🔗 VeganMars has joined #archiveteam
15:44 🔗 RichardG_ is now known as RichardG
16:01 🔗 pizzaiolo has joined #archiveteam
16:05 🔗 atomotic has joined #archiveteam
16:24 🔗 phuz has joined #archiveteam
16:24 🔗 phuzion has quit IRC (Read error: Connection reset by peer)
16:35 🔗 antonizoo has quit IRC (Remote host closed the connection)
16:44 🔗 ZexaronS has joined #archiveteam
16:50 🔗 antonizoo has joined #archiveteam
16:56 🔗 speculaas has joined #archiveteam
16:56 🔗 speculaas has quit IRC (Client Quit)
16:56 🔗 speculaas has joined #archiveteam
17:01 🔗 speculaas has quit IRC (Ping timeout: 268 seconds)
17:29 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
17:44 🔗 bRick5772 has joined #archiveteam
18:07 🔗 pizzaiolo has quit IRC (Read error: Connection reset by peer)
18:08 🔗 pizzaiolo has joined #archiveteam
18:15 🔗 SpaffGarg has quit IRC (Ping timeout: 250 seconds)
18:21 🔗 Muad-Dib FYI: Opgelet op Internet, a 12+ year old Dutch conumer rights/scam watch/protection forum, is closing July 1st http://www.opgeletopinternet.nl/
18:21 🔗 SpaffGarg has joined #archiveteam
18:21 🔗 Muad-Dib consumer rights*
18:39 🔗 Hobart MrRadar / hook54321 -> thx!
19:07 🔗 Sanqui Titanpad will be shutting down: http://blog.titanpad.com/2016/11/shutting-down-titanpad_12.html
19:08 🔗 Sanqui Ok, we know that already (http://archiveteam.org/index.php?title=Titanpad). Incidentally, May 1st has passed, but pads can still be edited.
19:23 🔗 pizzaiolo has quit IRC (Quit: pizzaiolo)
19:23 🔗 JAA has joined #archiveteam
19:24 🔗 pizzaiolo has joined #archiveteam
19:27 🔗 JAA This football team fan forum with a few million posts is closing tomorrow: http://boards.baltimoreravens.com/topic/72470-announcement-boards-closing-may-5-new-date/
19:28 🔗 Sanqui love it
19:29 🔗 Sanqui !d 0 0
19:29 🔗 Sanqui pffff
19:29 🔗 Sanqui fine
19:29 🔗 Sanqui I'll do it, but ONLY because they're ravens
19:29 🔗 xmc hahaha
19:30 🔗 * Sanqui puts a finger over xmc's mouth
19:30 🔗 Sanqui shhh
19:30 🔗 xmc :P
19:38 🔗 Aranje has quit IRC (Ping timeout: 245 seconds)
19:57 🔗 speculaas has joined #archiveteam
20:05 🔗 ZexaronS- has joined #archiveteam
20:06 🔗 sep332 has quit IRC (Read error: Operation timed out)
20:06 🔗 ZexaronS has quit IRC (Read error: Operation timed out)
20:23 🔗 sep332 has joined #archiveteam
20:32 🔗 joepie91 Muad-Dib: whoa, what the fuck? seriously?
20:33 🔗 joepie91 Muad-Dib: "Met veel spijt in het hart melden we jullie dat (OOK) de website van Kapaza op 13 mei 2017 offline zal gaan."
20:41 🔗 speculaas Goedenavond
20:51 🔗 Muad-Dib joepie91: yup
20:53 🔗 Muad-Dib the forum is a bit risky to tyhrow into archivebot though, since it has that nasty tendency to add one of those "PHPSESSID=" parts to internal links
20:56 🔗 speculaas vraagje, heeft iemand ervaring met het ophalen van de gegevens van een specifiek hyves account?
20:59 🔗 JAA Mmhm. Yeah. Oh, mhm. I know some of these words.
21:01 🔗 Muad-Dib speculaas: Even though there are some people in here who understand/speak Dutch like me and joepie91, you probably get more of a response asking it in english ;)
21:02 🔗 Sanqui Muad-Dib: I thought archivebot ignores those
21:03 🔗 Sanqui like, drops the parameters... but maybe not
21:03 🔗 speculaas Alright. I want to archive a Hyves account but on the Warior application I don't see the Hyves project.
21:03 🔗 Muad-Dib As for your question, speculaas: I am not sure what the process was for the retrieval of a specific hyves account, but I think joepie91 or arkiver might know more
21:04 🔗 Muad-Dib Hyves has been offline for several years now, the Warrior is just used for saving the website while it's still online
21:05 🔗 JAA Sanqui, Muad-Dib: ArchiveBot/grab-site uses wpull's --strip-session-id argument, which removes PHPSESSID and similar stuff from URLs.
21:06 🔗 * joepie91 appeareth
21:06 🔗 speculaas I thought there was a way after the end of Hyves to archive an account from Hyves
21:07 🔗 Muad-Dib To download the stuff we grabbed from Hyves, you probably are going to have to look around the Internet Archive, where we store the data
21:07 🔗 joepie91 speculaas: no, but it's (theoretically) possible to obtain pages from a Hyves account from the existing archives; the past ArchiveTeam project for it basically did a mass-archival of every account we could find
21:07 🔗 speculaas I don't have to use the warior application or github for that?
21:07 🔗 joepie91 speculaas: but let's move to #archiveteam-bs, this channel is for low-traffic announcements only :)
21:07 🔗 Muad-Dib speculaas: you'd need a time machine to archive something that's already deleted, it'd make our lives a helluva lot easier ;)
21:08 🔗 Muad-Dib but yes, let's move to #archiveteam-bs
21:11 🔗 JAA An update about myfreeforum (cf. logs from 5 Apr): the crowd fundraiser has ended, and they've lowered the target to match what's been pledged (£1063 of an original target of £10k) so the money got charged. Apparently that was planned from the beginning and the donations will be used to offer a database export. However, the admins have been completely silent since (as far as I can tell), so nobody really knows what's going to happen.
21:17 🔗 bRick5772 has quit IRC (Quit: Leaving.)
21:23 🔗 anhedonis has joined #archiveteam
21:31 🔗 FalconK Sanqui: no, it barely understands the semantics of URLs at all
21:31 🔗 FalconK a parameter blacklist might be an interesting feature
21:31 🔗 FalconK though it's already so bogged down with parsing that it's CPU bound
21:31 🔗 Sanqui FalconK: now you are directly contradicting JAA, so sort it out please
21:31 🔗 FalconK I've been known to be wrong; let me look at the source
21:32 🔗 schbirid has quit IRC (Quit: Leaving)
21:32 🔗 FalconK if it's not using --strip-session-id and
21:32 🔗 FalconK --strip-session-id works, it should be
21:32 🔗 kris33 has quit IRC (Textual IRC Client: www.textualapp.com)
21:34 🔗 kris33 has joined #archiveteam
21:40 🔗 speculaas has quit IRC (Ping timeout: 268 seconds)
21:43 🔗 FalconK said option strips exactly the following from the non-query part of the path:
21:43 🔗 FalconK ^(.*/)(\((?:[a-z]\([0-9a-z]{24}\))+\)/)([^\?]+\.aspx.*)$
21:43 🔗 fie has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 tsr has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 yuitimoth has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 flyingzum has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 luckcolor has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 tephra has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 antomatic has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 kevinr has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 Frogging has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 johnny4 has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 bsmith093 has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 ats has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 kisspunch has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 tapedrive has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 oli has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 wolfpld has quit IRC (ny.us.hub irc.efnet.nl)
21:43 🔗 FalconK ^(.*/)(\\([0-9a-z]{24}\\)/)([^\\?]+\\.aspx.*)$
21:44 🔗 FalconK and then from the query:
21:44 🔗 FalconK ^(.*)(?:jsessionid=[0-9a-zA-Z]{32})(?:&(.*))?$
21:44 🔗 FalconK ^(.*)(?:phpsessid=[0-9a-zA-Z]{32})(?:&(.*))?$
21:44 🔗 fie has joined #archiveteam
21:44 🔗 tsr has joined #archiveteam
21:44 🔗 yuitimoth has joined #archiveteam
21:44 🔗 flyingzum has joined #archiveteam
21:44 🔗 luckcolor has joined #archiveteam
21:44 🔗 tephra has joined #archiveteam
21:44 🔗 antomatic has joined #archiveteam
21:44 🔗 kevinr has joined #archiveteam
21:44 🔗 Frogging has joined #archiveteam
21:44 🔗 johnny4 has joined #archiveteam
21:44 🔗 bsmith093 has joined #archiveteam
21:44 🔗 irc.efnet.nl sets mode: +oooo luckcolor antomatic Frogging bsmith093
21:44 🔗 ats has joined #archiveteam
21:44 🔗 kisspunch has joined #archiveteam
21:44 🔗 tapedrive has joined #archiveteam
21:44 🔗 oli has joined #archiveteam
21:44 🔗 wolfpld has joined #archiveteam
21:44 🔗 swebb sets mode: +o antomatic
21:44 🔗 Frogging sets mode: +o yipdw
21:44 🔗 FalconK ^(.*)(?:sid=[0-9a-zA-Z]{32})(?:&(.*))?$
21:44 🔗 FalconK ^(.*)(?:ASPSESSIONID[a-zA-Z]{8}=[a-zA-Z]{24})(?:&(.*))?$
21:44 🔗 FalconK ^(.*)(?:cfid=[^&]+&cftoken=[^&]+)(?:&(.*))?$
21:44 🔗 FalconK and that's it
21:46 🔗 FalconK so PHPSESSID it will miss, since it only cares about that in lowercase
21:47 🔗 JAA It uses the re.I option.
21:47 🔗 JAA (At least in the current master)
21:47 🔗 Zeryl @Sanqui, thanks again for the message last night
21:48 🔗 FalconK then there's a bug somewhere else, because I've seen it running down the PHPSESSID rabbit hole a ton
21:48 🔗 Sanqui Zeryl: you're welcome, do good
21:48 🔗 Zeryl that's my hope! :)
21:48 🔗 FalconK yeah, the copy I'm running definitely uses re.I as well
21:48 🔗 Zeryl got some scripts all setup for the backup i'm working on, so I'll be throwing those up later. Hopefully they are a bit generic enough to use going forward.
21:48 🔗 FalconK ugh, I guess I'll have to look in the manhole next time I catch one running away like that to see why.
21:52 🔗 JAA Interestingly though, those regexes don't check whether jsessionid, phpsessid, etc. are preceded by either ? or & so only actual query parameters with those names are matched. For example, I'd expect "http://example.com/?thisusersid=0123456789abcdef0123456789abcdef&foo" to become "http://example.com/?thisuser&foo" (untested).
21:56 🔗 Sanqui noooo :(
21:58 🔗 JAA Sanqui: My EpicSki forum grab is done. 571k URLs (155k of which are thread pages), 64 GiB uncompressed according to wpull, 53 GiB compressed.
22:00 🔗 Sanqui JAA: good job! the archivebot job is still going
22:01 🔗 FalconK yes, we have a substantial issue with archivebot that I don't have a good strategy to address: it spends massive amounts of time doing things like building complete parsed representations of documents it gets
22:01 🔗 FalconK now, it's using wpull too
22:02 🔗 FalconK but it has an unfavourable CPU/bandwidth ratio
22:02 🔗 FalconK so it's able to do just a few requests per second if the pipeline has as many as 3 jobs
22:03 🔗 FalconK cloud CPU is vastly more expensive than cloud bandwidth, so I'd be interested to hear if anyone has any thoughts on it
22:05 🔗 Sanqui why are documents being parsed
22:05 🔗 Sanqui to gather links
22:05 🔗 Sanqui right
22:05 🔗 Sanqui -bs probably
22:05 🔗 * FalconK goes
22:18 🔗 REiN^ has quit IRC (Read error: Operation timed out)
22:22 🔗 REiN^ has joined #archiveteam
22:23 🔗 ZexaronS- has quit IRC (Leaving)
22:39 🔗 Stilett0 has quit IRC (Read error: Operation timed out)
22:59 🔗 Stilett0 has joined #archiveteam
23:22 🔗 JAA has quit IRC (Quit: Page closed)
23:32 🔗 superkuh has quit IRC (Remote host closed the connection)
23:34 🔗 superkuh has joined #archiveteam
23:44 🔗 Froggypwn has quit IRC (Read error: Operation timed out)
23:45 🔗 Froggypwn has joined #archiveteam
23:57 🔗 BlueMaxim has joined #archiveteam

irclogger-viewer