[00:30] *** jrconlin has joined #archiveteam [02:30] *** ndiddy has quit IRC () [02:41] *** SpaffGarg has quit IRC (Read error: Operation timed out) [02:43] *** SpaffGarg has joined #archiveteam [02:54] *** zeryl has joined #archiveteam [03:12] *** pizzaiolo has quit IRC (pizzaiolo) [03:23] *** zeryl has quit IRC (Quit: Page closed) [03:23] *** Zeryl has joined #archiveteam [04:07] WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD [04:07] lol, guess it no longer works? [04:15] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:16] reason for request, is for GNA updates. Working on downloading an updated set of files, ticket attachments, etc, and want to update the page w/ the data. [04:17] *** arbin has quit IRC (Read error: Operation timed out) [04:19] *** Froggypwn has joined #archiveteam [04:21] *** Sk1d has joined #archiveteam [04:29] *** signius has quit IRC (Quit: Leaving) [05:08] *** fie has joined #archiveteam [06:12] *** arbin has joined #archiveteam [06:16] hey Zeryl [06:36] *** Morbus has quit IRC (Read error: Connection reset by peer) [06:37] *** Morbus has joined #archiveteam [06:42] *** kris33 has joined #archiveteam [07:06] *** sivoais has quit IRC (Read error: Operation timed out) [07:07] *** chazchaz has quit IRC (Read error: Operation timed out) [07:07] *** Kenshin has quit IRC (Read error: Operation timed out) [07:08] *** chazchaz has joined #archiveteam [07:08] *** swebb sets mode: +o chazchaz [07:09] *** Kenshin has joined #archiveteam [07:09] *** sivoais has joined #archiveteam [07:12] *** schbirid has joined #archiveteam [07:25] *** SpaffGarg has quit IRC (Read error: Operation timed out) [07:28] *** SpaffGarg has joined #archiveteam [08:08] *** mls has quit IRC (Ping timeout: 250 seconds) [08:11] *** atomotic has joined #archiveteam [08:15] *** mls has joined #archiveteam [08:48] *** nyany has quit IRC (Ping timeout: 506 seconds) [08:52] *** antonizoo has quit IRC () [08:52] *** antonizoo has joined #archiveteam [09:05] *** Jonison has joined #archiveteam [10:50] *** godane has quit IRC (Ping timeout: 268 seconds) [11:01] *** Honno has joined #archiveteam [11:03] *** godane has joined #archiveteam [11:04] *** godane has left [11:12] *** kris33 has quit IRC (Textual IRC Client: www.textualapp.com) [11:51] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:55] *** kris33 has joined #archiveteam [12:26] *** nertzy2 has joined #archiveteam [12:28] *** nertzy has quit IRC (Ping timeout: 255 seconds) [12:42] *** nertzy2 has quit IRC (Ping timeout: 255 seconds) [12:43] *** nertzy has joined #archiveteam [13:00] *** atomotic has joined #archiveteam [13:05] *** nertzy2 has joined #archiveteam [13:06] *** BlueMaxim has quit IRC (Quit: Leaving) [13:11] *** nertzy has quit IRC (Read error: Operation timed out) [13:12] *** nertzy3 has joined #archiveteam [13:15] *** nertzy2 has quit IRC (Read error: Operation timed out) [13:30] *** nertzy3 has quit IRC (Quit: This computer has gone to sleep) [13:31] *** nertzy3 has joined #archiveteam [14:01] *** atomotic has quit IRC (ny.us.hub hub.se) [14:01] *** Jonison has quit IRC (ny.us.hub hub.se) [14:01] *** SpaffGarg has quit IRC (ny.us.hub hub.se) [14:01] *** Kenshin has quit IRC (ny.us.hub hub.se) [14:01] *** K4k has quit IRC (ny.us.hub hub.se) [14:01] *** SketchCow has quit IRC (ny.us.hub hub.se) [14:01] *** Kaz has quit IRC (ny.us.hub hub.se) [14:01] *** pfallenop has quit IRC (ny.us.hub hub.se) [14:01] *** Ctrl-S___ has quit IRC (ny.us.hub hub.se) [14:01] *** alembic has quit IRC (ny.us.hub hub.se) [14:01] *** hive-mind has quit IRC (ny.us.hub hub.se) [14:01] *** FalconK has quit IRC (ny.us.hub hub.se) [14:01] *** floogulin has quit IRC (ny.us.hub hub.se) [14:01] *** dimeshake has quit IRC (ny.us.hub hub.se) [14:01] *** octarine has quit IRC (ny.us.hub hub.se) [14:01] *** maxogden has quit IRC (ny.us.hub hub.se) [14:01] *** HCross2 has quit IRC (ny.us.hub hub.se) [14:01] *** deathy has quit IRC (ny.us.hub hub.se) [14:01] *** alfie has quit IRC (ny.us.hub hub.se) [14:01] *** BartoCH has quit IRC (ny.us.hub hub.se) [14:01] *** ThisAsYou has quit IRC (ny.us.hub hub.se) [14:01] *** deetwelve has quit IRC (ny.us.hub hub.se) [14:01] *** tklk has quit IRC (ny.us.hub hub.se) [14:01] *** Sue_ has quit IRC (ny.us.hub hub.se) [14:01] *** Muad-Dib has quit IRC (ny.us.hub hub.se) [14:01] *** Sanqui has quit IRC (ny.us.hub hub.se) [14:01] *** scyther has quit IRC (ny.us.hub hub.se) [14:01] *** Meroje has quit IRC (ny.us.hub hub.se) [14:01] *** mona has quit IRC (ny.us.hub hub.se) [14:01] *** raphidae has quit IRC (ny.us.hub hub.se) [14:01] *** Deewiant has quit IRC (ny.us.hub hub.se) [14:01] *** Boppen has quit IRC (ny.us.hub hub.se) [14:01] *** mls has quit IRC (ny.us.hub hub.se) [14:01] *** Sk1d has quit IRC (ny.us.hub hub.se) [14:01] *** xhdr has quit IRC (ny.us.hub hub.se) [14:01] *** andai has quit IRC (ny.us.hub hub.se) [14:01] *** Aoede has quit IRC (ny.us.hub hub.se) [14:01] *** nightpool has quit IRC (ny.us.hub hub.se) [14:01] *** lesderid has quit IRC (ny.us.hub hub.se) [14:01] *** hook54321 has quit IRC (ny.us.hub hub.se) [14:01] *** VeganMars has quit IRC (ny.us.hub hub.se) [14:01] *** Riviera has quit IRC (ny.us.hub hub.se) [14:01] *** SN4T14 has quit IRC (ny.us.hub hub.se) [14:01] *** tuluu_ has quit IRC (ny.us.hub hub.se) [14:01] *** QBcrusher has quit IRC (ny.us.hub hub.se) [14:01] *** JensRex has quit IRC (ny.us.hub hub.se) [14:01] *** andersju has quit IRC (ny.us.hub hub.se) [14:01] *** tammy_ has quit IRC (ny.us.hub hub.se) [14:01] *** i0npulse has quit IRC (ny.us.hub hub.se) [14:01] *** Nemo_bis has quit IRC (ny.us.hub hub.se) [14:01] *** Marc has quit IRC (ny.us.hub hub.se) [14:01] *** Hecatz has quit IRC (ny.us.hub hub.se) [14:01] *** Rai-chan has quit IRC (ny.us.hub hub.se) [14:01] *** medowar has quit IRC (ny.us.hub hub.se) [14:01] *** kris33 has quit IRC (ny.us.hub hub.se) [14:01] *** Rondom has quit IRC (ny.us.hub hub.se) [14:01] *** atluxity has quit IRC (ny.us.hub hub.se) [14:01] *** Ymgve has quit IRC (ny.us.hub hub.se) [14:01] *** Madchen has quit IRC (ny.us.hub hub.se) [14:01] *** toddf has quit IRC (ny.us.hub hub.se) [14:01] *** Meeh has quit IRC (ny.us.hub hub.se) [14:01] *** PurpleSym has quit IRC (ny.us.hub hub.se) [14:01] *** altlabel has quit IRC (ny.us.hub hub.se) [14:01] *** Froggypwn has quit IRC (ny.us.hub hub.se) [14:01] *** Zeryl has quit IRC (ny.us.hub hub.se) [14:01] *** Jon- has quit IRC (ny.us.hub hub.se) [14:01] *** Stilett0 has quit IRC (ny.us.hub hub.se) [14:01] *** dashcloud has quit IRC (ny.us.hub hub.se) [14:01] *** espes__ has quit IRC (ny.us.hub hub.se) [14:01] *** Darkstar has quit IRC (ny.us.hub hub.se) [14:01] *** topdownji has quit IRC (ny.us.hub hub.se) [14:01] *** Lord_Nigh has quit IRC (ny.us.hub hub.se) [14:01] *** brayden_ has quit IRC (ny.us.hub hub.se) [14:01] *** RichardG has quit IRC (ny.us.hub hub.se) [14:01] *** kurt has quit IRC (ny.us.hub hub.se) [14:01] *** Odd0002 has quit IRC (ny.us.hub hub.se) [14:01] *** ploop has quit IRC (ny.us.hub hub.se) [14:01] *** DFJustin has quit IRC (ny.us.hub hub.se) [14:01] *** SilSte has quit IRC (ny.us.hub hub.se) [14:01] *** Fletcher has quit IRC (ny.us.hub hub.se) [14:01] *** klg has quit IRC (ny.us.hub hub.se) [14:01] *** nico_32 has quit IRC (ny.us.hub hub.se) [14:01] *** antonizoo has quit IRC (ny.us.hub hub.se) [14:01] *** fie has quit IRC (ny.us.hub hub.se) [14:01] *** tsr has quit IRC (ny.us.hub hub.se) [14:01] *** yuitimoth has quit IRC (ny.us.hub hub.se) [14:01] *** flyingzum has quit IRC (ny.us.hub hub.se) [14:01] *** luckcolor has quit IRC (ny.us.hub hub.se) [14:01] *** tephra has quit IRC (ny.us.hub hub.se) [14:01] *** antomatic has quit IRC (ny.us.hub hub.se) [14:01] *** SmileyG has quit IRC (ny.us.hub hub.se) [14:01] *** kevinr has quit IRC (ny.us.hub hub.se) [14:01] *** Frogging has quit IRC (ny.us.hub hub.se) [14:01] *** johnny4 has quit IRC (ny.us.hub hub.se) [14:01] *** bsmith093 has quit IRC (ny.us.hub hub.se) [14:01] *** ats has quit IRC (ny.us.hub hub.se) [14:01] *** kisspunch has quit IRC (ny.us.hub hub.se) [14:01] *** tapedrive has quit IRC (ny.us.hub hub.se) [14:01] *** oli has quit IRC (ny.us.hub hub.se) [14:01] *** wolfpld has quit IRC (ny.us.hub hub.se) [14:02] *** antonizoo has joined #archiveteam [14:02] *** fie has joined #archiveteam [14:02] *** tsr has joined #archiveteam [14:02] *** yuitimoth has joined #archiveteam [14:02] *** flyingzum has joined #archiveteam [14:02] *** luckcolor has joined #archiveteam [14:02] *** tephra has joined #archiveteam [14:02] *** SmileyG has joined #archiveteam [14:02] *** antomatic has joined #archiveteam [14:02] *** kevinr has joined #archiveteam [14:02] *** Frogging has joined #archiveteam [14:02] *** irc.efnet.nl sets mode: +oooo luckcolor SmileyG antomatic Frogging [14:02] *** johnny4 has joined #archiveteam [14:02] *** bsmith093 has joined #archiveteam [14:02] *** ats has joined #archiveteam [14:02] *** kisspunch has joined #archiveteam [14:02] *** tapedrive has joined #archiveteam [14:02] *** oli has joined #archiveteam [14:02] *** wolfpld has joined #archiveteam [14:02] *** irc.efnet.nl sets mode: +o bsmith093 [14:02] *** swebb sets mode: +o antomatic [14:02] *** Frogging sets mode: +o yipdw [14:02] *** SmileyG has quit IRC (Write error: Broken pipe) [14:02] *** Smiley has joined #archiveteam [14:15] *** kris33 has joined #archiveteam [14:15] *** Froggypwn has joined #archiveteam [14:15] *** Zeryl has joined #archiveteam [14:15] *** Stilett0 has joined #archiveteam [14:15] *** Riviera has joined #archiveteam [14:15] *** dashcloud has joined #archiveteam [14:15] *** SN4T14 has joined #archiveteam [14:15] *** espes__ has joined #archiveteam [14:15] *** tuluu_ has joined #archiveteam [14:15] *** Darkstar has joined #archiveteam [14:15] *** QBcrusher has joined #archiveteam [14:15] *** Rondom has joined #archiveteam [14:15] *** JensRex has joined #archiveteam [14:15] *** topdownji has joined #archiveteam [14:15] *** andersju has joined #archiveteam [14:15] *** tammy_ has joined #archiveteam [14:15] *** i0npulse has joined #archiveteam [14:15] *** Nemo_bis has joined #archiveteam [14:15] *** Marc has joined #archiveteam [14:15] *** Hecatz has joined #archiveteam [14:15] *** medowar has joined #archiveteam [14:15] *** Rai-chan has joined #archiveteam [14:15] *** Lord_Nigh has joined #archiveteam [14:15] *** brayden_ has joined #archiveteam [14:15] *** hub.dk sets mode: +oooo Nemo_bis medowar Lord_Nigh brayden_ [14:15] *** kurt has joined #archiveteam [14:15] *** Odd0002 has joined #archiveteam [14:15] *** atluxity has joined #archiveteam [14:15] *** ploop has joined #archiveteam [14:15] *** DFJustin has joined #archiveteam [14:15] *** Ymgve has joined #archiveteam [14:15] *** SilSte has joined #archiveteam [14:15] *** klg has joined #archiveteam [14:15] *** Fletcher has joined #archiveteam [14:15] *** Madchen has joined #archiveteam [14:15] *** nico_32 has joined #archiveteam [14:15] *** toddf has joined #archiveteam [14:15] *** altlabel has joined #archiveteam [14:15] *** hub.dk sets mode: +oooo atluxity DFJustin Fletcher altlabel [14:15] *** PurpleSym has joined #archiveteam [14:15] *** Meeh has joined #archiveteam [14:15] *** hub.dk sets mode: +o PurpleSym [14:15] *** swebb sets mode: +o brayden_ [14:15] *** swebb sets mode: +o atluxity [14:15] *** swebb sets mode: +o DFJustin [14:15] *** swebb sets mode: +o altlabel [14:15] *** jmtd has joined #archiveteam [14:20] *** anhedonis has quit IRC (Read error: Operation timed out) [14:24] *** Deewiant has joined #archiveteam [14:24] *** Boppen has joined #archiveteam [14:32] *** atomotic has joined #archiveteam [14:32] *** Jonison has joined #archiveteam [14:32] *** Kenshin has joined #archiveteam [14:32] *** K4k has joined #archiveteam [14:32] *** SketchCow has joined #archiveteam [14:32] *** Kaz has joined #archiveteam [14:32] *** pfallenop has joined #archiveteam [14:32] *** Ctrl-S___ has joined #archiveteam [14:32] *** alembic has joined #archiveteam [14:32] *** hive-mind has joined #archiveteam [14:32] *** FalconK has joined #archiveteam [14:32] *** floogulin has joined #archiveteam [14:32] *** octarine has joined #archiveteam [14:32] *** dimeshake has joined #archiveteam [14:32] *** maxogden has joined #archiveteam [14:32] *** HCross2 has joined #archiveteam [14:32] *** efnet.port80.se sets mode: +oooo SketchCow Kaz FalconK HCross2 [14:32] *** deathy has joined #archiveteam [14:32] *** alfie has joined #archiveteam [14:32] *** BartoCH has joined #archiveteam [14:32] *** tklk has joined #archiveteam [14:32] *** raphidae has joined #archiveteam [14:32] *** ThisAsYou has joined #archiveteam [14:32] *** Muad-Dib has joined #archiveteam [14:32] *** Meroje has joined #archiveteam [14:32] *** deetwelve has joined #archiveteam [14:32] *** Sue_ has joined #archiveteam [14:32] *** Sanqui has joined #archiveteam [14:32] *** scyther has joined #archiveteam [14:32] *** mona has joined #archiveteam [14:32] *** efnet.port80.se sets mode: +o Sanqui [14:32] *** swebb sets mode: +o SketchCow [14:34] *** Jonison has quit IRC (Read error: Connection reset by peer) [14:36] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:52] *** nyany has joined #archiveteam [15:18] *** Ymgve has quit IRC (Ping timeout: 506 seconds) [15:30] *** Aranje has joined #archiveteam [15:42] *** SpaffGarg has joined #archiveteam [15:42] *** RichardG_ has joined #archiveteam [15:42] *** mls has joined #archiveteam [15:42] *** Sk1d has joined #archiveteam [15:42] *** xhdr has joined #archiveteam [15:42] *** andai has joined #archiveteam [15:42] *** Aoede has joined #archiveteam [15:42] *** nightpool has joined #archiveteam [15:42] *** lesderid has joined #archiveteam [15:42] *** hook54321 has joined #archiveteam [15:42] *** VeganMars has joined #archiveteam [15:44] *** RichardG_ is now known as RichardG [16:01] *** pizzaiolo has joined #archiveteam [16:05] *** atomotic has joined #archiveteam [16:24] *** phuz has joined #archiveteam [16:24] *** phuzion has quit IRC (Read error: Connection reset by peer) [16:35] *** antonizoo has quit IRC (Remote host closed the connection) [16:44] *** ZexaronS has joined #archiveteam [16:50] *** antonizoo has joined #archiveteam [16:56] *** speculaas has joined #archiveteam [16:56] *** speculaas has quit IRC (Client Quit) [16:56] *** speculaas has joined #archiveteam [17:01] *** speculaas has quit IRC (Ping timeout: 268 seconds) [17:29] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [17:44] *** bRick5772 has joined #archiveteam [18:07] *** pizzaiolo has quit IRC (Read error: Connection reset by peer) [18:08] *** pizzaiolo has joined #archiveteam [18:15] *** SpaffGarg has quit IRC (Ping timeout: 250 seconds) [18:21] FYI: Opgelet op Internet, a 12+ year old Dutch conumer rights/scam watch/protection forum, is closing July 1st http://www.opgeletopinternet.nl/ [18:21] *** SpaffGarg has joined #archiveteam [18:21] consumer rights* [18:39] MrRadar / hook54321 -> thx! [19:07] Titanpad will be shutting down: http://blog.titanpad.com/2016/11/shutting-down-titanpad_12.html [19:08] Ok, we know that already (http://archiveteam.org/index.php?title=Titanpad). Incidentally, May 1st has passed, but pads can still be edited. [19:23] *** pizzaiolo has quit IRC (Quit: pizzaiolo) [19:23] *** JAA has joined #archiveteam [19:24] *** pizzaiolo has joined #archiveteam [19:27] This football team fan forum with a few million posts is closing tomorrow: http://boards.baltimoreravens.com/topic/72470-announcement-boards-closing-may-5-new-date/ [19:28] love it [19:29] !d 0 0 [19:29] pffff [19:29] fine [19:29] I'll do it, but ONLY because they're ravens [19:29] hahaha [19:30] * Sanqui puts a finger over xmc's mouth [19:30] shhh [19:30] :P [19:38] *** Aranje has quit IRC (Ping timeout: 245 seconds) [19:57] *** speculaas has joined #archiveteam [20:05] *** ZexaronS- has joined #archiveteam [20:06] *** sep332 has quit IRC (Read error: Operation timed out) [20:06] *** ZexaronS has quit IRC (Read error: Operation timed out) [20:23] *** sep332 has joined #archiveteam [20:32] Muad-Dib: whoa, what the fuck? seriously? [20:33] Muad-Dib: "Met veel spijt in het hart melden we jullie dat (OOK) de website van Kapaza op 13 mei 2017 offline zal gaan." [20:41] Goedenavond [20:51] joepie91: yup [20:53] the forum is a bit risky to tyhrow into archivebot though, since it has that nasty tendency to add one of those "PHPSESSID=" parts to internal links [20:56] vraagje, heeft iemand ervaring met het ophalen van de gegevens van een specifiek hyves account? [20:59] Mmhm. Yeah. Oh, mhm. I know some of these words. [21:01] speculaas: Even though there are some people in here who understand/speak Dutch like me and joepie91, you probably get more of a response asking it in english ;) [21:02] Muad-Dib: I thought archivebot ignores those [21:03] like, drops the parameters... but maybe not [21:03] Alright. I want to archive a Hyves account but on the Warior application I don't see the Hyves project. [21:03] As for your question, speculaas: I am not sure what the process was for the retrieval of a specific hyves account, but I think joepie91 or arkiver might know more [21:04] Hyves has been offline for several years now, the Warrior is just used for saving the website while it's still online [21:05] Sanqui, Muad-Dib: ArchiveBot/grab-site uses wpull's --strip-session-id argument, which removes PHPSESSID and similar stuff from URLs. [21:06] * joepie91 appeareth [21:06] I thought there was a way after the end of Hyves to archive an account from Hyves [21:07] To download the stuff we grabbed from Hyves, you probably are going to have to look around the Internet Archive, where we store the data [21:07] speculaas: no, but it's (theoretically) possible to obtain pages from a Hyves account from the existing archives; the past ArchiveTeam project for it basically did a mass-archival of every account we could find [21:07] I don't have to use the warior application or github for that? [21:07] speculaas: but let's move to #archiveteam-bs, this channel is for low-traffic announcements only :) [21:07] speculaas: you'd need a time machine to archive something that's already deleted, it'd make our lives a helluva lot easier ;) [21:08] but yes, let's move to #archiveteam-bs [21:11] An update about myfreeforum (cf. logs from 5 Apr): the crowd fundraiser has ended, and they've lowered the target to match what's been pledged (£1063 of an original target of £10k) so the money got charged. Apparently that was planned from the beginning and the donations will be used to offer a database export. However, the admins have been completely silent since (as far as I can tell), so nobody really knows what's going to happen. [21:17] *** bRick5772 has quit IRC (Quit: Leaving.) [21:23] *** anhedonis has joined #archiveteam [21:31] Sanqui: no, it barely understands the semantics of URLs at all [21:31] a parameter blacklist might be an interesting feature [21:31] though it's already so bogged down with parsing that it's CPU bound [21:31] FalconK: now you are directly contradicting JAA, so sort it out please [21:31] I've been known to be wrong; let me look at the source [21:32] *** schbirid has quit IRC (Quit: Leaving) [21:32] if it's not using --strip-session-id and [21:32] --strip-session-id works, it should be [21:32] *** kris33 has quit IRC (Textual IRC Client: www.textualapp.com) [21:34] *** kris33 has joined #archiveteam [21:40] *** speculaas has quit IRC (Ping timeout: 268 seconds) [21:43] said option strips exactly the following from the non-query part of the path: [21:43] ^(.*/)(\((?:[a-z]\([0-9a-z]{24}\))+\)/)([^\?]+\.aspx.*)$ [21:43] *** fie has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** tsr has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** yuitimoth has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** flyingzum has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** luckcolor has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** tephra has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** antomatic has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** kevinr has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** Frogging has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** johnny4 has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** bsmith093 has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** ats has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** kisspunch has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** tapedrive has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** oli has quit IRC (ny.us.hub irc.efnet.nl) [21:43] *** wolfpld has quit IRC (ny.us.hub irc.efnet.nl) [21:43] ^(.*/)(\\([0-9a-z]{24}\\)/)([^\\?]+\\.aspx.*)$ [21:44] and then from the query: [21:44] ^(.*)(?:jsessionid=[0-9a-zA-Z]{32})(?:&(.*))?$ [21:44] ^(.*)(?:phpsessid=[0-9a-zA-Z]{32})(?:&(.*))?$ [21:44] *** fie has joined #archiveteam [21:44] *** tsr has joined #archiveteam [21:44] *** yuitimoth has joined #archiveteam [21:44] *** flyingzum has joined #archiveteam [21:44] *** luckcolor has joined #archiveteam [21:44] *** tephra has joined #archiveteam [21:44] *** antomatic has joined #archiveteam [21:44] *** kevinr has joined #archiveteam [21:44] *** Frogging has joined #archiveteam [21:44] *** johnny4 has joined #archiveteam [21:44] *** bsmith093 has joined #archiveteam [21:44] *** irc.efnet.nl sets mode: +oooo luckcolor antomatic Frogging bsmith093 [21:44] *** ats has joined #archiveteam [21:44] *** kisspunch has joined #archiveteam [21:44] *** tapedrive has joined #archiveteam [21:44] *** oli has joined #archiveteam [21:44] *** wolfpld has joined #archiveteam [21:44] *** swebb sets mode: +o antomatic [21:44] *** Frogging sets mode: +o yipdw [21:44] ^(.*)(?:sid=[0-9a-zA-Z]{32})(?:&(.*))?$ [21:44] ^(.*)(?:ASPSESSIONID[a-zA-Z]{8}=[a-zA-Z]{24})(?:&(.*))?$ [21:44] ^(.*)(?:cfid=[^&]+&cftoken=[^&]+)(?:&(.*))?$ [21:44] and that's it [21:46] so PHPSESSID it will miss, since it only cares about that in lowercase [21:47] It uses the re.I option. [21:47] (At least in the current master) [21:47] @Sanqui, thanks again for the message last night [21:48] then there's a bug somewhere else, because I've seen it running down the PHPSESSID rabbit hole a ton [21:48] Zeryl: you're welcome, do good [21:48] that's my hope! :) [21:48] yeah, the copy I'm running definitely uses re.I as well [21:48] got some scripts all setup for the backup i'm working on, so I'll be throwing those up later. Hopefully they are a bit generic enough to use going forward. [21:48] ugh, I guess I'll have to look in the manhole next time I catch one running away like that to see why. [21:52] Interestingly though, those regexes don't check whether jsessionid, phpsessid, etc. are preceded by either ? or & so only actual query parameters with those names are matched. For example, I'd expect "http://example.com/?thisusersid=0123456789abcdef0123456789abcdef&foo" to become "http://example.com/?thisuser&foo" (untested). [21:56] noooo :( [21:58] Sanqui: My EpicSki forum grab is done. 571k URLs (155k of which are thread pages), 64 GiB uncompressed according to wpull, 53 GiB compressed. [22:00] JAA: good job! the archivebot job is still going [22:01] yes, we have a substantial issue with archivebot that I don't have a good strategy to address: it spends massive amounts of time doing things like building complete parsed representations of documents it gets [22:01] now, it's using wpull too [22:02] but it has an unfavourable CPU/bandwidth ratio [22:02] so it's able to do just a few requests per second if the pipeline has as many as 3 jobs [22:03] cloud CPU is vastly more expensive than cloud bandwidth, so I'd be interested to hear if anyone has any thoughts on it [22:05] why are documents being parsed [22:05] to gather links [22:05] right [22:05] -bs probably [22:05] * FalconK goes [22:18] *** REiN^ has quit IRC (Read error: Operation timed out) [22:22] *** REiN^ has joined #archiveteam [22:23] *** ZexaronS- has quit IRC (Leaving) [22:39] *** Stilett0 has quit IRC (Read error: Operation timed out) [22:59] *** Stilett0 has joined #archiveteam [23:22] *** JAA has quit IRC (Quit: Page closed) [23:32] *** superkuh has quit IRC (Remote host closed the connection) [23:34] *** superkuh has joined #archiveteam [23:44] *** Froggypwn has quit IRC (Read error: Operation timed out) [23:45] *** Froggypwn has joined #archiveteam [23:57] *** BlueMaxim has joined #archiveteam