[00:15] *** Sk2d has joined #archiveteam [00:16] *** BlueMax has joined #archiveteam [00:18] *** Sk1d has quit IRC (Read error: Operation timed out) [00:18] *** Sk2d is now known as Sk1d [00:22] *** Ctrl has joined #archiveteam [00:37] *** alfie has quit IRC (Quit: Bye.) [00:59] *** fie has quit IRC (Ping timeout: 632 seconds) [01:50] *** fie has joined #archiveteam [02:18] *** balrog has quit IRC (Quit: Bye) [02:19] *** Flashfire has joined #archiveteam [02:19] https://www.cordcuttersnews.com/sony-crackle-is-shutting-down-in-canada/ [02:24] *** balrog has joined #archiveteam [02:38] *** Flashfire has quit IRC (Quit: http://www.mibbit.com ajax IRC Client) [02:52] *** Darkstar has quit IRC (Ping timeout: 480 seconds) [02:58] *** ta9le has quit IRC (Quit: Connection closed for inactivity) [02:59] *** Darkstar has joined #archiveteam [03:08] *** archodg_ has joined #archiveteam [03:10] *** odemg has quit IRC (Read error: Operation timed out) [03:11] *** archodg has quit IRC (Read error: Operation timed out) [03:24] *** odemg has joined #archiveteam [03:26] *** pizzaiolo has quit IRC (Remote host closed the connection) [03:39] *** Darkstar has quit IRC (Ping timeout: 480 seconds) [03:45] *** Flashfire has joined #archiveteam [03:46] *** Darkstar has joined #archiveteam [03:55] *** BlueMax has quit IRC (Leaving) [04:03] *** Flashfire has left [04:31] *** Darkstar has quit IRC (Ping timeout: 480 seconds) [04:32] *** BlueMax has joined #archiveteam [04:43] *** Darkstar has joined #archiveteam [05:16] *** Darkstar has quit IRC (Ping timeout: 246 seconds) [05:22] *** Darkstar has joined #archiveteam [06:04] *** tstarling has joined #archiveteam [06:07] *** Darkstar has quit IRC (Ping timeout: 506 seconds) [06:12] I want to talk about archiving https://arbital.com/ [06:13] it uses XHR POST requests to get the article content, which is apparently why IA etc. has not been able to archive it successfully [06:14] this website is a failed startup and the owner is in the process of winding it up, unclear what will happen [06:15] *** Darkstar has joined #archiveteam [06:15] I tried emailing him, no response [06:25] I'm just trying to figure out what it would take to make an archive [06:27] I could do a bit of dev work to support this but I'm not sure what I would need to patch at this point [06:27] or whether it would be easier to set up a proxy website and crawl the proxy instead [06:31] wrong time of the day for this channel, I guess, but maybe I'll carry on thinking out loud [06:32] a proxy website could replace XMLHttpRequest with a version that converts POST parameters to query string parameters and sends them to a GET-to-POST gateway also on the proxy side [06:41] *** schbirid has joined #archiveteam [06:53] *** Darkstar has quit IRC (Ping timeout: 246 seconds) [06:58] but is that the best we can do? obviously a search of the wayback machine for arbital.com would still only give you blank pages [06:58] you'd have to search for the proxy [07:03] *** Darkstar has joined #archiveteam [07:04] tstarling: someone affiliated with arbital said just now that it's not shutting down, fwiw [07:06] it's just one guy though, right? all he has to do is stop paying the Google App Engine bills [07:06] bbl [07:24] *** schbirid has quit IRC (Quit: Leaving) [07:47] *** Darkstar has quit IRC (Ping timeout: 246 seconds) [08:08] *** Darkstar has joined #archiveteam [08:35] *** BlueMaxim has joined #archiveteam [08:39] *** redlob has quit IRC (Read error: Operation timed out) [08:40] *** BlueMax has quit IRC (Read error: Operation timed out) [08:41] *** BlueMaxim has quit IRC (Remote host closed the connection) [08:41] *** BlueMax has joined #archiveteam [08:53] *** redlob has joined #archiveteam [09:34] *** ta9le has joined #archiveteam [09:40] I'm not sure we ever grabbed the "detailed" match statistics with #yolohalo, but they're going in 3 days https://www.bungie.net/en/Explore/Detail/News/46965 [09:45] *** Aoede has quit IRC (Ping timeout: 252 seconds) [09:47] *** Aoede has joined #archiveteam [09:54] *** BlueMax has quit IRC (Leaving) [10:56] *** zino__ has quit IRC (Remote host closed the connection) [11:19] *** alfie has joined #archiveteam [11:22] I guess there's a number of ways to spoof the contents of a website before putting it into a WARC, e.g. with an HTTP proxy or with /etc/hosts [11:23] the question then would be whether that is allowable for ArchiveBot and IA [11:25] but I am in the right place, right? You're the sort of people who (like me) care about websites disappearing? [11:28] *** pizzaiolo has joined #archiveteam [11:36] *** Stiletto has quit IRC (Read error: Connection reset by peer) [12:07] tstarling: this sounds like material for #archivebot-bs [12:08] thanks Muad-Dib [12:09] np [12:09] but better to try in the US day time by the looks of it? [12:09] depends, there are a lot of europeans here too, but probably more Americans, yeah [12:10] but then again, many of us are a bit crazy and might have weird sleep schedules ;) [12:12] I'll try in 10 hours or so, tomorrow morning for me [12:12] *** tstarling has quit IRC (Quit: Leaving) [12:30] *** Lactuca has joined #archiveteam [12:33] *** Lactuca has quit IRC (Client Quit) [13:27] Using POST to access content is such an Internet no no, I wonder if it is designed to foil crawlers. [13:32] *** ZoeB_ has joined #archiveteam [14:13] *** Mateon1 has quit IRC (Read error: Operation timed out) [14:14] *** ancaster has joined #archiveteam [14:15] *** Mateon1 has joined #archiveteam [14:27] *** ancaster has quit IRC (Quit: Page closed) [14:48] *** antomati_ has joined #archiveteam [14:50] *** antomatic has quit IRC (Read error: Operation timed out) [14:50] *** antomati_ is now known as antomatic [15:38] *** MMovie has quit IRC (Read error: Connection reset by peer) [17:04] *** MMovie has joined #archiveteam [17:21] *** db48x has joined #archiveteam [17:31] *** Ctrl has quit IRC (Ping timeout: 268 seconds) [17:32] *** Aoede has quit IRC (Quit: ZNC - http://znc.in) [17:40] *** Stilett0 has joined #archiveteam [17:43] *** redlob has quit IRC (Read error: Operation timed out) [17:44] *** redlob has joined #archiveteam [18:01] *** Ctrl has joined #archiveteam [18:01] *** pizzaiolo has quit IRC (Read error: Operation timed out) [18:09] *** adinbied has quit IRC (Quit: Leaving) [18:36] *** schbirid has joined #archiveteam [19:01] *** ta9le has quit IRC (Quit: Connection closed for inactivity) [19:07] *** Aoede has joined #archiveteam [19:14] *** ZoeB_ has quit IRC (Quit: ZoeB_) [20:15] *** antomati_ has joined #archiveteam [20:15] *** antomati_ has quit IRC (Connection closed) [20:16] *** antomatic has quit IRC (Ping timeout: 252 seconds) [20:34] *** antomatic has joined #archiveteam [20:47] *** jschwart has joined #archiveteam [20:55] *** schbirid has quit IRC (Remote host closed the connection) [21:29] *** jschwart has quit IRC (Quit: Konversation terminated!) [21:32] *** ta9le has joined #archiveteam [22:08] *** Ctrl has quit IRC (Ping timeout: 268 seconds) [22:09] *** Meroje has quit IRC (Ping timeout: 260 seconds) [22:15] *** Meroje has joined #archiveteam [22:36] *** Ctrl has joined #archiveteam [23:26] *** BlueMax has joined #archiveteam [23:54] *** dashcloud has quit IRC (Remote host closed the connection)