#archiveteam 2018-06-25,Mon

↑back Search

Time Nickname Message
00:15 🔗 Sk2d has joined #archiveteam
00:16 🔗 BlueMax has joined #archiveteam
00:18 🔗 Sk1d has quit IRC (Read error: Operation timed out)
00:18 🔗 Sk2d is now known as Sk1d
00:22 🔗 Ctrl has joined #archiveteam
00:37 🔗 alfie has quit IRC (Quit: Bye.)
00:59 🔗 fie has quit IRC (Ping timeout: 632 seconds)
01:50 🔗 fie has joined #archiveteam
02:18 🔗 balrog has quit IRC (Quit: Bye)
02:19 🔗 Flashfire has joined #archiveteam
02:19 🔗 Flashfire https://www.cordcuttersnews.com/sony-crackle-is-shutting-down-in-canada/
02:24 🔗 balrog has joined #archiveteam
02:38 🔗 Flashfire has quit IRC (Quit: http://www.mibbit.com ajax IRC Client)
02:52 🔗 Darkstar has quit IRC (Ping timeout: 480 seconds)
02:58 🔗 ta9le has quit IRC (Quit: Connection closed for inactivity)
02:59 🔗 Darkstar has joined #archiveteam
03:08 🔗 archodg_ has joined #archiveteam
03:10 🔗 odemg has quit IRC (Read error: Operation timed out)
03:11 🔗 archodg has quit IRC (Read error: Operation timed out)
03:24 🔗 odemg has joined #archiveteam
03:26 🔗 pizzaiolo has quit IRC (Remote host closed the connection)
03:39 🔗 Darkstar has quit IRC (Ping timeout: 480 seconds)
03:45 🔗 Flashfire has joined #archiveteam
03:46 🔗 Darkstar has joined #archiveteam
03:55 🔗 BlueMax has quit IRC (Leaving)
04:03 🔗 Flashfire has left
04:31 🔗 Darkstar has quit IRC (Ping timeout: 480 seconds)
04:32 🔗 BlueMax has joined #archiveteam
04:43 🔗 Darkstar has joined #archiveteam
05:16 🔗 Darkstar has quit IRC (Ping timeout: 246 seconds)
05:22 🔗 Darkstar has joined #archiveteam
06:04 🔗 tstarling has joined #archiveteam
06:07 🔗 Darkstar has quit IRC (Ping timeout: 506 seconds)
06:12 🔗 tstarling I want to talk about archiving https://arbital.com/
06:13 🔗 tstarling it uses XHR POST requests to get the article content, which is apparently why IA etc. has not been able to archive it successfully
06:14 🔗 tstarling this website is a failed startup and the owner is in the process of winding it up, unclear what will happen
06:15 🔗 Darkstar has joined #archiveteam
06:15 🔗 tstarling I tried emailing him, no response
06:25 🔗 tstarling I'm just trying to figure out what it would take to make an archive
06:27 🔗 tstarling I could do a bit of dev work to support this but I'm not sure what I would need to patch at this point
06:27 🔗 tstarling or whether it would be easier to set up a proxy website and crawl the proxy instead
06:31 🔗 tstarling wrong time of the day for this channel, I guess, but maybe I'll carry on thinking out loud
06:32 🔗 tstarling a proxy website could replace XMLHttpRequest with a version that converts POST parameters to query string parameters and sends them to a GET-to-POST gateway also on the proxy side
06:41 🔗 schbirid has joined #archiveteam
06:53 🔗 Darkstar has quit IRC (Ping timeout: 246 seconds)
06:58 🔗 tstarling but is that the best we can do? obviously a search of the wayback machine for arbital.com would still only give you blank pages
06:58 🔗 tstarling you'd have to search for the proxy
07:03 🔗 Darkstar has joined #archiveteam
07:04 🔗 fenn tstarling: someone affiliated with arbital said just now that it's not shutting down, fwiw
07:06 🔗 tstarling it's just one guy though, right? all he has to do is stop paying the Google App Engine bills
07:06 🔗 tstarling bbl
07:24 🔗 schbirid has quit IRC (Quit: Leaving)
07:47 🔗 Darkstar has quit IRC (Ping timeout: 246 seconds)
08:08 🔗 Darkstar has joined #archiveteam
08:35 🔗 BlueMaxim has joined #archiveteam
08:39 🔗 redlob has quit IRC (Read error: Operation timed out)
08:40 🔗 BlueMax has quit IRC (Read error: Operation timed out)
08:41 🔗 BlueMaxim has quit IRC (Remote host closed the connection)
08:41 🔗 BlueMax has joined #archiveteam
08:53 🔗 redlob has joined #archiveteam
09:34 🔗 ta9le has joined #archiveteam
09:40 🔗 Muad-Dib I'm not sure we ever grabbed the "detailed" match statistics with #yolohalo, but they're going in 3 days https://www.bungie.net/en/Explore/Detail/News/46965
09:45 🔗 Aoede has quit IRC (Ping timeout: 252 seconds)
09:47 🔗 Aoede has joined #archiveteam
09:54 🔗 BlueMax has quit IRC (Leaving)
10:56 🔗 zino__ has quit IRC (Remote host closed the connection)
11:19 🔗 alfie has joined #archiveteam
11:22 🔗 tstarling I guess there's a number of ways to spoof the contents of a website before putting it into a WARC, e.g. with an HTTP proxy or with /etc/hosts
11:23 🔗 tstarling the question then would be whether that is allowable for ArchiveBot and IA
11:25 🔗 tstarling but I am in the right place, right? You're the sort of people who (like me) care about websites disappearing?
11:28 🔗 pizzaiolo has joined #archiveteam
11:36 🔗 Stiletto has quit IRC (Read error: Connection reset by peer)
12:07 🔗 Muad-Dib tstarling: this sounds like material for #archivebot-bs
12:08 🔗 tstarling thanks Muad-Dib
12:09 🔗 Muad-Dib np
12:09 🔗 tstarling but better to try in the US day time by the looks of it?
12:09 🔗 Muad-Dib depends, there are a lot of europeans here too, but probably more Americans, yeah
12:10 🔗 Muad-Dib but then again, many of us are a bit crazy and might have weird sleep schedules ;)
12:12 🔗 tstarling I'll try in 10 hours or so, tomorrow morning for me
12:12 🔗 tstarling has quit IRC (Quit: Leaving)
12:30 🔗 Lactuca has joined #archiveteam
12:33 🔗 Lactuca has quit IRC (Client Quit)
13:27 🔗 phillipsj Using POST to access content is such an Internet no no, I wonder if it is designed to foil crawlers.
13:32 🔗 ZoeB_ has joined #archiveteam
14:13 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
14:14 🔗 ancaster has joined #archiveteam
14:15 🔗 Mateon1 has joined #archiveteam
14:27 🔗 ancaster has quit IRC (Quit: Page closed)
14:48 🔗 antomati_ has joined #archiveteam
14:50 🔗 antomatic has quit IRC (Read error: Operation timed out)
14:50 🔗 antomati_ is now known as antomatic
15:38 🔗 MMovie has quit IRC (Read error: Connection reset by peer)
17:04 🔗 MMovie has joined #archiveteam
17:21 🔗 db48x has joined #archiveteam
17:31 🔗 Ctrl has quit IRC (Ping timeout: 268 seconds)
17:32 🔗 Aoede has quit IRC (Quit: ZNC - http://znc.in)
17:40 🔗 Stilett0 has joined #archiveteam
17:43 🔗 redlob has quit IRC (Read error: Operation timed out)
17:44 🔗 redlob has joined #archiveteam
18:01 🔗 Ctrl has joined #archiveteam
18:01 🔗 pizzaiolo has quit IRC (Read error: Operation timed out)
18:09 🔗 adinbied has quit IRC (Quit: Leaving)
18:36 🔗 schbirid has joined #archiveteam
19:01 🔗 ta9le has quit IRC (Quit: Connection closed for inactivity)
19:07 🔗 Aoede has joined #archiveteam
19:14 🔗 ZoeB_ has quit IRC (Quit: ZoeB_)
20:15 🔗 antomati_ has joined #archiveteam
20:15 🔗 antomati_ has quit IRC (Connection closed)
20:16 🔗 antomatic has quit IRC (Ping timeout: 252 seconds)
20:34 🔗 antomatic has joined #archiveteam
20:47 🔗 jschwart has joined #archiveteam
20:55 🔗 schbirid has quit IRC (Remote host closed the connection)
21:29 🔗 jschwart has quit IRC (Quit: Konversation terminated!)
21:32 🔗 ta9le has joined #archiveteam
22:08 🔗 Ctrl has quit IRC (Ping timeout: 268 seconds)
22:09 🔗 Meroje has quit IRC (Ping timeout: 260 seconds)
22:15 🔗 Meroje has joined #archiveteam
22:36 🔗 Ctrl has joined #archiveteam
23:26 🔗 BlueMax has joined #archiveteam
23:54 🔗 dashcloud has quit IRC (Remote host closed the connection)

irclogger-viewer