#archiveteam 2018-06-25,Mon

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***Sk2d has joined #archiveteam
BlueMax has joined #archiveteam
Sk1d has quit IRC (Read error: Operation timed out)
Sk2d is now known as Sk1d
Ctrl has joined #archiveteam
[00:15]
.... (idle for 15mn)
alfie has quit IRC (Quit: Bye.) [00:37]
..... (idle for 22mn)
fie has quit IRC (Ping timeout: 632 seconds) [00:59]
........... (idle for 51mn)
fie has joined #archiveteam [01:50]
...... (idle for 28mn)
balrog has quit IRC (Quit: Bye)
Flashfire has joined #archiveteam
[02:18]
Flashfirehttps://www.cordcuttersnews.com/sony-crackle-is-shutting-down-in-canada/ [02:19]
***balrog has joined #archiveteam [02:24]
Flashfire has quit IRC (Quit: http://www.mibbit.com ajax IRC Client) [02:38]
Darkstar has quit IRC (Ping timeout: 480 seconds) [02:52]
ta9le has quit IRC (Quit: Connection closed for inactivity)
Darkstar has joined #archiveteam
[02:58]
archodg_ has joined #archiveteam
odemg has quit IRC (Read error: Operation timed out)
archodg has quit IRC (Read error: Operation timed out)
[03:08]
odemg has joined #archiveteam
pizzaiolo has quit IRC (Remote host closed the connection)
[03:24]
Darkstar has quit IRC (Ping timeout: 480 seconds) [03:39]
Flashfire has joined #archiveteam
Darkstar has joined #archiveteam
[03:45]
BlueMax has quit IRC (Leaving) [03:55]
Flashfire has left [04:03]
...... (idle for 28mn)
Darkstar has quit IRC (Ping timeout: 480 seconds)
BlueMax has joined #archiveteam
[04:31]
Darkstar has joined #archiveteam [04:43]
....... (idle for 33mn)
Darkstar has quit IRC (Ping timeout: 246 seconds) [05:16]
Darkstar has joined #archiveteam [05:22]
......... (idle for 42mn)
tstarling has joined #archiveteam
Darkstar has quit IRC (Ping timeout: 506 seconds)
[06:04]
tstarlingI want to talk about archiving https://arbital.com/
it uses XHR POST requests to get the article content, which is apparently why IA etc. has not been able to archive it successfully
this website is a failed startup and the owner is in the process of winding it up, unclear what will happen
[06:12]
***Darkstar has joined #archiveteam [06:15]
tstarlingI tried emailing him, no response [06:15]
I'm just trying to figure out what it would take to make an archive
I could do a bit of dev work to support this but I'm not sure what I would need to patch at this point
or whether it would be easier to set up a proxy website and crawl the proxy instead
wrong time of the day for this channel, I guess, but maybe I'll carry on thinking out loud
a proxy website could replace XMLHttpRequest with a version that converts POST parameters to query string parameters and sends them to a GET-to-POST gateway also on the proxy side
[06:25]
***schbirid has joined #archiveteam [06:41]
Darkstar has quit IRC (Ping timeout: 246 seconds) [06:53]
tstarlingbut is that the best we can do? obviously a search of the wayback machine for arbital.com would still only give you blank pages
you'd have to search for the proxy
[06:58]
***Darkstar has joined #archiveteam [07:03]
fenntstarling: someone affiliated with arbital said just now that it's not shutting down, fwiw [07:04]
tstarlingit's just one guy though, right? all he has to do is stop paying the Google App Engine bills
bbl
[07:06]
.... (idle for 18mn)
***schbirid has quit IRC (Quit: Leaving) [07:24]
..... (idle for 23mn)
Darkstar has quit IRC (Ping timeout: 246 seconds) [07:47]
..... (idle for 21mn)
Darkstar has joined #archiveteam [08:08]
...... (idle for 27mn)
BlueMaxim has joined #archiveteam
redlob has quit IRC (Read error: Operation timed out)
BlueMax has quit IRC (Read error: Operation timed out)
BlueMaxim has quit IRC (Remote host closed the connection)
BlueMax has joined #archiveteam
[08:35]
redlob has joined #archiveteam [08:53]
......... (idle for 41mn)
ta9le has joined #archiveteam [09:34]
Muad-DibI'm not sure we ever grabbed the "detailed" match statistics with #yolohalo, but they're going in 3 days https://www.bungie.net/en/Explore/Detail/News/46965 [09:40]
***Aoede has quit IRC (Ping timeout: 252 seconds)
Aoede has joined #archiveteam
[09:45]
BlueMax has quit IRC (Leaving) [09:54]
............. (idle for 1h2mn)
zino__ has quit IRC (Remote host closed the connection) [10:56]
..... (idle for 23mn)
alfie has joined #archiveteam [11:19]
tstarlingI guess there's a number of ways to spoof the contents of a website before putting it into a WARC, e.g. with an HTTP proxy or with /etc/hosts
the question then would be whether that is allowable for ArchiveBot and IA
but I am in the right place, right? You're the sort of people who (like me) care about websites disappearing?
[11:22]
***pizzaiolo has joined #archiveteam [11:28]
Stiletto has quit IRC (Read error: Connection reset by peer) [11:36]
....... (idle for 31mn)
Muad-Dibtstarling: this sounds like material for #archivebot-bs [12:07]
tstarlingthanks Muad-Dib [12:08]
Muad-Dibnp [12:09]
tstarlingbut better to try in the US day time by the looks of it? [12:09]
Muad-Dibdepends, there are a lot of europeans here too, but probably more Americans, yeah
but then again, many of us are a bit crazy and might have weird sleep schedules ;)
[12:09]
tstarlingI'll try in 10 hours or so, tomorrow morning for me [12:12]
***tstarling has quit IRC (Quit: Leaving) [12:12]
.... (idle for 18mn)
Lactuca has joined #archiveteam
Lactuca has quit IRC (Client Quit)
[12:30]
........... (idle for 54mn)
phillipsjUsing POST to access content is such an Internet no no, I wonder if it is designed to foil crawlers. [13:27]
***ZoeB_ has joined #archiveteam [13:32]
......... (idle for 41mn)
Mateon1 has quit IRC (Read error: Operation timed out)
ancaster has joined #archiveteam
Mateon1 has joined #archiveteam
[14:13]
ancaster has quit IRC (Quit: Page closed) [14:27]
..... (idle for 21mn)
antomati_ has joined #archiveteam
antomatic has quit IRC (Read error: Operation timed out)
antomati_ is now known as antomatic
[14:48]
.......... (idle for 48mn)
MMovie has quit IRC (Read error: Connection reset by peer) [15:38]
.................. (idle for 1h26mn)
MMovie has joined #archiveteam [17:04]
.... (idle for 17mn)
db48x has joined #archiveteam [17:21]
Ctrl has quit IRC (Ping timeout: 268 seconds)
Aoede has quit IRC (Quit: ZNC - http://znc.in)
[17:31]
Stilett0 has joined #archiveteam
redlob has quit IRC (Read error: Operation timed out)
redlob has joined #archiveteam
[17:40]
.... (idle for 17mn)
Ctrl has joined #archiveteam
pizzaiolo has quit IRC (Read error: Operation timed out)
[18:01]
adinbied has quit IRC (Quit: Leaving) [18:09]
...... (idle for 27mn)
schbirid has joined #archiveteam [18:36]
...... (idle for 25mn)
ta9le has quit IRC (Quit: Connection closed for inactivity) [19:01]
Aoede has joined #archiveteam [19:07]
ZoeB_ has quit IRC (Quit: ZoeB_) [19:14]
............. (idle for 1h1mn)
antomati_ has joined #archiveteam
antomati_ has quit IRC (Connection closed)
antomatic has quit IRC (Ping timeout: 252 seconds)
[20:15]
.... (idle for 18mn)
antomatic has joined #archiveteam [20:34]
jschwart has joined #archiveteam [20:47]
schbirid has quit IRC (Remote host closed the connection) [20:55]
....... (idle for 34mn)
jschwart has quit IRC (Quit: Konversation terminated!)
ta9le has joined #archiveteam
[21:29]
........ (idle for 36mn)
Ctrl has quit IRC (Ping timeout: 268 seconds)
Meroje has quit IRC (Ping timeout: 260 seconds)
[22:08]
Meroje has joined #archiveteam [22:15]
..... (idle for 21mn)
Ctrl has joined #archiveteam [22:36]
........... (idle for 50mn)
BlueMax has joined #archiveteam [23:26]
...... (idle for 28mn)
dashcloud has quit IRC (Remote host closed the connection) [23:54]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)