#archiveteam 2018-02-09,Fri

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
fermintershould I just recrawl it? (it might take a long time) [00:02]
astridi would make a backup of the file and then edit it [00:02]
ferminterI think maybe I could modify warcio or something to output a corrected version
Or I could just regex/sed/awk, but that would break any times WARC-Target-URI appeared in the HTML itself (which is doubtful, but still theoretically possible)
[00:02]
astridisn't the html usually gzipped
or are the headers gzipped too
[00:03]
ferminteroh wait not sure
I'll check
looks like the headers are gzipped
[00:03]
astridok
basic rule we've followed around editing warcs in the past is, if you can provide a tool to perfectly reverse the edits and come out with a file bit-for-bit identical with the original input, then it's fine
[00:04]
............. (idle for 1h2mn)
***BobJonkma has quit IRC (Read error: Operation timed out) [01:07]
........ (idle for 36mn)
pizzaiolo has quit IRC (Remote host closed the connection)
dashcloud has quit IRC (Ping timeout: 492 seconds)
dashcloud has joined #archiveteam
[01:43]
RichardG has quit IRC (Read error: Connection reset by peer)
RichardG has joined #archiveteam
[02:01]
..... (idle for 24mn)
Morbus has quit IRC (Ping timeout: 255 seconds) [02:25]
........... (idle for 52mn)
ferminter has quit IRC (http://www.mibbit.com ajax IRC Client) [03:17]
......... (idle for 44mn)
Stilett0 has joined #archiveteam [04:01]
.... (idle for 17mn)
BlueMax has joined #archiveteam
qw3rty115 has joined #archiveteam
qw3rty114 has quit IRC (Read error: Operation timed out)
[04:18]
..................... (idle for 1h42mn)
ferminter has joined #archiveteam [06:05]
ferminterIDK if this will be helpful for anyone, but I wrote a quick script to fix that issue: https://gist.github.com/sudonym1/e607abe127f058e9027301e53994b910
probably should've used warcio instead of warctools, since the former works with python 3, but oh well
(Wget 1.19 broken angle bracket issue)
[06:05]
***ferminter has quit IRC (Client Quit) [06:06]
................... (idle for 1h33mn)
dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.)
dashcloud has joined #archiveteam
schbirid has joined #archiveteam
[07:39]
.......... (idle for 49mn)
muramasa has joined #archiveteam [08:30]
atomotic has joined #archiveteam [08:42]
..... (idle for 23mn)
BlueMaxim has joined #archiveteam
atomotic has quit IRC (Ping timeout: 260 seconds)
atomotic has joined #archiveteam
BlueMax has quit IRC (Read error: Operation timed out)
[09:05]
RichardG has quit IRC (se.hub irc.efnet.nl)
will has quit IRC (se.hub irc.efnet.nl)
Smiley has quit IRC (se.hub irc.efnet.nl)
BnAboyZ has quit IRC (se.hub irc.efnet.nl)
kisspunch has quit IRC (se.hub irc.efnet.nl)
Zebranky has quit IRC (se.hub irc.efnet.nl)
MrRadar2 has quit IRC (se.hub irc.efnet.nl)
BnARobin has quit IRC (se.hub irc.efnet.nl)
jtn2 has quit IRC (se.hub irc.efnet.nl)
Tenebrae has quit IRC (se.hub irc.efnet.nl)
Fusl has quit IRC (se.hub irc.efnet.nl)
hook54321 has quit IRC (se.hub irc.efnet.nl)
Polylith has quit IRC (se.hub irc.efnet.nl)
[09:17]
..... (idle for 20mn)
BlueMaxim has quit IRC (Leaving) [09:37]
..................... (idle for 1h43mn)
pizzaiolo has joined #archiveteam
mabynogy has joined #archiveteam
[11:20]
FalconK has quit IRC (Ping timeout: 260 seconds) [11:32]
RichardG has joined #archiveteam
will has joined #archiveteam
Smiley has joined #archiveteam
BnAboyZ has joined #archiveteam
kisspunch has joined #archiveteam
Zebranky has joined #archiveteam
MrRadar2 has joined #archiveteam
BnARobin has joined #archiveteam
jtn2 has joined #archiveteam
Tenebrae has joined #archiveteam
Fusl has joined #archiveteam
hook54321 has joined #archiveteam
Polylith has joined #archiveteam
irc.efnet.nl sets mode: +o MrRadar2
[11:37]
...... (idle for 27mn)
atomotic has quit IRC (Quit: atomotic) [12:04]
Morbus has joined #archiveteam [12:09]
.... (idle for 19mn)
FalconK has joined #archiveteam [12:28]
.... (idle for 17mn)
ranavalon has joined #archiveteam
bitspill has quit IRC ()
bitspill has joined #archiveteam
[12:45]
........... (idle for 52mn)
DrasticAc has quit IRC ()
DrasticAc has joined #archiveteam
[13:40]
wp494Oddshot.tv (basically Twitch clips before Twitch added clips natively) is shutting down this coming Monday: https://www.reddit.com/r/GlobalOffensive/comments/7wd4qh/psa_oddshot_is_shutting_down/
most of it might be stuff that could be found elsewhere already, while other bits may be from streams that got taken down for one reason or another
also dxrt, joepie91, MrRadar, SketchCow, please spread the +o
dunno what happened to the whole auto-op thing we had going a while back but I guess that doesn't work anymore so /shrug
[13:41]
***atomotic has joined #archiveteam [13:58]
....... (idle for 33mn)
Mateon1 has quit IRC (Ping timeout: 252 seconds)
Mateon1 has joined #archiveteam
[14:31]
...... (idle for 25mn)
riking has quit IRC ()
riking has joined #archiveteam
ThisAsYou has quit IRC ()
ThisAsYou has joined #archiveteam
[14:56]
dogsrcool has joined #archiveteam [15:08]
dogsrcoolWHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD [15:09]
Sanquidogsrcool: what is your quest? [15:12]
dogsrcoolto get a wiki account [15:13]
.... (idle for 15mn)
Sanquidogsrcool: sure but, what do you want to edit/add? [15:28]
..... (idle for 24mn)
***Burak has joined #archiveteam [15:52]
BurakOddshot.tv, the stream clip hosting service, is shutting down in three days - https://medium.com/the-oddshot-loop/end-of-an-era-aefeca0420bf
Could AT archive it?
[15:56]
***atrocity has joined #archiveteam [16:00]
...... (idle for 29mn)
ZexaronS has joined #archiveteam
SketchCow sets mode: +o wp494
SketchCow sets mode: +oooo db48x arkiver atluxity antomatic
SketchCow sets mode: +oooo astrid chfoo closure dashcloud
SketchCow sets mode: +o DFJustin
[16:29]
JAAJAA raises hand [16:39]
***SketchCow sets mode: +o JAA [16:50]
JAAThanks [16:54]
***JAA changes topic to: Archive Team: We're not archive.org | https://archiveteam.org/ | Lengthy discussions: #archiveteam-bs | Offtopic: #archiveteam-ot | Yes, we know about Oddshot.t
JAA changes topic to: Archive Team: We're not archive.org | https://archiveteam.org/ | Lengthy discussions: #archiveteam-bs | Offtopic: #archiveteam-ot | We know about Oddshot.tv
[16:54]
....... (idle for 31mn)
atomotic has quit IRC (Quit: atomotic) [17:25]
..... (idle for 24mn)
MMovie2 has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
[17:49]
icedice has joined #archiveteam
ZexaronS has quit IRC (Quit: Leaving)
[17:59]
.............. (idle for 1h6mn)
pizzaiolo has quit IRC (Remote host closed the connection)
pizzaiolo has joined #archiveteam
Ctrl has quit IRC (Read error: Operation timed out)
w0rp has quit IRC (Read error: Operation timed out)
w0rp has joined #archiveteam
[19:06]
REiN^ has quit IRC (Read error: Operation timed out)
icedice2 has joined #archiveteam
icedice2 has quit IRC (Client Quit)
icedice has quit IRC (Read error: Operation timed out)
[19:22]
BobJonkma has joined #archiveteam [19:35]
don_ has quit IRC (Quit: WeeChat 1.6)
don_ has joined #archiveteam
[19:48]
...... (idle for 27mn)
schbirid has quit IRC (Quit: Leaving) [20:19]
jschwart has joined #archiveteam
RichardG has quit IRC (Read error: Connection reset by peer)
RichardG has joined #archiveteam
schbirid has joined #archiveteam
[20:29]
.... (idle for 17mn)
schbirid has quit IRC (Quit: Leaving) [20:51]
......... (idle for 44mn)
mabynogy has quit IRC (Quit: dpt.slasheva.com) [21:35]
REiN^ has joined #archiveteam
ZexaronS has joined #archiveteam
mabynogy has joined #archiveteam
[21:42]
BlueMax has joined #archiveteam [21:50]
..... (idle for 22mn)
mabynogy has quit IRC (Quit: dpt.slasheva.com) [22:12]
wp494 sets mode: +ooo FalconK Sanqui swebb
swebb sets mode: +o Jonimus
swebb sets mode: +o altlabel
swebb sets mode: +o balrog
swebb sets mode: +o beardicus
swebb sets mode: +o dcmorton
swebb sets mode: +o edsu
swebb sets mode: +o midas3
swebb sets mode: +o mistym
[22:22]
wp494oh.
welp, ok, guess there is some auto-opping after all
[22:22]
***pizzaiolo has quit IRC (pizzaiolo)
pizzaiolo has joined #archiveteam
pizzaiolo has quit IRC (Client Quit)
godane has quit IRC (Read error: Operation timed out)
pizzaiolo has joined #archiveteam
[22:33]
godane has joined #archiveteam
godane has quit IRC (Client Quit)
[22:49]
.... (idle for 15mn)
jschwart has quit IRC (Quit: Konversation terminated!) [23:04]
tomaspark has joined #archiveteam
tomaspark has quit IRC (Client Quit)
[23:18]
BlueMax has quit IRC (Leaving) [23:28]
REiN^ has quit IRC (Read error: Operation timed out) [23:34]
icedice has joined #archiveteam [23:43]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)