| Time |
Nickname |
Message |
|
00:07
🔗
|
|
RichardG_ is now known as RichardG |
|
00:24
🔗
|
|
filippo__ has joined #archiveteam |
|
00:36
🔗
|
|
JesseW has joined #archiveteam |
|
01:11
🔗
|
DFJustin |
atz0: we've already beeb grabbing it since earlier today |
|
01:26
🔗
|
* |
JesseW grumble ... LifeNDebt dropped by again, but I missed them. I wanted to point them at the work I did... |
|
01:35
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
01:38
🔗
|
|
JesseW has joined #archiveteam |
|
01:50
🔗
|
|
Mayonaise has joined #archiveteam |
|
02:29
🔗
|
|
aaaaaaaa_ has joined #archiveteam |
|
02:29
🔗
|
|
aaaaaaaaa has quit IRC (Read error: Connection reset by peer) |
|
02:30
🔗
|
|
Coderjoe has quit IRC (Read error: Operation timed out) |
|
02:31
🔗
|
|
aaaaaaaa_ is now known as aaaaaaaaa |
|
02:31
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
02:31
🔗
|
|
aaaaaaaaa has quit IRC (Client Quit) |
|
02:33
🔗
|
|
Coderjoe has joined #archiveteam |
|
02:46
🔗
|
|
robink has quit IRC (Ping timeout: 492 seconds) |
|
02:46
🔗
|
|
robink has joined #archiveteam |
|
02:54
🔗
|
|
koo5 has quit IRC (Remote host closed the connection) |
|
03:28
🔗
|
|
JesseW has joined #archiveteam |
|
03:28
🔗
|
|
chfoo has quit IRC (Remote host closed the connection) |
|
03:29
🔗
|
|
chfoo has joined #archiveteam |
|
04:20
🔗
|
|
SN4T14_ has quit IRC (Ping timeout: 369 seconds) |
|
04:36
🔗
|
|
Froggypwn has quit IRC (Ping timeout: 483 seconds) |
|
04:38
🔗
|
|
atz0 has quit IRC (Read error: Operation timed out) |
|
05:00
🔗
|
|
Froggypwn has joined #archiveteam |
|
05:16
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
05:24
🔗
|
|
Elegance has quit IRC (Read error: Connection reset by peer) |
|
05:25
🔗
|
|
Elegance has joined #archiveteam |
|
05:48
🔗
|
|
Smiley has quit IRC (Ping timeout: 252 seconds) |
|
05:49
🔗
|
* |
SketchCow has been packing up manuals to mail to backers all night. So many manuals |
|
05:49
🔗
|
SketchCow |
50 manuals to go |
|
05:53
🔗
|
|
khaoohs_ has quit IRC (Read error: Operation timed out) |
|
05:54
🔗
|
|
Start has joined #archiveteam |
|
05:57
🔗
|
|
Smiley has joined #archiveteam |
|
06:01
🔗
|
yipdw |
sounds like |
|
06:01
🔗
|
yipdw |
a manual process |
|
06:02
🔗
|
yipdw |
fuck I should have said manual labor |
|
06:16
🔗
|
|
Emcy has joined #archiveteam |
|
06:20
🔗
|
|
Emcy_ has quit IRC (Ping timeout: 483 seconds) |
|
06:20
🔗
|
|
Dark_Star has quit IRC (Read error: Operation timed out) |
|
06:25
🔗
|
|
Start_ has joined #archiveteam |
|
06:25
🔗
|
|
Start has quit IRC (Read error: Connection reset by peer) |
|
06:46
🔗
|
|
schbirid has joined #archiveteam |
|
07:04
🔗
|
|
primus104 has joined #archiveteam |
|
07:04
🔗
|
|
Start_ is now known as Start |
|
07:12
🔗
|
|
tsp_ has quit IRC (Read error: Operation timed out) |
|
07:13
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
07:18
🔗
|
|
SN4T14 has joined #archiveteam |
|
07:18
🔗
|
|
godane has quit IRC (Ping timeout: 252 seconds) |
|
07:24
🔗
|
|
khaoohs has joined #archiveteam |
|
07:41
🔗
|
|
atomotic has joined #archiveteam |
|
07:42
🔗
|
|
khaoohs_ has joined #archiveteam |
|
07:43
🔗
|
|
HCross has quit IRC (Quit: ZNC has crashed or something! I'LL BE BACK!) |
|
07:45
🔗
|
|
khaoohs has quit IRC (Read error: Operation timed out) |
|
08:46
🔗
|
|
PurpleSym has joined #archiveteam |
|
08:59
🔗
|
|
zenguy_pc has quit IRC (Connection closed) |
|
08:59
🔗
|
|
zenguy_pc has joined #archiveteam |
|
09:08
🔗
|
|
BlueMaxim has quit IRC (Read error: Connection reset by peer) |
|
09:30
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
09:42
🔗
|
|
Emcy_ has joined #archiveteam |
|
09:44
🔗
|
|
Emcy has quit IRC (Ping timeout: 310 seconds) |
|
10:00
🔗
|
|
Sum has quit IRC (Ping timeout: 483 seconds) |
|
10:00
🔗
|
|
anomie has quit IRC (Read error: Connection reset by peer) |
|
10:03
🔗
|
|
xk_id has quit IRC (Remote host closed the connection) |
|
10:07
🔗
|
|
anomie has joined #archiveteam |
|
10:20
🔗
|
|
xk_id has joined #archiveteam |
|
10:27
🔗
|
|
chazchaz has quit IRC (Read error: Operation timed out) |
|
10:30
🔗
|
|
chazchaz has joined #archiveteam |
|
10:42
🔗
|
|
Sum has joined #archiveteam |
|
10:53
🔗
|
|
Spring has joined #archiveteam |
|
10:56
🔗
|
|
atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) |
|
11:00
🔗
|
|
Sum has quit IRC (Read error: Operation timed out) |
|
11:02
🔗
|
|
Spring has quit IRC (Ping timeout: 483 seconds) |
|
11:03
🔗
|
|
Spring has joined #archiveteam |
|
11:12
🔗
|
|
robink has quit IRC (Ping timeout: 492 seconds) |
|
11:14
🔗
|
|
robink has joined #archiveteam |
|
11:34
🔗
|
|
primus104 has joined #archiveteam |
|
11:47
🔗
|
|
atomotic has joined #archiveteam |
|
12:04
🔗
|
|
Specular has joined #archiveteam |
|
12:05
🔗
|
|
vitzli has joined #archiveteam |
|
12:07
🔗
|
|
godane has joined #archiveteam |
|
12:07
🔗
|
|
Spring has quit IRC (Ping timeout: 483 seconds) |
|
12:14
🔗
|
|
vitzli has quit IRC (Client Quit) |
|
12:15
🔗
|
|
SmileyG has joined #archiveteam |
|
12:16
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
12:29
🔗
|
Sanqui |
ugh, the fact that wpull is broken right now is killing me |
|
12:29
🔗
|
Sanqui |
I wanted to archive something personally and delete it |
|
12:29
🔗
|
Sanqui |
asap |
|
12:29
🔗
|
Sanqui |
I'm not sure what to do now |
|
12:30
🔗
|
Sanqui |
downgrade python? |
|
12:50
🔗
|
|
pfallenop has joined #archiveteam |
|
12:53
🔗
|
schbirid |
grab some linux iso, run virtualbox |
|
12:53
🔗
|
|
pfallenop has quit IRC (Remote host closed the connection) |
|
12:53
🔗
|
|
Froggypwn has quit IRC (Read error: Operation timed out) |
|
12:54
🔗
|
|
Froggypwn has joined #archiveteam |
|
13:04
🔗
|
|
pfallenop has joined #archiveteam |
|
13:04
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
13:26
🔗
|
|
K4k has quit IRC (WeeChat 1.2) |
|
13:46
🔗
|
|
scyther has joined #archiveteam |
|
13:48
🔗
|
|
afics has quit IRC (Ping timeout: 252 seconds) |
|
13:48
🔗
|
|
Spring has joined #archiveteam |
|
13:48
🔗
|
|
afics has joined #archiveteam |
|
13:51
🔗
|
|
Specular has quit IRC (Ping timeout: 483 seconds) |
|
13:53
🔗
|
|
PurpleSym has quit IRC (Remote host closed the connection) |
|
14:02
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
14:03
🔗
|
|
tsp_ has joined #archiveteam |
|
14:11
🔗
|
|
PurpleSym has joined #archiveteam |
|
14:12
🔗
|
|
aliz has quit IRC (Remote host closed the connection) |
|
14:21
🔗
|
|
Spring has quit IRC (Quit: Leaving) |
|
14:24
🔗
|
|
aliz has joined #archiveteam |
|
14:24
🔗
|
|
aliz has quit IRC (Client Quit) |
|
14:30
🔗
|
|
aliz has joined #archiveteam |
|
14:40
🔗
|
|
Start has joined #archiveteam |
|
14:42
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
15:10
🔗
|
* |
midas hands yipdw sunglasses |
|
15:15
🔗
|
marvinw |
Sanqui: most distros should have a way to keep both python3.4 and python3.5 installed |
|
15:38
🔗
|
joepie91 |
haha |
|
15:38
🔗
|
joepie91 |
optimist |
|
15:38
🔗
|
joepie91 |
Sanqui: look at pyenv |
|
15:38
🔗
|
|
JesseW has joined #archiveteam |
|
15:41
🔗
|
|
primus104 has joined #archiveteam |
|
15:44
🔗
|
|
Morbus has quit IRC (Quit: http://www.disobey.com/) |
|
15:56
🔗
|
|
xk_id has quit IRC (Remote host closed the connection) |
|
15:57
🔗
|
|
HarryCros has joined #archiveteam |
|
15:57
🔗
|
|
Dark_Star has joined #archiveteam |
|
15:57
🔗
|
|
HarryCros is now known as HCross |
|
15:57
🔗
|
HCross |
there we go |
|
15:57
🔗
|
|
scyther has quit IRC (Quit: Leaving) |
|
16:03
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
16:04
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
16:05
🔗
|
|
JesseW has joined #archiveteam |
|
16:17
🔗
|
|
JesseW has quit IRC (Read error: Operation timed out) |
|
16:28
🔗
|
|
wyatt8740 has quit IRC (Remote host closed the connection) |
|
16:29
🔗
|
|
habi has joined #archiveteam |
|
16:48
🔗
|
|
habi has left |
|
16:52
🔗
|
|
robink has quit IRC (Ping timeout: 492 seconds) |
|
16:53
🔗
|
|
robink has joined #archiveteam |
|
16:56
🔗
|
|
beardicus has quit IRC (Remote host closed the connection) |
|
16:58
🔗
|
|
beardicus has joined #archiveteam |
|
16:59
🔗
|
|
philpem has joined #archiveteam |
|
17:05
🔗
|
|
beardicus has quit IRC (bye) |
|
17:05
🔗
|
|
beardicus has joined #archiveteam |
|
17:14
🔗
|
|
habi has joined #archiveteam |
|
17:16
🔗
|
|
slang has joined #archiveteam |
|
17:32
🔗
|
|
wyatt8740 has joined #archiveteam |
|
17:33
🔗
|
|
habi has left |
|
17:35
🔗
|
|
Morbus has joined #archiveteam |
|
17:46
🔗
|
|
helpme has joined #archiveteam |
|
17:47
🔗
|
helpme |
can i look deleted facebook account ? |
|
17:48
🔗
|
schbirid |
nope |
|
17:48
🔗
|
Dark_Star |
@helpme no, you can't, sorry |
|
17:48
🔗
|
helpme |
omg :( |
|
17:48
🔗
|
helpme |
thanks |
|
17:48
🔗
|
helpme |
good days |
|
17:48
🔗
|
|
helpme has quit IRC (Client Quit) |
|
18:03
🔗
|
|
aaaaaaaaa has joined #archiveteam |
|
18:07
🔗
|
|
Jonimus has quit IRC (WeeChat 1.3) |
|
18:08
🔗
|
|
jonimus has joined #archiveteam |
|
18:17
🔗
|
|
jonimus is now known as Jonimus |
|
18:36
🔗
|
|
SN4T14 has quit IRC (Quit: Leaving) |
|
18:54
🔗
|
|
Stilett0 has quit IRC (Ping timeout: 186 seconds) |
|
18:55
🔗
|
|
Stiletto has joined #archiveteam |
|
18:57
🔗
|
|
beardicus has quit IRC (Read error: Operation timed out) |
|
18:57
🔗
|
|
beardicus has joined #archiveteam |
|
19:04
🔗
|
|
godane has quit IRC (Ping timeout: 268 seconds) |
|
19:07
🔗
|
|
xk_id has joined #archiveteam |
|
19:14
🔗
|
|
xk_id has quit IRC (Remote host closed the connection) |
|
19:14
🔗
|
|
xk_id has joined #archiveteam |
|
19:16
🔗
|
|
scyther has joined #archiveteam |
|
19:17
🔗
|
|
godane has joined #archiveteam |
|
19:45
🔗
|
|
beardicus has quit IRC (bye) |
|
19:46
🔗
|
|
logan2 has quit IRC (Read error: Operation timed out) |
|
19:47
🔗
|
|
beardicus has joined #archiveteam |
|
19:55
🔗
|
|
logan has joined #archiveteam |
|
19:55
🔗
|
|
habi has joined #archiveteam |
|
19:59
🔗
|
|
Z__ has joined #archiveteam |
|
20:00
🔗
|
Z__ |
http://www.docstoc.com/ is shutting down in 2 months. may be worth looking into archiving them. |
|
20:03
🔗
|
tephra_ |
Not sure if it's been alerted here, coulnd't find anything on the wiki. The sunet ftp archive is being decomissoned |
|
20:03
🔗
|
tephra_ |
http://ftp.sunet.se/news.html |
|
20:04
🔗
|
|
Z__ has quit IRC (Client Quit) |
|
20:05
🔗
|
tephra_ |
It's a lot of mirroring of stuff (like distros et al) but also a lot of original content in swedish from the 90's |
|
20:05
🔗
|
|
Start has joined #archiveteam |
|
20:11
🔗
|
arkiver |
we're going to start the little comcast poject in a bit |
|
20:11
🔗
|
arkiver |
Start ^ |
|
20:12
🔗
|
|
toad1 has quit IRC (Read error: Operation timed out) |
|
20:15
🔗
|
Start |
ok, i'll do the remaining scrapes asap |
|
20:17
🔗
|
arkiver |
ok! |
|
20:33
🔗
|
|
habi has left |
|
20:45
🔗
|
|
PurpleSym has quit IRC (Remote host closed the connection) |
|
20:54
🔗
|
|
aaaaaaaa_ has joined #archiveteam |
|
20:58
🔗
|
schbirid |
i _think_ sunet was done long ago |
|
20:58
🔗
|
schbirid |
not sure though |
|
20:58
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:00
🔗
|
aaaaaaaa_ |
there was a concerted effort to get it in the effteepee channel, but I'm not sure if it finished or fizzled. |
|
21:01
🔗
|
arkiver |
ftp? |
|
21:01
🔗
|
arkiver |
comcast? |
|
21:01
🔗
|
|
aaaaaaaaa has quit IRC (Read error: Operation timed out) |
|
21:02
🔗
|
|
aaaaaaaa_ is now known as aaaaaaaaa |
|
21:02
🔗
|
aaaaaaaaa |
sorry, I was referring to the sunet ftp site |
|
21:04
🔗
|
arkiver |
sorry |
|
21:09
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
21:09
🔗
|
|
scyther has quit IRC (Read error: Connection reset by peer) |
|
21:11
🔗
|
DFJustin |
I'm sure we've gotten parts of it but it's huge so probably not the whole thing |
|
21:15
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
21:18
🔗
|
|
dcmorton has joined #archiveteam |
|
21:19
🔗
|
DFJustin |
that notice is from May 23, 2014? |
|
21:27
🔗
|
balrog |
sunet is still up |
|
21:39
🔗
|
|
godane has joined #archiveteam |
|
22:00
🔗
|
|
aaaaaaaa_ has joined #archiveteam |
|
22:00
🔗
|
|
aaaaaaaaa has quit IRC (Read error: Connection reset by peer) |
|
22:10
🔗
|
|
aaaaaaaa_ is now known as aaaaaaaaa |
|
22:10
🔗
|
|
Start has joined #archiveteam |
|
22:11
🔗
|
arkiver |
chfoo: yipdw: can you please create a rsync target on FOS for comcast? |
|
22:21
🔗
|
|
atz0 has joined #archiveteam |
|
22:21
🔗
|
|
atz0 has quit IRC (Client Quit) |
|
22:21
🔗
|
chfoo |
arkiver: ok, added |
|
22:26
🔗
|
|
Rickster has quit IRC (Ping timeout: 252 seconds) |
|
22:28
🔗
|
|
Rickster has joined #archiveteam |
|
22:35
🔗
|
arkiver |
thank you! |
|
22:36
🔗
|
arkiver |
And editing the projects.json works very well, thanks for that update! |
|
22:50
🔗
|
|
Zebranky_ has quit IRC (Read error: Operation timed out) |
|
22:54
🔗
|
|
cgs has joined #archiveteam |
|
22:56
🔗
|
cgs |
is anyone familiar with the warc python module? seems to be quite happy doing what I'd like to do, but it is skipping large portions of archives its opening for seemingly no reason. |
|
22:58
🔗
|
cgs |
for record in warc.open("internal.warc.gz") only makes it about 40MB through (the warc is 1GB). |
|
22:59
🔗
|
cgs |
ooh. https://github.com/internetarchive/warc/issues/21 |
|
23:04
🔗
|
|
Zebranky has joined #archiveteam |
|
23:07
🔗
|
cgs |
I'm completely stumped. |
|
23:08
🔗
|
cgs |
it's got to do with the gzip file, or the gzip library they are using. raw WARC iterated just fine. |
|
23:12
🔗
|
cgs |
unpacking the warc and repacking with gzip -1 seems to do the trick. |
|
23:20
🔗
|
cgs |
so it has a custom "gzip2" wrapper which is sort of sketchy. |
|
23:31
🔗
|
cgs |
think this is a 32bit thing at least in origin. unzipped we are sitting at 4.46GB, which fucks with the length in the gzip format which is a 4 byte integer. |
|
23:38
🔗
|
|
xk_id has quit IRC (Remote host closed the connection) |
|
23:41
🔗
|
aaaaaaaaa |
cgs: if you are extracting stuff from warcs, warcat works nicely |
|
23:42
🔗
|
aaaaaaaaa |
https://github.com/chfoo/warcat |
|
23:43
🔗
|
cgs |
that looks promising |
|
23:48
🔗
|
cgs |
aaaaaaaaa: perfect, thank you |
|
23:50
🔗
|
aaaaaaaaa |
you are welcome. |