Time |
Nickname |
Message |
00:00
π
|
limebyte |
arkiver, wow |
00:00
π
|
limebyte |
how to become a target |
00:00
π
|
limebyte |
tell me moah |
00:01
π
|
SketchCow |
3 major torrentings removed |
00:09
π
|
|
Start has joined #archiveteam |
00:09
π
|
bsmith093 |
SketchCow: like what? |
00:12
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
00:14
π
|
|
MMovie has joined #archiveteam |
00:16
π
|
bsmith093 |
etext.org says IA has a mirror of them but i'm looking and all i see are 302 erroes |
00:18
π
|
bsmith093 |
idk what happened, but now it's working fine. |
00:20
π
|
SketchCow |
n n n |
00:20
π
|
SketchCow |
I just mean on FOS |
00:22
π
|
arkiver |
limebyte: a target for ftp-grab should I think at least have 4 TB and 500Mbit |
00:23
π
|
limebyte |
wow |
00:23
π
|
limebyte |
such moneys dat costa |
00:23
π
|
arkiver |
please talk normal |
00:23
π
|
xmc |
NO |
00:25
π
|
SketchCow |
I'm on arkiver's side here |
00:25
π
|
SketchCow |
It's bad enough 80% of you have mental health issues |
00:25
π
|
SketchCow |
We have to have some level of communication standards |
00:25
π
|
SketchCow |
Or next thing you know.... |
00:25
π
|
SketchCow |
THIRD PERSON SELF-REFERENCE |
00:26
π
|
* |
SketchCow oooOOOOoOOOOOOo waves hands |
00:27
π
|
|
ndizzle has joined #archiveteam |
00:28
π
|
|
Smiley has joined #archiveteam |
00:29
π
|
|
SketchCo1 has joined #archiveteam |
00:29
π
|
|
edsu_ has joined #archiveteam |
00:29
π
|
|
RichardG has joined #archiveteam |
00:30
π
|
arkiver |
Haha |
00:30
π
|
* |
arkiver agrees |
00:30
π
|
|
Start has quit IRC (Read error: Connection reset by peer) |
00:30
π
|
|
SketchCow has quit IRC (Read error: Connection reset by peer) |
00:30
π
|
|
Start has joined #archiveteam |
00:30
π
|
|
RichardG_ has quit IRC (Ping timeout: 249 seconds) |
00:30
π
|
|
edsu has quit IRC (Ping timeout: 249 seconds) |
00:30
π
|
|
jk[SVP] has quit IRC (Ping timeout: 249 seconds) |
00:30
π
|
xmc |
for the record i also request comprehensible and non-trollish speech |
00:30
π
|
xmc |
unfortunately for everyone i seem to have lost my snail hat |
00:30
π
|
xmc |
(@) |
00:30
π
|
|
dxrt- has quit IRC (Ping timeout: 260 seconds) |
00:30
π
|
|
sigkell has quit IRC (Ping timeout: 260 seconds) |
00:30
π
|
SketchCo1 |
I'm not channel operator |
00:30
π
|
SketchCo1 |
This is the time for revolution |
00:30
π
|
|
SketchCo1 is now known as SketchCow |
00:30
π
|
xmc |
:O |
00:30
π
|
FalconK |
you mean +o |
00:30
π
|
xmc |
yes |
00:31
π
|
FalconK |
:P |
00:31
π
|
xmc |
that |
00:31
π
|
* |
FalconK steals a snail and wears it like a hat |
00:31
π
|
|
jk[SVP] has joined #archiveteam |
00:32
π
|
|
SmileyG has quit IRC (Ping timeout: 260 seconds) |
00:32
π
|
FalconK |
still getting 125-200 kB/s on uploads to fos, by the way. so it's better than it was. |
00:32
π
|
|
ndiddy has joined #archiveteam |
00:33
π
|
|
bauruine has quit IRC (Ping timeout: 260 seconds) |
00:33
π
|
|
joepie91 has quit IRC (Ping timeout: 260 seconds) |
00:33
π
|
xmc |
slightly |
00:33
π
|
|
bauruine has joined #archiveteam |
00:34
π
|
xmc |
well, that's about a megabit, transatlantic, unpleasant but about par? |
00:34
π
|
|
sigkell has joined #archiveteam |
00:35
π
|
|
joepie91 has joined #archiveteam |
00:36
π
|
SketchCow |
arkiver: op me |
00:36
π
|
* |
snape is in ΕΏavour o erudite diΕΏcourΕΏe in the faΕΏhion of our Georgian forefathers, what? |
00:38
π
|
snape |
Goddammit, need more coffee. >.< |
00:39
π
|
|
xXx_ndidd has quit IRC (Read error: Operation timed out) |
00:40
π
|
|
xXx_ndidd has joined #archiveteam |
00:43
π
|
|
ndizzle has quit IRC (Read error: Operation timed out) |
00:43
π
|
* |
DFJustin ΕΏeconds the Motion |
00:44
π
|
FalconK |
a megabit would be about 0.1% of nominal |
00:44
π
|
FalconK |
this provider must have unbelievably shitty peering, or fos is still overloaded. |
00:47
π
|
|
mhazinsk has quit IRC (Read error: Operation timed out) |
00:47
π
|
|
Jonimus has quit IRC (Read error: Operation timed out) |
00:47
π
|
* |
xmc inspects the weathermap |
00:47
π
|
xmc |
https://monitor.archive.org/weathermap/weathermap.html |
00:47
π
|
xmc |
what connection do you come in on? |
00:48
π
|
xmc |
actually it all looks to be in non-overload condition |
00:48
π
|
|
vegbrasil has quit IRC (Read error: Operation timed out) |
00:48
π
|
FalconK |
it sends to rsync://fos.textfiles.com/archivebot/ |
00:48
π
|
|
beardicus has quit IRC (Read error: Operation timed out) |
00:48
π
|
|
xXx_ndidd has quit IRC (Ping timeout: 492 seconds) |
00:49
π
|
|
aMunster has quit IRC (Read error: Operation timed out) |
00:49
π
|
FalconK |
I don't know if that is even on the map? |
00:50
π
|
|
rossdylan has quit IRC (Read error: Operation timed out) |
00:50
π
|
FalconK |
server is also teamarchive0.fnf.archive.org |
00:50
π
|
xmc |
traceroute and see if you recognize anything |
00:50
π
|
xmc |
but none of those arrows coming from the internet are warm colors so it's not that |
00:50
π
|
FalconK |
via ipipserver.core.archive.org |
00:51
π
|
xmc |
you should be able to tell whether you're coming through HE or ISC |
00:51
π
|
FalconK |
ISC |
00:51
π
|
xmc |
that's about all i can help you with |
00:51
π
|
FalconK |
er actually |
00:51
π
|
FalconK |
goes via both HE and ISC |
00:51
π
|
|
w0rp has quit IRC (Ping timeout: 252 seconds) |
00:51
π
|
FalconK |
er, isc.10gigabitethernet5-2.core1.pao1.he.net. |
00:52
π
|
FalconK |
so just HE, then. |
00:52
π
|
FalconK |
I should run a speedtest to near there and see what is up |
00:52
π
|
|
ndiddy has quit IRC (Read error: Operation timed out) |
00:55
π
|
|
w0rp has joined #archiveteam |
00:56
π
|
* |
snape notes the lack of IPv6 ΕΏupport wfor FOS with mild diΕΏapproval. |
00:57
π
|
xmc |
you should change your name to ΕΏnape |
00:58
π
|
snape |
I tried, but it "is not a legal nickname". :( |
01:00
π
|
|
nwf has quit IRC (Ping timeout: 633 seconds) |
01:00
π
|
|
closure has quit IRC (Ping timeout: 633 seconds) |
01:02
π
|
xmc |
also you can't use that letter at the beginning of a word |
01:02
π
|
xmc |
woop woop woop off-topic siren |
01:07
π
|
|
aMunster has joined #archiveteam |
01:10
π
|
|
vegbrasil has joined #archiveteam |
01:10
π
|
|
beardicus has joined #archiveteam |
01:11
π
|
|
closure has joined #archiveteam |
01:12
π
|
|
nwf has joined #archiveteam |
01:18
π
|
|
Jonimus has joined #archiveteam |
01:20
π
|
|
pfallenop has quit IRC (Ping timeout: 260 seconds) |
01:23
π
|
|
mhazinsk has joined #archiveteam |
01:36
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
01:37
π
|
|
MMovie has joined #archiveteam |
01:51
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
01:52
π
|
|
philpem has quit IRC (Ping timeout: 260 seconds) |
01:52
π
|
|
MMovie has joined #archiveteam |
02:01
π
|
|
fpoee has quit IRC (Read error: Connection reset by peer) |
02:01
π
|
|
plog99 has joined #archiveteam |
02:22
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
02:23
π
|
|
JesseW has joined #archiveteam |
02:23
π
|
|
MMovie has joined #archiveteam |
02:30
π
|
|
Nemo_bis has quit IRC (Ping timeout: 252 seconds) |
02:34
π
|
|
ndiddy has joined #archiveteam |
02:39
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
02:41
π
|
|
MMovie has joined #archiveteam |
02:55
π
|
|
plog99 has quit IRC (Ping timeout: 250 seconds) |
02:57
π
|
|
Chorca has quit IRC (Ping timeout: 252 seconds) |
02:58
π
|
|
plog99 has joined #archiveteam |
02:59
π
|
|
Chorca has joined #archiveteam |
03:12
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
03:14
π
|
|
MMovie has joined #archiveteam |
03:31
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
03:33
π
|
|
MMovie has joined #archiveteam |
03:51
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
03:52
π
|
|
MMovie has joined #archiveteam |
04:02
π
|
|
Burak has quit IRC (Ping timeout: 255 seconds) |
04:09
π
|
|
tomwsmf-a has quit IRC (Read error: Operation timed out) |
04:09
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
04:11
π
|
|
MMovie has joined #archiveteam |
04:28
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
04:30
π
|
|
MMovie has joined #archiveteam |
04:31
π
|
|
dxrt- has joined #archiveteam |
04:31
π
|
|
dxrt sets mode: +o dxrt- |
04:32
π
|
|
dxrt sets mode: +o SketchCow |
04:44
π
|
|
bwn has quit IRC (Read error: Operation timed out) |
04:45
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
04:46
π
|
|
MMovie has joined #archiveteam |
05:04
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
05:05
π
|
|
MMovie has joined #archiveteam |
05:20
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
05:20
π
|
|
Sk1d has quit IRC (Ping timeout: 250 seconds) |
05:21
π
|
|
MMovie has joined #archiveteam |
05:24
π
|
|
Chorca has quit IRC (Quit: leaving) |
05:31
π
|
|
Sk1d has joined #archiveteam |
05:35
π
|
|
Sk1d has quit IRC (Ping timeout: 200 seconds) |
05:35
π
|
|
Sk1d has joined #archiveteam |
05:53
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
05:56
π
|
|
MMovie has joined #archiveteam |
06:13
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
06:15
π
|
|
MMovie has joined #archiveteam |
06:17
π
|
|
scyther has joined #archiveteam |
06:31
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
06:33
π
|
|
MMovie has joined #archiveteam |
06:48
π
|
SketchCow |
You know what I love about "notes the lack of IPv6 support wfor FOS with mild disapproval" |
06:48
π
|
SketchCow |
How it tells me 30 other things about you |
06:48
π
|
SketchCow |
And how I don't want to know any of them |
06:49
π
|
* |
SketchCow is getting, you know, work done. |
06:49
π
|
SketchCow |
work. |
06:49
π
|
SketchCow |
Also, Rocket League is the best $20 value in videogames this year. |
06:53
π
|
|
snape has left forget I said anything then; adieu |
06:56
π
|
|
db48x has joined #archiveteam |
06:57
π
|
|
WinterFox has joined #archiveteam |
07:09
π
|
|
JesseW has quit IRC (Ping timeout: 252 seconds) |
07:12
π
|
|
Nemo_bis has joined #archiveteam |
07:28
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
07:30
π
|
|
MMovie has joined #archiveteam |
07:36
π
|
|
robink has joined #archiveteam |
07:56
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
07:57
π
|
|
MMovie has joined #archiveteam |
08:01
π
|
midas |
how this often goes: http://i.imgur.com/43PYBxi.gif |
08:09
π
|
BnA-Robin |
HCross: depends on where we run it, and that depends a bit on if we need speed or diskspace or ip addresses. Also would depend on total bandwidth needed for the project. Unmetered connections vary between 100-300 Mbit/s up/down, metered 1,2 Gbit/s down and 300 Mbit/s up to paris. |
08:13
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
08:15
π
|
|
MMovie has joined #archiveteam |
08:19
π
|
|
arkiver2 has joined #archiveteam |
08:24
π
|
|
schbirid has joined #archiveteam |
08:31
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
08:33
π
|
|
MMovie has joined #archiveteam |
08:44
π
|
|
bwn has joined #archiveteam |
08:45
π
|
|
metalcamp has joined #archiveteam |
08:51
π
|
|
atomotic has joined #archiveteam |
08:54
π
|
|
Atom__ has quit IRC (Ping timeout: 252 seconds) |
09:02
π
|
|
megaminxw has joined #archiveteam |
09:04
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
09:05
π
|
|
MMovie has joined #archiveteam |
09:23
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
09:23
π
|
|
MMovie has joined #archiveteam |
09:40
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
09:41
π
|
|
MMovie has joined #archiveteam |
09:54
π
|
|
arkiver2 has quit IRC (Ping timeout: 252 seconds) |
10:14
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
10:15
π
|
|
MMovie has joined #archiveteam |
10:20
π
|
|
SirCmpwn has quit IRC (Ping timeout: 260 seconds) |
10:27
π
|
|
metalcamp has quit IRC (Ping timeout: 252 seconds) |
10:31
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
10:32
π
|
|
MMovie has joined #archiveteam |
10:34
π
|
|
vitzli has joined #archiveteam |
10:48
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
10:49
π
|
|
metalcamp has joined #archiveteam |
10:50
π
|
|
MMovie has joined #archiveteam |
10:52
π
|
|
SirCmpwn has joined #archiveteam |
10:57
π
|
|
pfallenop has joined #archiveteam |
11:05
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
11:07
π
|
|
MMovie has joined #archiveteam |
11:25
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
11:26
π
|
|
MMovie has joined #archiveteam |
11:26
π
|
|
metalcamp has quit IRC (Ping timeout: 252 seconds) |
11:28
π
|
|
vegbrasil has quit IRC (Read error: Operation timed out) |
11:37
π
|
|
ohhdemgir has joined #archiveteam |
11:41
π
|
|
scyther has quit IRC (Quit: Leaving) |
11:46
π
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
11:54
π
|
|
vegbrasil has joined #archiveteam |
12:12
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
12:13
π
|
|
MMovie has joined #archiveteam |
12:26
π
|
|
WinterFox has quit IRC (Remote host closed the connection) |
12:30
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
12:31
π
|
|
MMovie has joined #archiveteam |
12:36
π
|
|
atomotic has joined #archiveteam |
12:42
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
12:44
π
|
|
MMovie has joined #archiveteam |
12:47
π
|
|
scyther has joined #archiveteam |
13:00
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
13:01
π
|
|
MMovie has joined #archiveteam |
13:12
π
|
limebyte |
SketchCow, needs to be configured |
13:12
π
|
limebyte |
mens more workz |
13:25
π
|
|
megaminxw has quit IRC (Quit: Leaving.) |
13:43
π
|
|
noahc has joined #archiveteam |
13:56
π
|
|
RichardG has quit IRC (Ping timeout: 633 seconds) |
14:02
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
14:03
π
|
|
MMovie has joined #archiveteam |
14:20
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
14:22
π
|
|
MMovie has joined #archiveteam |
14:22
π
|
|
Zei-Pii has joined #archiveteam |
14:38
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
14:39
π
|
|
MMovie has joined #archiveteam |
14:57
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
14:59
π
|
|
MMovie has joined #archiveteam |
15:03
π
|
|
Start has quit IRC (Quit: Disconnected.) |
15:03
π
|
|
Tomcat_ has joined #archiveteam |
15:14
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
15:15
π
|
|
MMovie has joined #archiveteam |
15:17
π
|
|
noahc has quit IRC (Ping timeout: 255 seconds) |
15:20
π
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
15:31
π
|
|
mismatch_ has quit IRC (Ping timeout: 633 seconds) |
15:31
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
15:31
π
|
SketchCow |
archive.org is super-hella-down for the moment. |
15:32
π
|
|
MMovie has joined #archiveteam |
15:37
π
|
|
Tomcat_ has quit IRC (Remote host closed the connection) |
15:42
π
|
|
SketchCo1 has joined #archiveteam |
15:44
π
|
|
SketchCow has quit IRC (Read error: Operation timed out) |
15:53
π
|
|
Start has joined #archiveteam |
15:55
π
|
|
ndiddy has quit IRC (Read error: Operation timed out) |
16:01
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
16:03
π
|
|
MMovie has joined #archiveteam |
16:05
π
|
|
arkiver sets mode: +o SketchCo1 |
16:05
π
|
arkiver |
There you go |
16:08
π
|
swebb |
Can someone op me? |
16:08
π
|
|
arkiver sets mode: +o swebb |
16:08
π
|
|
swebb sets mode: +o DFJustin |
16:08
π
|
|
swebb sets mode: +o Jonimus |
16:08
π
|
|
swebb sets mode: +o SadDM |
16:08
π
|
|
swebb sets mode: +o antomati_ |
16:08
π
|
|
swebb sets mode: +o balrog |
16:08
π
|
|
swebb sets mode: +o brayden_ |
16:08
π
|
|
swebb sets mode: +o edsu_ |
16:08
π
|
|
balrog sets mode: +o Lord_Nigh |
16:08
π
|
|
swebb sets mode: +o xmc |
16:08
π
|
swebb |
Thanks |
16:08
π
|
arkiver |
Nice |
16:10
π
|
|
arkiver sets mode: +o HCross |
16:10
π
|
|
arkiver sets mode: +o yipdw |
16:11
π
|
|
godane has quit IRC (Ping timeout: 252 seconds) |
16:13
π
|
|
LastNinja has joined #archiveteam |
16:21
π
|
|
mismatch_ has joined #archiveteam |
16:21
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
16:22
π
|
|
MMovie has joined #archiveteam |
16:25
π
|
|
atomotic has joined #archiveteam |
16:25
π
|
|
godane has joined #archiveteam |
16:28
π
|
|
RichardG has joined #archiveteam |
16:37
π
|
|
godane has quit IRC (Quit: Leaving.) |
16:40
π
|
|
metalcamp has joined #archiveteam |
16:41
π
|
phuzion |
SketchCo1: I miiiiiiiiiight have an idea of why FOS is getting destroyed so frequently, but it's just a shot in the dark. Is it the CPU that's completely overworked? |
16:43
π
|
phuzion |
Because it looks like most of the projects use rsync with --compress-level=9, which beats up CPU pretty good on both ends of the transfer. |
16:45
π
|
|
godane has joined #archiveteam |
16:48
π
|
|
pfallenop has quit IRC (Remote host closed the connection) |
16:48
π
|
|
pfallenop has joined #archiveteam |
16:50
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
16:51
π
|
|
MMovie has joined #archiveteam |
17:01
π
|
|
LastNinja has quit IRC (Ping timeout: 260 seconds) |
17:05
π
|
|
JesseW has joined #archiveteam |
17:06
π
|
|
Start has quit IRC (Quit: Disconnected.) |
17:16
π
|
|
JesseW has quit IRC (Quit: Leaving.) |
17:22
π
|
|
noahc has joined #archiveteam |
17:22
π
|
noahc |
SketchCow: Any progress on http://warctozip.archive.org coming back online? I doubt there is much I can do, but anything I can do to help make it happen? |
17:23
π
|
MrRadar |
noahc: Do you need a specific WARC converted to a zip? |
17:23
π
|
noahc |
Yeah! Can you do that? |
17:23
π
|
noahc |
Or tell me how? |
17:24
π
|
MrRadar |
The code is on GitHub so I could probably run the service locally: https://github.com/alard/warctozip-service |
17:24
π
|
noahc |
I'm not sure if I can get the file or not...actually. |
17:25
π
|
noahc |
http://warctozip.archive.org/1324480184-1750974327/webshots.com-user-bblum08-20121124-040843.zip/http://archive.org/download/webshots-freeze-frame-20121124042939/webshots-20121124042939.megawarc.warc.gz , but the domain is down. |
17:25
π
|
xmc |
the http://archive.org/... bit is what you want to download |
17:25
π
|
xmc |
and then run warctozip on it? |
17:25
π
|
xmc |
er, nvm, i don't know how this tool works |
17:25
π
|
noahc |
Oh, well, maybe I can figure that out. |
17:26
π
|
xmc |
the warctozip tool takes a byte range, which is the pair of big numbers there |
17:26
π
|
xmc |
so you don't have to download the whole thing |
17:26
π
|
noahc |
ahh, yeah, it's like 53GB for the megawarc file. |
17:26
π
|
noahc |
But if I downloaded the whole thing, that'd be fine too. |
17:27
π
|
noahc |
As long as I can get the specific user I wanted out of it. |
17:27
π
|
xmc |
yeah, but you can save time and bandwidth by running warctozip and giving it the byte range :) |
17:27
π
|
arkiver |
what do you want to get exactly? |
17:27
π
|
arkiver |
pictures from to account or such a thing? |
17:27
π
|
arkiver |
the* |
17:27
π
|
noahc |
Yeah, so from here: http://ia601601.us.archive.org/14/items/webshots-freeze-frame-index/index.html |
17:28
π
|
noahc |
Getting user bblum08 or less likely bmblum |
17:29
π
|
noahc |
xmc: how would I get the byte range? |
17:29
π
|
xmc |
as i said earlier: <xmc> the warctozip tool takes a byte range, which is the pair of big numbers there |
17:29
π
|
xmc |
in the url i mean |
17:29
π
|
noahc |
Ahh, that's what I suspected. |
17:30
π
|
noahc |
But, aren't those dates 2012.... |
17:30
π
|
xmc |
inspecting urls for semantic content should really be taught in schools |
17:30
π
|
noahc |
Or I'm an idiot. |
17:30
π
|
swebb |
Full AlJazeera Network Crawl update: approx 109G of content so-far, 1.5M urls crawled, 0.5M urls still queued |
17:30
π
|
noahc |
132...-175. |
17:30
π
|
xmc |
2012-11-24 T 04:29:39 isn't a date? |
17:30
π
|
xmc |
yeah |
17:30
π
|
noahc |
DateTime... |
17:31
π
|
noahc |
Okay, let me dick around with this over my lunch break and see how far I can get. |
17:33
π
|
noahc |
Thanks for the help everyone. |
17:34
π
|
xmc |
def |
17:41
π
|
|
atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzzβ¦) |
17:47
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
17:48
π
|
noahc |
There is a 90% chance I have this thing working.... |
17:48
π
|
noahc |
Thanks again! |
17:48
π
|
|
MMovie has joined #archiveteam |
17:49
π
|
|
philpem has joined #archiveteam |
17:54
π
|
xmc |
yay |
17:58
π
|
noahc |
I'm not quite there yet. I'm getting files, but the website claims I should be getting 407MB, but I'm getting less than 100MB. It should be as simple as just replacing http://warctozip.archive.org/ with localhost:5000/ right? |
17:58
π
|
xmc |
should be yes |
18:00
π
|
MrRadar |
noahc: I downloaded, extracted, and recompressed the WARC for you; I'm uploading it right now |
18:01
π
|
noahc |
Thanks MrRadar! |
18:01
π
|
noahc |
Did you do something other than what I did? |
18:01
π
|
noahc |
If you take the byte range 175 - 132, you get 43. I have 42.7MB on disk. Do I need to make my range bigger? |
18:03
π
|
|
vitzli has quit IRC (Leaving) |
18:05
π
|
|
SketchCo1 is now known as SketchCow |
18:05
π
|
|
tomwsmf-a has joined #archiveteam |
18:07
π
|
MrRadar |
noahc: I downloaded the file with curl (which supports byte range queries) then extracted it with warcat and compressed the result into a zip file |
18:08
π
|
MrRadar |
So, I did it all manually |
18:09
π
|
noahc |
Oh, okay. I guess there is more than one way to skin a cat.... |
18:09
π
|
noahc |
I do appreciate your help though. |
18:12
π
|
xmc |
skin a warc you mean :P |
18:14
π
|
MrRadar |
https://2by2.info/blip/webshots-20121124042939.megawarc.1324480184-1750974327.zip |
18:14
π
|
noahc |
Yes. |
18:14
π
|
noahc |
Skin a warc... |
18:21
π
|
noahc |
Thanks, got it! |
18:21
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
18:23
π
|
|
MMovie has joined #archiveteam |
18:26
π
|
|
scyther has quit IRC (Read error: Connection reset by peer) |
18:26
π
|
|
scyther has joined #archiveteam |
18:37
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
18:37
π
|
|
Deewiant_ has joined #archiveteam |
18:38
π
|
|
Sk1d has quit IRC (hub.se efnet.portlane.se) |
18:38
π
|
|
altlabel has quit IRC (hub.se efnet.portlane.se) |
18:38
π
|
|
filippo__ has quit IRC (hub.se efnet.portlane.se) |
18:38
π
|
|
Fletcher_ has quit IRC (hub.se efnet.portlane.se) |
18:38
π
|
|
Deewiant has quit IRC (hub.se efnet.portlane.se) |
18:38
π
|
|
Gfy has quit IRC (hub.se efnet.portlane.se) |
18:39
π
|
|
Sk2d has joined #archiveteam |
18:39
π
|
|
MMovie has joined #archiveteam |
18:41
π
|
|
Start has joined #archiveteam |
18:48
π
|
|
maseck has quit IRC (Remote host closed the connection) |
18:51
π
|
|
maseck has joined #archiveteam |
18:53
π
|
|
Sk2d is now known as Sk1d |
19:02
π
|
|
bsmith093 has quit IRC (Ping timeout: 190 seconds) |
19:09
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
19:10
π
|
|
Start has quit IRC (Quit: Disconnected.) |
19:11
π
|
|
MMovie has joined #archiveteam |
19:21
π
|
|
Start has joined #archiveteam |
19:22
π
|
|
filippo__ has joined #archiveteam |
19:27
π
|
|
altlabel has joined #archiveteam |
19:28
π
|
|
noahc has quit IRC (Ping timeout: 255 seconds) |
19:29
π
|
|
bwn has quit IRC (Read error: Operation timed out) |
19:38
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
19:39
π
|
|
MMovie has joined #archiveteam |
19:43
π
|
|
Deewiant_ has quit IRC (Killed (hub.se (Nick collision (new)))) |
19:43
π
|
|
Sk1d has quit IRC (Killed (hub.se (Nick collision (new)))) |
19:43
π
|
|
Gfy has joined #archiveteam |
19:43
π
|
|
Sk1d has joined #archiveteam |
19:51
π
|
|
bwn has joined #archiveteam |
20:00
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
20:00
π
|
|
MMovie has joined #archiveteam |
20:10
π
|
|
megaminxw has joined #archiveteam |
20:27
π
|
|
Zei-Pii has quit IRC (Ping timeout: 362 seconds) |
20:29
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
20:29
π
|
|
MMovie has joined #archiveteam |
20:36
π
|
|
Boppen has joined #archiveteam |
20:43
π
|
|
megaminxw has quit IRC (Quit: Leaving.) |
20:45
π
|
|
Start has quit IRC (Quit: Disconnected.) |
20:56
π
|
|
ndiddy has joined #archiveteam |
21:00
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
21:02
π
|
|
robink has quit IRC (Ping timeout: 260 seconds) |
21:02
π
|
|
MMovie has joined #archiveteam |
21:13
π
|
|
scyther has quit IRC (Quit: Leaving) |
21:14
π
|
|
Boppen has quit IRC (hub.se irc.du.se) |
21:14
π
|
|
robink has joined #archiveteam |
21:18
π
|
|
Tomcat_ has joined #archiveteam |
21:21
π
|
|
metalcamp has quit IRC (Ping timeout: 252 seconds) |
21:30
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
21:31
π
|
|
MMovie has joined #archiveteam |
21:37
π
|
aliz |
Are the stats for each project saved? |
21:38
π
|
aliz |
Would be nice to generate a badge or a diploma from the stats, like diploma.php?nick=aliz&project=googlecode |
21:38
π
|
xmc |
i think so? they're usually removed from the live tracker after a while because disk space |
21:39
π
|
|
schbirid has quit IRC (Quit: Leaving) |
21:39
π
|
yipdw |
as far as I know, nobody archives the tracker scoreboards, and once we purge them from the tracker they're gone from that |
21:40
π
|
xmc |
i don't have an export-and-save cronjob or anything |
21:41
π
|
aliz |
some summary stats shouldn't take up to much space, like project|nick|size|items |
21:41
π
|
yipdw |
there is a backup task, I don't know if it's run |
21:41
π
|
FalconK |
:D |
21:41
π
|
yipdw |
anyway if someone would like to grab the pages I don't think anyone would mind |
21:42
π
|
xmc |
maybe it'd be good to keep chain-of-custody records for jobs? |
21:42
π
|
yipdw |
they should render reasonably even without Javascript support |
21:42
π
|
xmc |
maybe it'd be good to not keep them? |
21:42
π
|
xmc |
???? |
21:42
π
|
aliz |
is there someone official from archivteam that could "sign" the diploma I would think it would be a nice gesture |
21:43
π
|
yipdw |
everyone is in archive team, so you can sign your own |
21:43
π
|
xmc |
^ |
21:43
π
|
xmc |
if you want to be all fancy you can take it to your bank and have it notarized or something |
21:49
π
|
arkiver |
yipdw: logs are always saved right? |
21:49
π
|
yipdw |
they're saved in wpull.log, I don't think they're simultaneously written to the metawarc's wpull log record |
21:49
π
|
arkiver |
I mean the tracker logs of incoming items |
21:49
π
|
yipdw |
oh |
21:49
π
|
yipdw |
yeah |
21:50
π
|
arkiver |
ok |
21:51
π
|
arkiver |
I think a little stats image would be nice |
21:51
π
|
arkiver |
people might use it on forums |
21:51
π
|
MrRadar |
The irony, the ArchiveTeam doesn't save its own history |
21:52
π
|
arkiver |
Would make us more known on the internet and the user can show off the GBs he/she did |
21:52
π
|
MrRadar |
:P |
21:55
π
|
|
Emcy has joined #archiveteam |
21:56
π
|
|
Tomcat_ has quit IRC (Remote host closed the connection) |
21:56
π
|
|
Emcy_ has quit IRC (Read error: Operation timed out) |
22:00
π
|
JW_work |
I don't think "making us more known on the internet" is a particularly *good* thing. |
22:00
π
|
FalconK |
it would sure help more people make informed decisions about whether they approve, but really |
22:00
π
|
FalconK |
you're right |
22:01
π
|
JW_work |
There a quite a few things we do that we couldn't do if our "known on the internet" quotient rose above various levels. |
22:02
π
|
JW_work |
And with regards to "anyone official" β we try pretty hard to specifically avoid the existence of people who are designated as "official", AFAIK. |
22:03
π
|
|
Froggypwn has quit IRC (Read error: Connection reset by peer) |
22:05
π
|
|
filippo__ has quit IRC (Ping timeout: 252 seconds) |
22:05
π
|
|
BnA-Rob1n has joined #archiveteam |
22:06
π
|
|
Stilett0 has joined #archiveteam |
22:06
π
|
|
w0rp has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
ats has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
thefinn93 has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
Peetz0r has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
dashcloud has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
Lord_Nigh has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
nertzy2 has quit IRC (Ping timeout: 252 seconds) |
22:06
π
|
|
dashcloud has joined #archiveteam |
22:07
π
|
|
Stiletto has quit IRC (Ping timeout: 252 seconds) |
22:07
π
|
|
nekomune has quit IRC (Ping timeout: 252 seconds) |
22:07
π
|
|
Froggypwn has joined #archiveteam |
22:08
π
|
|
nertzy has joined #archiveteam |
22:08
π
|
|
Lord_Nigh has joined #archiveteam |
22:09
π
|
|
w0rp has joined #archiveteam |
22:09
π
|
|
thefinn93 has joined #archiveteam |
22:09
π
|
|
balrog sets mode: +o Lord_Nigh |
22:09
π
|
|
filippo__ has joined #archiveteam |
22:10
π
|
|
nekomune has joined #archiveteam |
22:11
π
|
|
BnA-Rob1n has quit IRC (Quit: Bye!) |
22:11
π
|
|
ats has joined #archiveteam |
22:12
π
|
|
Peetz0r has joined #archiveteam |
22:12
π
|
|
BnA-Rob1n has joined #archiveteam |
22:17
π
|
xmc |
ehhh |
22:17
π
|
xmc |
they're typically more useless than anything else |
22:18
π
|
|
acridAxid has quit IRC (marauder) |
22:18
π
|
|
Froggypwn has quit IRC (Read error: Connection reset by peer) |
22:19
π
|
|
acridAxid has joined #archiveteam |
22:20
π
|
|
nekomune has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
winr4r has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
bai has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
MrRadar has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
Baljem_ has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
bai has joined #archiveteam |
22:22
π
|
|
Baljem has joined #archiveteam |
22:22
π
|
|
filippo__ has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
Simpbrai_ has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
Fusl has quit IRC (Ping timeout: 252 seconds) |
22:22
π
|
|
Simpbrai_ has joined #archiveteam |
22:23
π
|
|
espes__ has quit IRC (Ping timeout: 252 seconds) |
22:24
π
|
|
Zebranky has quit IRC (Ping timeout: 252 seconds) |
22:24
π
|
|
Zebranky has joined #archiveteam |
22:24
π
|
|
MrRadar has joined #archiveteam |
22:24
π
|
|
SketchCow has quit IRC (Ping timeout: 252 seconds) |
22:24
π
|
|
BnA-Robin has quit IRC (Ping timeout: 378 seconds) |
22:24
π
|
|
BnA-Robin has joined #archiveteam |
22:25
π
|
|
SketchCow has joined #archiveteam |
22:25
π
|
|
swebb sets mode: +o SketchCow |
22:25
π
|
|
filippo__ has joined #archiveteam |
22:26
π
|
|
Emcy has quit IRC (Read error: Operation timed out) |
22:29
π
|
|
winr4r has joined #archiveteam |
22:29
π
|
SketchCow |
EFNet, what's wrong with you |
22:30
π
|
|
Nemo_bis has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
will has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
Marc has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
useretail has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
z00nx has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
Rye has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
is- has quit IRC (hub.dk irc.underworld.no) |
22:30
π
|
|
ersi has quit IRC (hub.dk irc.underworld.no) |
22:32
π
|
|
Froggypwn has joined #archiveteam |
22:32
π
|
xmc |
efnet is working on getting rid of their remaining servers |
22:32
π
|
xmc |
while leaving the dns entries active |
22:35
π
|
|
is-_ has joined #archiveteam |
22:36
π
|
|
n00b579 has joined #archiveteam |
22:36
π
|
|
espes__ has joined #archiveteam |
22:38
π
|
|
Fusl has joined #archiveteam |
22:39
π
|
|
Stilett0 is now known as Stiletto |
22:40
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
22:41
π
|
|
MMovie has joined #archiveteam |
22:42
π
|
|
ersi_ has joined #archiveteam |
22:48
π
|
|
will has joined #archiveteam |
22:52
π
|
|
n00b579 has quit IRC (Quit: Page closed) |
22:52
π
|
FalconK |
* while leaving the DNS entries active and continuing to list them on the website |
22:53
π
|
xmc |
yes |
22:57
π
|
|
robink has quit IRC (Read error: Operation timed out) |
23:03
π
|
arkiver |
working on livejournal now |
23:04
π
|
MrRadar |
arkiver: Do you have any access to the Archivebot bot? Or is that only yipdw? |
23:05
π
|
MrRadar |
It got disconnected and hasn't reappeared |
23:05
π
|
arkiver |
Yeah, you should contact yipdw about that |
23:05
π
|
arkiver |
or xmc, not sure |
23:05
π
|
|
dserodio has quit IRC (Read error: Operation timed out) |
23:05
π
|
MrRadar |
yipdw seems to be AFK right now, I'll try xmc |
23:22
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
23:23
π
|
|
MMovie has joined #archiveteam |
23:30
π
|
|
qwebirc85 has joined #archiveteam |
23:30
π
|
|
qwebirc85 has quit IRC (Client Quit) |
23:31
π
|
|
Asparagir has joined #archiveteam |
23:32
π
|
Asparagir |
Bunch of SF Bay Area newspapers and their websites are gonna shut down early April. These two sites will need archiving:Β Β contracostatimes.com and insidebayarea.com |
23:32
π
|
Asparagir |
Source: http://www.mercurynews.com/business/ci_29581099/bay-area-news-group-announces-newspaper-rebranding |
23:33
π
|
|
Start has joined #archiveteam |
23:33
π
|
Asparagir |
Not sure if this is really better suited for ArchiveBot or for the ArchiveTeam Warrior. If the latter, I unfortunately still don't know how to make new jobs for it. |
23:33
π
|
Asparagir |
(But am still willing to learn, and document what I learn, if anyone wants to take on an apprentice.) |
23:34
π
|
JW_work |
I'll try to remember to stick them in archivebot once it gets unstuck |
23:34
π
|
|
dserodio has joined #archiveteam |
23:38
π
|
Asparagir |
Thanks. |
23:38
π
|
Asparagir |
More fun -- Poetica is shutting down, June 1st shutdown date. Conde Nast acquihire. |
23:38
π
|
Asparagir |
https://blog.poetica.com/2016/03/01/our-next-chapter/ |
23:39
π
|
* |
Asparagir bangs the gong for SketchCow to step in and talk to them |
23:41
π
|
Asparagir |
Hmmm, looks like very little of their data was public-facing. Not sure much can be done about that one. |
23:45
π
|
SketchCow |
In the contemporary era, this is a sane and proper shutdown. |
23:46
π
|
Asparagir |
Our standards for these kinds of things are so low. At least their blog post was not trying to be all flippant and faux-happy. |
23:47
π
|
Asparagir |
(Well, except for "Thatβs why weβre so excited to announce...") |
23:54
π
|
|
MMovie has quit IRC (Read error: Operation timed out) |
23:56
π
|
|
MMovie has joined #archiveteam |