| Time |
Nickname |
Message |
|
00:03
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
00:10
🔗
|
|
pizzaiolo has quit IRC (Remote host closed the connection) |
|
00:17
🔗
|
|
Smiley has quit IRC (Remote host closed the connection) |
|
00:17
🔗
|
|
Smiley has joined #archiveteam-bs |
|
00:32
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
00:32
🔗
|
|
JAA has joined #archiveteam-bs |
|
00:44
🔗
|
|
j08nY has quit IRC (Quit: Leaving) |
|
01:22
🔗
|
|
passerby has quit IRC (Read error: Operation timed out) |
|
01:28
🔗
|
|
passerby has joined #archiveteam-bs |
|
01:47
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
02:05
🔗
|
|
pnJay has quit IRC (Read error: Connection reset by peer) |
|
02:27
🔗
|
|
pizzaiolo has quit IRC (Ping timeout: 246 seconds) |
|
02:32
🔗
|
|
pnJay has joined #archiveteam-bs |
|
02:37
🔗
|
|
ZexaronS has quit IRC (Leaving) |
|
02:57
🔗
|
|
Roelandus has quit IRC (Ping timeout: 268 seconds) |
|
04:34
🔗
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
|
05:00
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
05:20
🔗
|
|
RichardG has joined #archiveteam-bs |
|
05:37
🔗
|
|
RichardG has quit IRC (Ping timeout: 244 seconds) |
|
05:54
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
06:00
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
06:25
🔗
|
|
RichardG has joined #archiveteam-bs |
|
06:38
🔗
|
|
RichardG has quit IRC (Ping timeout: 633 seconds) |
|
07:03
🔗
|
|
RichardG has joined #archiveteam-bs |
|
07:14
🔗
|
|
kyounko has joined #archiveteam-bs |
|
07:57
🔗
|
|
masterX24 has joined #archiveteam-bs |
|
07:59
🔗
|
masterX24 |
update on DMOZ from my end: at 3,2 mio pages 190k to go atm, that counter trolled me at 1,7 mio since some pages were "hidden" deeply and only appeared in the later stages |
|
08:03
🔗
|
masterX24 |
luckily i caught those 420s early at my crawl and whenever one slipped thru a ignore got slapped on so my crawl should only have a few of those buggers |
|
08:07
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
08:07
🔗
|
masterX24 |
sorry for not hopping on in the meantime |
|
08:07
🔗
|
|
Boppen has joined #archiveteam-bs |
|
08:13
🔗
|
|
j08nY has joined #archiveteam-bs |
|
08:36
🔗
|
|
GE has joined #archiveteam-bs |
|
08:41
🔗
|
|
fie has quit IRC (Leaving) |
|
08:42
🔗
|
|
fie has joined #archiveteam-bs |
|
08:43
🔗
|
|
j08nY has quit IRC (Quit: Leaving) |
|
08:54
🔗
|
JAA |
masterX24: good to hear. I also grabbed those ~300 pages last night with wget (with the command I posted + --truncate-output) just in case. Let's hope DMOZ stays up long enough so your crawl can finish. |
|
08:56
🔗
|
masterX24 |
cranked up speed a bit, originally crawl started with 2 conns parallel, later after more shit appeared i went to 3 and yesterday i switched to 5 connections after knowing my servers cpu works out |
|
08:56
🔗
|
masterX24 |
also: IRC username limit stole a 4 from my name (usually i use masterX244 everywhere) |
|
08:57
🔗
|
|
Honno has quit IRC (Ping timeout: 370 seconds) |
|
09:17
🔗
|
JAA |
Ha, I thought something was missing but wasn't sure what it was :D Yeah, the 9 character limit is stupid |
|
09:25
🔗
|
|
kyounko|2 has joined #archiveteam-bs |
|
09:31
🔗
|
|
kyounko has quit IRC (Read error: Operation timed out) |
|
09:39
🔗
|
masterX24 |
@JAA how did you get the feeling something was missing? |
|
09:47
🔗
|
|
qwebirc73 has joined #archiveteam-bs |
|
09:47
🔗
|
qwebirc73 |
damnit, firefox crashed |
|
09:48
🔗
|
JAA |
I saw your post on /r/Archiveteam a few days ago and faintly remembered what your nick looked like. My head was probably thinking "something with m, maybe a letter, and three digits" or so. |
|
09:49
🔗
|
qwebirc73 |
ahh, makes sense then |
|
09:49
🔗
|
|
masterX24 has quit IRC (Ping timeout: 268 seconds) |
|
09:49
🔗
|
qwebirc73 |
relogging after server noticed my zap |
|
09:49
🔗
|
|
qwebirc73 has quit IRC (Client Quit) |
|
09:50
🔗
|
|
masterX24 has joined #archiveteam-bs |
|
09:50
🔗
|
masterX24 |
back now with real nick |
|
09:50
🔗
|
JAA |
welcome back :) |
|
10:00
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
10:02
🔗
|
|
Honno has joined #archiveteam-bs |
|
10:09
🔗
|
|
Honno has quit IRC (Ping timeout: 370 seconds) |
|
10:17
🔗
|
|
Jonison has joined #archiveteam-bs |
|
10:25
🔗
|
|
Jonison has quit IRC (Quit: Leaving) |
|
10:43
🔗
|
masterX24 |
146k to go... hoping that crawl finishes on DMOZ |
|
10:43
🔗
|
|
Cameron_D has quit IRC (Read error: Operation timed out) |
|
10:44
🔗
|
|
yipdw has quit IRC (Read error: Operation timed out) |
|
10:48
🔗
|
|
me has joined #archiveteam-bs |
|
10:52
🔗
|
|
Cameron_D has joined #archiveteam-bs |
|
10:56
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
10:56
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
11:05
🔗
|
|
me has quit IRC (Read error: Operation timed out) |
|
11:05
🔗
|
|
Cameron_D has quit IRC (Read error: Operation timed out) |
|
11:08
🔗
|
|
Cameron_D has joined #archiveteam-bs |
|
11:12
🔗
|
|
me has joined #archiveteam-bs |
|
11:17
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
11:18
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
11:28
🔗
|
|
GE has joined #archiveteam-bs |
|
11:35
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
11:56
🔗
|
|
BlueMaxim has quit IRC (Read error: Connection reset by peer) |
|
12:14
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
12:16
🔗
|
|
JAA has joined #archiveteam-bs |
|
12:22
🔗
|
|
wabu has quit IRC (Read error: Operation timed out) |
|
12:22
🔗
|
|
wabu has joined #archiveteam-bs |
|
12:40
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
12:44
🔗
|
|
godane has quit IRC (Ping timeout: 633 seconds) |
|
12:53
🔗
|
JensRex |
https://www.reddit.com/r/DataHoarder/comments/5zbk40/westwoods_ftp_ist_still_up_maybe_you_want_to/ |
|
13:00
🔗
|
|
j08nY has joined #archiveteam-bs |
|
13:23
🔗
|
|
compu has joined #archiveteam-bs |
|
13:23
🔗
|
|
antomati_ has joined #archiveteam-bs |
|
13:23
🔗
|
|
swebb sets mode: +o antomati_ |
|
13:26
🔗
|
|
espes___ has joined #archiveteam-bs |
|
13:26
🔗
|
|
HP_ has joined #archiveteam-bs |
|
13:26
🔗
|
|
w0rp has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
antomatic has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
wolfpld has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
HP has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
espes__ has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
luckcolor has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
TC01 has quit IRC (Read error: Operation timed out) |
|
13:26
🔗
|
|
yuitimoth has quit IRC (Read error: Connection reset by peer) |
|
13:26
🔗
|
|
kevinr has quit IRC (Ping timeout: 381 seconds) |
|
13:26
🔗
|
|
kevinr has joined #archiveteam-bs |
|
13:26
🔗
|
|
compu_85 has quit IRC (Ping timeout: 246 seconds) |
|
13:26
🔗
|
|
w0rp_ has joined #archiveteam-bs |
|
13:26
🔗
|
|
w0rp_ is now known as w0rp |
|
13:27
🔗
|
|
TC01 has joined #archiveteam-bs |
|
13:27
🔗
|
|
wolfpld has joined #archiveteam-bs |
|
13:27
🔗
|
|
luckcolor has joined #archiveteam-bs |
|
13:28
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
13:39
🔗
|
|
godane has joined #archiveteam-bs |
|
14:29
🔗
|
|
kyounko has joined #archiveteam-bs |
|
14:35
🔗
|
|
kyounko|2 has quit IRC (Read error: Operation timed out) |
|
14:54
🔗
|
|
kyounko|2 has joined #archiveteam-bs |
|
14:56
🔗
|
|
kyounko has quit IRC (Read error: Operation timed out) |
|
15:04
🔗
|
|
masterX24 has quit IRC (Ping timeout: 268 seconds) |
|
15:18
🔗
|
|
masterX24 has joined #archiveteam-bs |
|
15:18
🔗
|
masterX24 |
and another firefox crash got me |
|
15:20
🔗
|
|
ndiddy has quit IRC () |
|
15:23
🔗
|
masterX24 |
84k atm, looks like its a close race atm on DMOZ |
|
15:34
🔗
|
JAA |
Wait a second... The "we're going down" notice has disappeared from https://www.dmoz.org/ ?! |
|
15:36
🔗
|
JAA |
Ah no, there it is again... weird |
|
15:37
🔗
|
JAA |
Every few page refreshes, instead of the "Important Notice" it just says "Welcome to DMOZ! It's the Web, Organized." |
|
15:51
🔗
|
masterX24 |
77k atm, disappearing for a bit now, goin home from work, resuming monitoring then |
|
15:51
🔗
|
|
masterX24 has quit IRC (Quit: Page closed) |
|
16:00
🔗
|
tobbez |
JAA: Probably just caching issues on their end |
|
16:19
🔗
|
|
passerby has quit IRC (Read error: Operation timed out) |
|
16:19
🔗
|
|
passerby has joined #archiveteam-bs |
|
16:45
🔗
|
JensRex |
In a strike of irony, this page: http://recordkeepingroundtable.org/2011/06/25/where-do-old-websites-go-to-die-with-jason-scott-of-archive-team-podcast/ |
|
16:45
🔗
|
JensRex |
Linked from: http://archiveteam.org/index.php?title=User:Jscott |
|
16:45
🔗
|
JensRex |
is 404. |
|
16:50
🔗
|
|
GE has joined #archiveteam-bs |
|
16:53
🔗
|
|
odemg has joined #archiveteam-bs |
|
16:53
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
16:55
🔗
|
|
odemg has joined #archiveteam-bs |
|
17:10
🔗
|
rocode |
IA chrome sends you to https://web.archive.org/web/20121204052508/http://recordkeepingroundtable.org:80/2011/06/25/where-do-old-websites-go-to-die-with-jason-scott-of-archive-team-podcast/ |
|
17:10
🔗
|
rocode |
:D |
|
17:11
🔗
|
rocode |
I know personally a lot of the links on JScott's twitter backlog are dead. |
|
17:36
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
17:37
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
17:37
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
18:23
🔗
|
|
JAA has joined #archiveteam-bs |
|
18:36
🔗
|
|
icedice has joined #archiveteam-bs |
|
18:42
🔗
|
|
masterX24 has joined #archiveteam-bs |
|
18:42
🔗
|
masterX24 |
back, also dmoz 30k to go |
|
19:02
🔗
|
closure |
rocode: I happen to have a copy of that mp3 in my archives, if the IA does not.. |
|
19:11
🔗
|
|
Aranje has joined #archiveteam-bs |
|
19:14
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
19:14
🔗
|
JensRex |
closure: It does. Just listened to it. |
|
19:15
🔗
|
|
Smiley has joined #archiveteam-bs |
|
19:16
🔗
|
JensRex |
I really really hope Self Destructing Cookies gets fixed properly somehow. |
|
19:16
🔗
|
JensRex |
Wrong channel. |
|
19:29
🔗
|
masterX24 |
16k on DMOZ |
|
19:50
🔗
|
masterX24 |
less than 10k, seems like that one gets saved... |
|
19:57
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
20:00
🔗
|
|
odemg has joined #archiveteam-bs |
|
20:04
🔗
|
JensRex |
dmoz is a manual project? |
|
20:04
🔗
|
JensRex |
I think I missed the memo. |
|
20:18
🔗
|
masterX24 |
single crawler from me running on it |
|
20:18
🔗
|
masterX24 |
archivebot was running, too but a config error there slowed it down massively |
|
20:19
🔗
|
masterX24 |
(it hunted external links, too and had a few ignores missing to skip the abuse and flag links) |
|
20:20
🔗
|
Kaz |
hm |
|
20:21
🔗
|
Kaz |
any reason they couldn't be added to the archivebot job? |
|
20:21
🔗
|
masterX24 |
2k to go |
|
20:21
🔗
|
masterX24 |
idk, i posted it on the channel shortly after noticing it |
|
20:26
🔗
|
masterX24 |
600... |
|
20:31
🔗
|
|
cf has quit IRC (Quit: Bye.) |
|
20:38
🔗
|
masterX24 |
saved |
|
20:38
🔗
|
masterX24 |
now to get the files to archive.org |
|
20:43
🔗
|
|
GE has joined #archiveteam-bs |
|
21:04
🔗
|
MrRadar |
Thanks masterX24! |
|
21:06
🔗
|
masterX24 |
damnit... upload doesnt have any progress indicator (having to use coommandline tools from my webserver due to home internet being slow) |
|
21:52
🔗
|
masterX24 |
took a while but first warc got in, how to get the files linked to archiveteam collection? SketchCow xmc |
|
21:55
🔗
|
godane |
storm is really windy today |
|
21:57
🔗
|
masterX24 |
logging out, sleeptime |
|
21:57
🔗
|
|
masterX24 has quit IRC (Quit: Page closed) |
|
22:34
🔗
|
|
amiiboh has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
22:50
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
22:50
🔗
|
|
JAA has joined #archiveteam-bs |
|
22:55
🔗
|
godane |
looks like bbc took down there xml data |
|
22:56
🔗
|
godane |
https://github.com/get-iplayer/get_iplayer/issues |
|
22:56
🔗
|
godane |
i breaks downloading streams |
|
22:58
🔗
|
godane |
plus side is i was able to grab the audio jason talked about on twitter 12 hours ago |
|
23:20
🔗
|
|
icedice has quit IRC (Ping timeout: 245 seconds) |
|
23:23
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
23:30
🔗
|
|
odemg has joined #archiveteam-bs |
|
23:30
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
23:36
🔗
|
|
mls has joined #archiveteam-bs |
|
23:54
🔗
|
SketchCow |
I just finished adding the "Frostbyte Collection" to Archive. |
|
23:54
🔗
|
SketchCow |
4,250 items. |
|
23:54
🔗
|
SketchCow |
Now I get to do QA Checks until forever |