| Time |
Nickname |
Message |
|
00:21
🔗
|
|
Sanqui has quit IRC (Ping timeout: 615 seconds) |
|
00:53
🔗
|
|
jrwr has quit IRC (Connection closed) |
|
00:59
🔗
|
SketchCow |
So, I just paid $50 for urlte.am |
|
01:00
🔗
|
SketchCow |
Anyone who wants to throw at that or one of our things |
|
01:05
🔗
|
Flashfire |
That’s already one of our things |
|
01:05
🔗
|
Flashfire |
It redirects to the URL team tracker |
|
01:05
🔗
|
Flashfire |
But it’s appreciated all the same |
|
01:07
🔗
|
ivan_ |
Flashfire: domains are renewed annually |
|
01:12
🔗
|
SketchCow |
.. |
|
01:55
🔗
|
SketchCow |
NRA Videos now downloading |
|
01:56
🔗
|
hook54321 |
SketchCow: I think JAA started downloading them as well |
|
01:57
🔗
|
JAA |
Fusl did. |
|
01:57
🔗
|
hook54321 |
ah ok |
|
01:57
🔗
|
JAA |
http://archivebox-hel1.meo.ws/nratv/files/ |
|
01:58
🔗
|
JAA |
2863 of ~22k are there |
|
01:58
🔗
|
hook54321 |
looks like the videos themselves are being put into WARCs http://archivebox-hel1.meo.ws/nratv/warcs/ |
|
01:59
🔗
|
JAA |
Yes |
|
01:59
🔗
|
JAA |
Using wpull to download the playlist and video segments, writing WARCs and plain files, then combining the files into a full video file. |
|
01:59
🔗
|
hook54321 |
ah |
|
02:00
🔗
|
JAA |
The idea being that it could be put in both the WBM and in IA items. |
|
02:08
🔗
|
SketchCow |
OK, then I should just delete this then |
|
02:09
🔗
|
SketchCow |
Done! (I got plenty else I could go after) |
|
02:27
🔗
|
|
stapler11 has joined #archiveteam-bs |
|
02:31
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
03:32
🔗
|
|
odemgi has joined #archiveteam-bs |
|
03:35
🔗
|
|
odemgi_ has quit IRC (Read error: Operation timed out) |
|
03:35
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
|
03:38
🔗
|
|
godane has quit IRC (Ping timeout: 252 seconds) |
|
03:38
🔗
|
|
Fusl5 has joined #archiveteam-bs |
|
03:42
🔗
|
|
Fusl4 has quit IRC (Read error: Operation timed out) |
|
03:47
🔗
|
|
odemg has joined #archiveteam-bs |
|
04:01
🔗
|
|
godane has joined #archiveteam-bs |
|
04:07
🔗
|
|
systwi has joined #archiveteam-bs |
|
04:12
🔗
|
|
systwi has quit IRC (Quit: Give me your HAND, and I'll help you across.) |
|
06:10
🔗
|
|
wyatt8740 has joined #archiveteam-bs |
|
06:30
🔗
|
|
m007a83 has quit IRC (Ping timeout: 252 seconds) |
|
06:58
🔗
|
|
af10b3e5e has quit IRC (Ping timeout: 615 seconds) |
|
07:00
🔗
|
|
d5f4a3622 has joined #archiveteam-bs |
|
07:00
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
07:11
🔗
|
|
m007a83 has joined #archiveteam-bs |
|
07:14
🔗
|
|
agfa has quit IRC (Read error: Operation timed out) |
|
07:48
🔗
|
|
icedice has joined #archiveteam-bs |
|
07:51
🔗
|
|
icedice2 has quit IRC (Ping timeout: 252 seconds) |
|
09:37
🔗
|
godane |
so i uploaded 3 episodes of this japanese show : https://archive.org/details/yoicocchi-1997-12-21 |
|
09:43
🔗
|
|
icedice has quit IRC (Read error: Operation timed out) |
|
10:17
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
10:21
🔗
|
|
icedice has joined #archiveteam-bs |
|
10:33
🔗
|
|
chirlu has quit IRC (Ping timeout: 255 seconds) |
|
10:40
🔗
|
|
icedice has quit IRC (Remote host closed the connection) |
|
10:56
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
12:24
🔗
|
|
enick_187 is now known as PurpleSym |
|
12:59
🔗
|
|
JH88 has joined #archiveteam-bs |
|
13:23
🔗
|
|
icedice has joined #archiveteam-bs |
|
13:26
🔗
|
|
schbirid has joined #archiveteam-bs |
|
14:08
🔗
|
SmileyG |
lol the spam reviewer is back. |
|
14:08
🔗
|
SmileyG |
https://archive.org/details/@kozwrlqgsnqkecf |
|
14:14
🔗
|
Fusl |
SketchCow: ^ |
|
14:14
🔗
|
|
BartoCH has quit IRC (Ping timeout: 615 seconds) |
|
14:26
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
14:39
🔗
|
|
BartoCH has quit IRC (Ping timeout: 615 seconds) |
|
14:41
🔗
|
|
underscor has quit IRC (Read error: Connection reset by peer) |
|
14:42
🔗
|
|
underscor has joined #archiveteam-bs |
|
16:27
🔗
|
SmileyG |
that url has come from multiple spammers too |
|
16:27
🔗
|
SmileyG |
the one in the reviews |
|
16:45
🔗
|
anarcat |
crawler framework in go http://go-colly.org/ |
|
16:47
🔗
|
anarcat |
some interesting bits here too http://go-colly.org/docs/best_practices/distributed/ |
|
17:06
🔗
|
luckcolor |
anarcat: problem is that go doesn't yet have a WARC library that supports writing |
|
17:06
🔗
|
luckcolor |
and actually building something that can work and act the same as the solution it's currently used (WPULL) is not easy |
|
17:07
🔗
|
anarcat |
ah right |
|
17:07
🔗
|
anarcat |
still, i like the design of shoving some stuff into the proxy and/or shared DB (e.g. redis) |
|
17:07
🔗
|
luckcolor |
like it would need extensive testing that ensure it doesn't get less stuff that WPULL currently manages to get |
|
17:08
🔗
|
luckcolor |
it should perform equal or better in terms of accuracy |
|
17:08
🔗
|
anarcat |
for sure |
|
17:08
🔗
|
luckcolor |
also kinda a lot of the population here speaks python soo :) |
|
17:08
🔗
|
anarcat |
and i mean it doesn't resolve the "chromebot" target at all |
|
17:08
🔗
|
anarcat |
yeah |
|
17:08
🔗
|
luckcolor |
yeah ofc |
|
17:09
🔗
|
luckcolor |
i mean i know golang myself so i would be the first user around these parts to proposed a solution using go (wich i think i even did in the past lel) but yeah |
|
17:09
🔗
|
anarcat |
anyways, just an interesting framework to start off of i guess |
|
17:26
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
18:04
🔗
|
|
tapos has joined #archiveteam-bs |
|
18:04
🔗
|
|
tapos has quit IRC (Connection closed) |
|
18:08
🔗
|
|
tapos has joined #archiveteam-bs |
|
18:31
🔗
|
|
godane has quit IRC (Read error: Connection reset by peer) |
|
18:43
🔗
|
|
tapos has quit IRC (Quit: Leaving) |
|
19:05
🔗
|
|
godane has joined #archiveteam-bs |
|
20:11
🔗
|
hook54321 |
benjins: unfortunately newspaper archives are oftentimes very commercialized these days, which puts those archives at risk. |
|
20:15
🔗
|
benjins |
And they're becoming more necessary as papers close down |
|
20:37
🔗
|
|
d5f4a3622 has quit IRC (Ping timeout: 615 seconds) |
|
21:16
🔗
|
|
killsushi has joined #archiveteam-bs |
|
21:19
🔗
|
|
apache2 has quit IRC (Remote host closed the connection) |
|
21:19
🔗
|
|
apache2 has joined #archiveteam-bs |
|
21:54
🔗
|
|
Jens has quit IRC (Remote host closed the connection) |
|
21:55
🔗
|
|
Jens has joined #archiveteam-bs |
|
21:59
🔗
|
|
schbirid has quit IRC (Remote host closed the connection) |
|
22:49
🔗
|
godane |
SketchCow : looks like youngstown vindicator newspaper was digitize by google: https://news.google.com/newspapers?nid=pqgf-8x9CmQC&dat=19450727&b_mode=2&hl=en |
|
22:50
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
22:50
🔗
|
godane |
at least up to 1980s |
|
22:58
🔗
|
hook54321 |
nice |
|
23:05
🔗
|
|
VerifiedJ has quit IRC (Quit: Leaving) |
|
23:05
🔗
|
hook54321 |
looks like it's missing stuff from before 1893 though |
|
23:21
🔗
|
|
Dallas has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
joshua_ has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Xibalba has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
brayden has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
sHATNER has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
odemgi has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
stapler11 has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
h3ndr1k has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Lord_Nigh has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
benjins has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Atom-- has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
MillerBOS has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Yurume has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
thejsa has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
omglolbah has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Jon has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
pikami has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
sknebel has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
drcd has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
legoktm has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
Kenshin has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
chfoo has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:21
🔗
|
|
_niklas has quit IRC (hub.efnet.us irc.efnet.nl) |
|
23:22
🔗
|
|
odemgi has joined #archiveteam-bs |
|
23:22
🔗
|
|
stapler11 has joined #archiveteam-bs |
|
23:22
🔗
|
|
Dallas has joined #archiveteam-bs |
|
23:22
🔗
|
|
joshua_ has joined #archiveteam-bs |
|
23:22
🔗
|
|
h3ndr1k has joined #archiveteam-bs |
|
23:22
🔗
|
|
MrRadar2 has joined #archiveteam-bs |
|
23:22
🔗
|
|
Xibalba has joined #archiveteam-bs |
|
23:22
🔗
|
|
brayden has joined #archiveteam-bs |
|
23:22
🔗
|
|
BnAboyZ has joined #archiveteam-bs |
|
23:22
🔗
|
|
sHATNER has joined #archiveteam-bs |
|
23:22
🔗
|
|
Lord_Nigh has joined #archiveteam-bs |
|
23:22
🔗
|
|
benjins has joined #archiveteam-bs |
|
23:22
🔗
|
|
Atom-- has joined #archiveteam-bs |
|
23:22
🔗
|
|
MillerBOS has joined #archiveteam-bs |
|
23:22
🔗
|
|
Tenebrae has joined #archiveteam-bs |
|
23:22
🔗
|
|
Yurume has joined #archiveteam-bs |
|
23:22
🔗
|
|
thejsa has joined #archiveteam-bs |
|
23:22
🔗
|
|
_niklas has joined #archiveteam-bs |
|
23:22
🔗
|
|
chfoo has joined #archiveteam-bs |
|
23:22
🔗
|
|
Kenshin has joined #archiveteam-bs |
|
23:22
🔗
|
|
legoktm has joined #archiveteam-bs |
|
23:22
🔗
|
|
drcd has joined #archiveteam-bs |
|
23:22
🔗
|
|
sknebel has joined #archiveteam-bs |
|
23:22
🔗
|
|
pikami has joined #archiveteam-bs |
|
23:22
🔗
|
|
Jon has joined #archiveteam-bs |
|
23:22
🔗
|
|
omglolbah has joined #archiveteam-bs |
|
23:22
🔗
|
|
irc.efnet.nl sets mode: +o MrRadar2 |
|
23:40
🔗
|
|
godane has quit IRC (Quit: Leaving.) |