Time |
Nickname |
Message |
00:00
🔗
|
|
Jens has quit IRC (Remote host closed the connection) |
00:09
🔗
|
|
Jens has joined #archiveteam-bs |
00:18
🔗
|
|
m_alencar has joined #archiveteam-bs |
00:21
🔗
|
|
marceloal has quit IRC (Ping timeout: 255 seconds) |
00:31
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 250 seconds) |
00:31
🔗
|
|
Mateon1 has joined #archiveteam-bs |
00:37
🔗
|
|
Jens has quit IRC (Remote host closed the connection) |
00:46
🔗
|
|
Jens has joined #archiveteam-bs |
00:49
🔗
|
|
alencar has joined #archiveteam-bs |
00:51
🔗
|
|
m_alencar has quit IRC (Ping timeout: 258 seconds) |
00:54
🔗
|
|
m_alencar has joined #archiveteam-bs |
00:57
🔗
|
|
Jens has quit IRC (Remote host closed the connection) |
00:57
🔗
|
|
Jens has joined #archiveteam-bs |
00:59
🔗
|
|
alencar has quit IRC (Ping timeout: 360 seconds) |
01:43
🔗
|
|
rsznick has joined #archiveteam-bs |
01:46
🔗
|
|
rsznik has quit IRC (Ping timeout: 252 seconds) |
01:47
🔗
|
SketchCow |
godane: I will instruct you how to tell the Fedex person how to address them |
01:47
🔗
|
SketchCow |
You don't need to fill anything out. |
01:50
🔗
|
|
rsznik has joined #archiveteam-bs |
01:50
🔗
|
|
rsznick has quit IRC (Ping timeout: 252 seconds) |
01:53
🔗
|
|
BlueMax has joined #archiveteam-bs |
02:01
🔗
|
godane |
ok |
02:25
🔗
|
|
octothorp has joined #archiveteam-bs |
02:34
🔗
|
|
zyphlar has joined #archiveteam-bs |
02:38
🔗
|
|
zyphlar has quit IRC (Remote host closed the connection) |
02:39
🔗
|
|
ItsYoda has quit IRC (Ping timeout: 260 seconds) |
02:40
🔗
|
|
zyphlar has joined #archiveteam-bs |
02:47
🔗
|
|
zyphlar has quit IRC (Remote host closed the connection) |
02:49
🔗
|
|
zyphlar has joined #archiveteam-bs |
03:15
🔗
|
|
Pixi has quit IRC (Quit: Pixi) |
03:17
🔗
|
|
ld1 has quit IRC (Quit: ld1) |
03:19
🔗
|
|
ItsYoda has joined #archiveteam-bs |
03:20
🔗
|
|
Pixi has joined #archiveteam-bs |
03:22
🔗
|
|
ld1 has joined #archiveteam-bs |
03:30
🔗
|
|
icedice has joined #archiveteam-bs |
03:31
🔗
|
|
icedice has quit IRC (Remote host closed the connection) |
04:16
🔗
|
|
mabynogy has joined #archiveteam-bs |
04:20
🔗
|
|
mabynogy has quit IRC (Read error: Connection reset by peer) |
04:21
🔗
|
|
mabynogy has joined #archiveteam-bs |
04:25
🔗
|
|
ItsYoda has quit IRC (Ping timeout: 260 seconds) |
04:27
🔗
|
|
mabynogy has quit IRC (Remote host closed the connection) |
04:30
🔗
|
|
mabynogy has joined #archiveteam-bs |
04:46
🔗
|
|
qw3rty113 has joined #archiveteam-bs |
04:47
🔗
|
|
ItsYoda has joined #archiveteam-bs |
04:53
🔗
|
|
qw3rty112 has quit IRC (Read error: Operation timed out) |
05:09
🔗
|
|
BlueMax has quit IRC (Leaving) |
05:24
🔗
|
|
ivan has quit IRC (Ping timeout: 246 seconds) |
05:35
🔗
|
|
ivan has joined #archiveteam-bs |
05:53
🔗
|
|
BlueMax has joined #archiveteam-bs |
05:55
🔗
|
|
m_alencar has quit IRC (Quit: Leaving) |
06:17
🔗
|
|
phirephly has quit IRC (Read error: Operation timed out) |
06:47
🔗
|
|
dan- has joined #archiveteam-bs |
06:50
🔗
|
|
phirephly has joined #archiveteam-bs |
07:59
🔗
|
|
octothorp has quit IRC (Remote host closed the connection) |
08:01
🔗
|
|
octothorp has joined #archiveteam-bs |
08:10
🔗
|
|
mabynogy has quit IRC (Quit: dpt.slasheva.com) |
08:15
🔗
|
|
schbirid has joined #archiveteam-bs |
09:40
🔗
|
|
BlueMax has quit IRC (Read error: Connection reset by peer) |
09:58
🔗
|
|
BlueMax has joined #archiveteam-bs |
10:34
🔗
|
|
REiN^ has quit IRC (Read error: Operation timed out) |
11:27
🔗
|
|
REiN^ has joined #archiveteam-bs |
11:57
🔗
|
|
BlueMax has quit IRC (Leaving) |
13:19
🔗
|
|
mabynogy has joined #archiveteam-bs |
13:34
🔗
|
|
arbin has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Atom-- has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
chazchaz has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Soni has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
slyphic has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
zino has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
unlobito has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
twigfoot has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
astrid has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
ranma_ has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
yipdw has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
mistym has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Soulflare has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
superkuh has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
odemg has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
kvieta has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Laverne has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Darkstar has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
namespace has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Yurume has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Coderjo has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
swebb has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
atlogbot has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
dxrt has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
MrRadar has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
dcmorton has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
eprillios has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Somebody2 has quit IRC (hub.efnet.us irc.servercentral.net) |
13:34
🔗
|
|
Cameron_D has quit IRC (hub.efnet.us irc.servercentral.net) |
13:38
🔗
|
|
Boppen has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
nyany has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Kagee has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
altlabel has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Xibalba has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
klondike has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Mateon1 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Stilett0 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Sk1d has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
antomatic has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
robogoat has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
SN4T14 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Rai-chan has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Aoede has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Gfy has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
svchfoo1 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
tsr has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
nightpool has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Dimtree has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Valentine has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
midas has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Jusque has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
yuitimoth has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
wacky has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
atomicthu has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Ing3b0rg has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
closure has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
chazchaz_ has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
REiN^ has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
qw3rty113 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
bwn has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
sep332 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
robink has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Fusl has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
c4rc4s has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
PotcFdk has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
Mayonaise has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
squires has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
PoorHomie has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
rolfoid has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
C4K3 has quit IRC (hub.efnet.us ny.us.hub) |
13:38
🔗
|
|
beardicus has quit IRC (hub.efnet.us ny.us.hub) |
13:42
🔗
|
|
arbin has joined #archiveteam-bs |
13:42
🔗
|
|
Atom-- has joined #archiveteam-bs |
13:42
🔗
|
|
chazchaz has joined #archiveteam-bs |
13:42
🔗
|
|
Soni has joined #archiveteam-bs |
13:42
🔗
|
|
slyphic has joined #archiveteam-bs |
13:42
🔗
|
|
zino has joined #archiveteam-bs |
13:42
🔗
|
|
unlobito has joined #archiveteam-bs |
13:42
🔗
|
|
twigfoot has joined #archiveteam-bs |
13:42
🔗
|
|
astrid has joined #archiveteam-bs |
13:42
🔗
|
|
ranma_ has joined #archiveteam-bs |
13:42
🔗
|
|
yipdw has joined #archiveteam-bs |
13:42
🔗
|
|
mistym has joined #archiveteam-bs |
13:42
🔗
|
|
Soulflare has joined #archiveteam-bs |
13:42
🔗
|
|
superkuh has joined #archiveteam-bs |
13:42
🔗
|
|
odemg has joined #archiveteam-bs |
13:42
🔗
|
|
kvieta has joined #archiveteam-bs |
13:42
🔗
|
|
Laverne has joined #archiveteam-bs |
13:42
🔗
|
|
Darkstar has joined #archiveteam-bs |
13:42
🔗
|
|
namespace has joined #archiveteam-bs |
13:42
🔗
|
|
Yurume has joined #archiveteam-bs |
13:42
🔗
|
|
Coderjo has joined #archiveteam-bs |
13:42
🔗
|
|
atlogbot has joined #archiveteam-bs |
13:42
🔗
|
|
swebb has joined #archiveteam-bs |
13:42
🔗
|
|
dxrt has joined #archiveteam-bs |
13:42
🔗
|
|
irc.servercentral.net sets mode: +ovoo astrid atlogbot swebb dxrt |
13:42
🔗
|
|
MrRadar has joined #archiveteam-bs |
13:42
🔗
|
|
dcmorton has joined #archiveteam-bs |
13:42
🔗
|
|
eprillios has joined #archiveteam-bs |
13:42
🔗
|
|
Somebody2 has joined #archiveteam-bs |
13:42
🔗
|
|
Cameron_D has joined #archiveteam-bs |
13:42
🔗
|
|
irc.servercentral.net sets mode: +o Somebody2 |
13:42
🔗
|
|
Frogging sets mode: +o yipdw |
13:42
🔗
|
|
swebb sets mode: +o brayden |
13:42
🔗
|
|
swebb sets mode: +o SketchCow |
13:42
🔗
|
|
swebb sets mode: +o balrog |
13:42
🔗
|
|
swebb sets mode: +o JAA |
13:42
🔗
|
|
swebb sets mode: +o DFJustin |
13:42
🔗
|
|
swebb sets mode: +o Jonimus |
13:50
🔗
|
|
Harzilein has joined #archiveteam-bs |
13:50
🔗
|
Harzilein |
hi |
13:55
🔗
|
|
REiN^ has joined #archiveteam-bs |
13:55
🔗
|
|
qw3rty113 has joined #archiveteam-bs |
13:55
🔗
|
|
Mateon1 has joined #archiveteam-bs |
13:55
🔗
|
|
bwn has joined #archiveteam-bs |
13:55
🔗
|
|
sep332 has joined #archiveteam-bs |
13:55
🔗
|
|
Dimtree has joined #archiveteam-bs |
13:55
🔗
|
|
Valentine has joined #archiveteam-bs |
13:55
🔗
|
|
Stilett0 has joined #archiveteam-bs |
13:55
🔗
|
|
robink has joined #archiveteam-bs |
13:55
🔗
|
|
Fusl has joined #archiveteam-bs |
13:55
🔗
|
|
midas has joined #archiveteam-bs |
13:55
🔗
|
|
c4rc4s has joined #archiveteam-bs |
13:55
🔗
|
|
PotcFdk has joined #archiveteam-bs |
13:55
🔗
|
|
Mayonaise has joined #archiveteam-bs |
13:55
🔗
|
|
squires has joined #archiveteam-bs |
13:55
🔗
|
|
PoorHomie has joined #archiveteam-bs |
13:55
🔗
|
|
rolfoid has joined #archiveteam-bs |
13:55
🔗
|
|
C4K3 has joined #archiveteam-bs |
13:55
🔗
|
|
beardicus has joined #archiveteam-bs |
13:55
🔗
|
|
Jusque has joined #archiveteam-bs |
13:55
🔗
|
|
Boppen has joined #archiveteam-bs |
13:55
🔗
|
|
Sk1d has joined #archiveteam-bs |
13:55
🔗
|
|
nightpool has joined #archiveteam-bs |
13:55
🔗
|
|
tsr has joined #archiveteam-bs |
13:55
🔗
|
|
svchfoo1 has joined #archiveteam-bs |
13:55
🔗
|
|
Xibalba has joined #archiveteam-bs |
13:55
🔗
|
|
Gfy has joined #archiveteam-bs |
13:55
🔗
|
|
Aoede has joined #archiveteam-bs |
13:55
🔗
|
|
Rai-chan has joined #archiveteam-bs |
13:55
🔗
|
|
altlabel has joined #archiveteam-bs |
13:55
🔗
|
|
Kagee has joined #archiveteam-bs |
13:55
🔗
|
|
SN4T14 has joined #archiveteam-bs |
13:55
🔗
|
|
klondike has joined #archiveteam-bs |
13:55
🔗
|
|
nyany has joined #archiveteam-bs |
13:55
🔗
|
|
robogoat has joined #archiveteam-bs |
13:55
🔗
|
|
antomatic has joined #archiveteam-bs |
13:55
🔗
|
|
yuitimoth has joined #archiveteam-bs |
13:55
🔗
|
|
chazchaz_ has joined #archiveteam-bs |
13:55
🔗
|
|
closure has joined #archiveteam-bs |
13:55
🔗
|
|
Ing3b0rg has joined #archiveteam-bs |
13:55
🔗
|
|
atomicthu has joined #archiveteam-bs |
13:55
🔗
|
|
wacky has joined #archiveteam-bs |
13:55
🔗
|
|
ny.us.hub sets mode: +ooo svchfoo1 antomatic closure |
13:55
🔗
|
|
swebb sets mode: +o antomatic |
14:02
🔗
|
|
K4k has quit IRC (Read error: Connection reset by peer) |
14:08
🔗
|
|
Stilett0 has quit IRC (Ping timeout: 250 seconds) |
14:18
🔗
|
|
ranma has quit IRC (ZNC - http://znc.in) |
14:18
🔗
|
|
ranma_ has quit IRC (Quit: Bye!) |
14:46
🔗
|
|
Stilett0 has joined #archiveteam-bs |
15:02
🔗
|
|
RichardG has joined #archiveteam-bs |
15:58
🔗
|
godane |
so one tape has at least 5 hours of random VH1 recordings from maybe june 1990 |
15:59
🔗
|
godane |
the VH1 part is going be most likely put up as one big blog |
15:59
🔗
|
godane |
*block |
15:59
🔗
|
godane |
before that i have about 40ish minutes of CNBC from around 1990 too |
16:22
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
16:23
🔗
|
|
RichardG has joined #archiveteam-bs |
16:33
🔗
|
|
jtn2 has quit IRC (Read error: Operation timed out) |
16:33
🔗
|
|
jtn2 has joined #archiveteam-bs |
17:38
🔗
|
|
atrocity has joined #archiveteam-bs |
18:12
🔗
|
|
ola_norsk has joined #archiveteam-bs |
18:13
🔗
|
ola_norsk |
hi. Is there some common procedure to archive Youtube channels that are in imediate danger of becoming removed by 'mass-flagging' ? |
18:14
🔗
|
ola_norsk |
i'm currently doing the (up to 720p) of 'PsychEdSubstance' videos https://archive.org/details/PsychedSubstance_YouTube_Videos_Archive_20180216 |
18:17
🔗
|
ola_norsk |
from what i understand, the guy's already recieved 2 strikes, and a third would remove the channel. Meanwhile, by his words YouTube is not providing much help or understanding of what's going on. |
18:25
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
18:27
🔗
|
ola_norsk |
I'm gonna take his "save me!" quite literal, since i don't personally care what he means by that. |
18:27
🔗
|
|
schbirid has quit IRC (Ping timeout: 255 seconds) |
18:28
🔗
|
|
K4k has joined #archiveteam-bs |
18:37
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
18:39
🔗
|
|
RichardG has joined #archiveteam-bs |
18:40
🔗
|
plue |
i don't know if such a list exists, but please post youtube accounts/channels here or maybe create a page in the wiki. there should be enough ppl with some storage here to save the channels. |
18:45
🔗
|
ola_norsk |
plue: good idea. btw, here's my shitty solution of how i'm doing at the moment https://pastebin.com/jeZ948N2 |
18:45
🔗
|
ola_norsk |
doing it* |
19:01
🔗
|
godane |
so i'm 23k items |
19:01
🔗
|
godane |
i'm also digitizing tape 4 from jasons boxes |
19:03
🔗
|
godane |
after tape 2 being fuzzy MST3K that got capture at 10k bitrate thru the full tape |
19:03
🔗
|
ola_norsk |
geezer |
19:04
🔗
|
godane |
i'm capturing the rest of the tapes at 6000k for video |
19:05
🔗
|
ola_norsk |
wouldn't it be cool if there was a "record button" award? :D |
19:07
🔗
|
ola_norsk |
similar to youtube's 'play button', and perhaps also a 'Internet Archive Yearbook' (pdf or physical) in the same manner :) |
19:09
🔗
|
plue |
^ |
19:10
🔗
|
ola_norsk |
wheter or not if the awards were made out of cardboard, it would be cool i think |
19:11
🔗
|
ola_norsk |
"Archivist of <year>" ..etc |
19:14
🔗
|
godane |
i did upload 449,998 items one year: https://archive.org/details/@chris85?and[]=addeddate:2016 |
19:14
🔗
|
ola_norsk |
"Internet Archive, Most User Friendly Company of <year>" ..etc |
19:15
🔗
|
ola_norsk |
that company award might even be an incentive for companies to give a shit about user data.. |
19:17
🔗
|
godane |
i'm still working on the archivebox project |
19:18
🔗
|
mabynogy |
what is it? |
19:18
🔗
|
ola_norsk |
godane: i gave you a 'favorite' for your efforts :) |
19:19
🔗
|
godane |
its meant to be a rpi box hosting kiwix wikipedia + piratebox |
19:21
🔗
|
godane |
right now kiwix as a problem with 4gb index that crashes kiwix-serve |
19:22
🔗
|
godane |
the hope is that it get fix in the next month then zim files can be rebuild |
19:22
🔗
|
mabynogy |
interesting |
19:23
🔗
|
mabynogy |
one of my archiving related ideas is a software nas |
19:24
🔗
|
godane |
i got this for the start kit to build it: https://www.amazon.com/CanaKit-Raspberry-Complete-Starter-Kit/dp/B01C6Q2GSY |
19:25
🔗
|
godane |
that case was alot better then anything else i got so far |
19:25
🔗
|
godane |
every other case was going fall apart on me for some reason |
19:30
🔗
|
riking |
so, interesting situation. I was reviewing my recent uploads and I think something I archived is just outright copyvio. https://archive.org/details/MSPFA_50_201802 It's basically a copy of the Sesame Street book with a few minor edits and a replaced ending. |
19:32
🔗
|
ola_norsk |
to anyone who's using webrecorder, there's an issue that causes broken WARCS https://github.com/webrecorder/webrecorder/issues/456 |
19:34
🔗
|
ola_norsk |
if i'm not mistaken, this issue caused my https://archive.org/details/WARC_www_ronmiscavigebook_com item to be currently broken |
19:34
🔗
|
riking |
fuuuu. "wow, this one has a lot of youtube videos. i wonder why" (open up on live site) bwe.png bwe.png bwe.png fuck you photobucket |
19:35
🔗
|
riking |
good to see that my 503 Slow Down handling is working though |
19:47
🔗
|
riking |
Okay i'm going to ask again - when doing S3 uploads, how do I not make it queue a task for every single uploaded file? |
19:48
🔗
|
astrid |
there's a magic recipe for this, 1sec |
19:49
🔗
|
astrid |
from the doc: https://archive.org/help/abouts3.txt |
19:49
🔗
|
astrid |
x-archive-queue-derive:0 |
19:51
🔗
|
riking |
i'm talking about the archive.php jobs though? |
19:52
🔗
|
riking |
does queue-derive not make those? |
19:52
🔗
|
riking |
queue-derive-0 rather |
19:53
🔗
|
riking |
i'll take a screenshot of catalog.php... |
19:53
🔗
|
astrid |
what's your issue with archive.php jobs |
19:54
🔗
|
riking |
they're properly "S3 snowballing" but my account currently has like 800 queued |
19:54
🔗
|
astrid |
i still fail to see the issue |
19:54
🔗
|
astrid |
computer will do its thing, relax |
19:55
🔗
|
astrid |
have some tea and look at trees maybe |
19:57
🔗
|
riking |
clearly, the proper solution is to have the upload script check the task queue and tell itself to slow down, rather than waiting for a SlowDown error |
19:59
🔗
|
astrid |
i still don't understand what the issue is |
19:59
🔗
|
astrid |
snowballing is by design |
19:59
🔗
|
riking |
It feels like I'm being a "noisy neighbor", clogging up the task queue for everyone else |
19:59
🔗
|
astrid |
nah |
20:00
🔗
|
astrid |
s3 queues an archive.php task for every PUT regardless |
20:00
🔗
|
astrid |
if an archive.php task finishes its work and sees more work waiting, it'll do that too |
20:00
🔗
|
astrid |
then the next archive.php to come along will walk in, look around, see nothing waiting for it to do, and leave |
20:00
🔗
|
astrid |
so they'll all evaporate real quick |
20:01
🔗
|
astrid |
i've had thousands of queued tasks also |
20:01
🔗
|
astrid |
i like to treat it like a game |
20:01
🔗
|
ola_norsk |
trust the Brewster! https://ia800109.us.archive.org/10/items/bkahle_past_present_orwellian/bkahle_present.png |
20:01
🔗
|
astrid |
computer race! |
20:02
🔗
|
riking |
Oh, well it's not really fair because my script is doing concurrent uploads instead of one file at a time. |
20:02
🔗
|
astrid |
archive.php is absolutely necessary ... i think it takes the files off the s3 server and puts them into the petabox thingy |
20:03
🔗
|
riking |
Yeah I was thinking, could I upload multiple files, then have one archive.php job do all of them at the start |
20:03
🔗
|
riking |
but whatever :) |
20:03
🔗
|
astrid |
computer will do computer things. it's designed to deal with your shit |
20:05
🔗
|
riking |
I tried torrent uploads at one point but the files all get marked as derived (not original) and also I moved to a net connection that blocks torrents |
20:06
🔗
|
riking |
I guess I'm kinda a perfectionist. the script checks for already uploaded files, but then checks that both the size and md5 match |
20:07
🔗
|
riking |
and then reuses that md5 calculation for the Content-MD5: header |
20:07
🔗
|
astrid |
yeah the "torrent uploads are derivations" thing bugs me too |
20:07
🔗
|
astrid |
ah good, checksums <3 |
20:10
🔗
|
riking |
btw if someone has a service-worker JS script that can serve files out of a WARC, I could be using that instead of uploading every image as its own file |
20:18
🔗
|
riking |
and... i wouldn't even need to do url rewriting i think? and i could catch CSS stylesheet assets without writing a recursive parse across @import ? |
20:19
🔗
|
riking |
wait no i would still need the recursive parse i just wouldn't need to rewrite the stylesheets. |
20:26
🔗
|
|
BartoCH has joined #archiveteam-bs |
20:31
🔗
|
|
mabynogy has quit IRC (Quit: dpt.slasheva.com) |
20:58
🔗
|
|
ablabiX has joined #archiveteam-bs |
21:00
🔗
|
|
Xibalba has quit IRC (Ping timeout: 480 seconds) |
21:00
🔗
|
|
ablabiX is now known as Xibalba |
21:01
🔗
|
|
RichardG has quit IRC (Ping timeout: 245 seconds) |
21:27
🔗
|
|
C4K3 has quit IRC (leaving) |
21:27
🔗
|
|
C4K3 has joined #archiveteam-bs |
21:40
🔗
|
|
mabynogy has joined #archiveteam-bs |
21:40
🔗
|
|
mabynogy has quit IRC (Client Quit) |
21:45
🔗
|
|
dashcloud has joined #archiveteam-bs |
21:51
🔗
|
|
Ravenloft has joined #archiveteam-bs |
21:52
🔗
|
|
BlueMax has joined #archiveteam-bs |
22:32
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 250 seconds) |
22:32
🔗
|
|
Mateon1 has joined #archiveteam-bs |
22:59
🔗
|
godane |
SketchCow: so i'm on tape 5 now |
23:15
🔗
|
|
RichardG has joined #archiveteam-bs |
23:18
🔗
|
|
ola_norsk has quit IRC (I's in not shape for internat for tnight.. https://youtu.be/8MnF6tonFY4) |