| Time |
Nickname |
Message |
|
00:04
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
00:08
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
00:16
🔗
|
|
C4K3 has joined #archiveteam-bs |
|
00:19
🔗
|
Ryz |
In regards to the amount of text in the descriptions in https://www.archiveteam.org/index.php?title=Disestablishments_in_2015 - is there a way to make the font size smaller? |
|
00:20
🔗
|
Ryz |
Also, the list seems to be busted, referring to the Joystiq entry that somehow has 8 entries within it? |
|
00:22
🔗
|
|
Martle has joined #archiveteam-bs |
|
00:24
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
00:26
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
00:27
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
00:55
🔗
|
|
alex__ has quit IRC (Quit: take care ye all. Have fun!) |
|
01:04
🔗
|
|
Flashback has quit IRC (Ping timeout: 252 seconds) |
|
01:04
🔗
|
|
kiskabak has quit IRC (Ping timeout: 265 seconds) |
|
01:04
🔗
|
|
w0rmybak has quit IRC (Ping timeout: 265 seconds) |
|
01:09
🔗
|
|
qw3rty118 has joined #archiveteam-bs |
|
01:16
🔗
|
|
ivan` has joined #archiveteam-bs |
|
01:18
🔗
|
|
Mayeau has joined #archiveteam-bs |
|
01:18
🔗
|
|
Albardin has quit IRC (Ping timeout: 600 seconds) |
|
01:22
🔗
|
|
qw3rty118 has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
dxrt_ has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
Mayonaise has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
ivan has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
qw3rty117 has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
sep332 has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
kiska1 has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
REiN^ has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
PhrackD has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
TigerbotH has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
JTL has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
squires has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
branden has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
wmvhater has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
PotcFdk has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
RedType has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
Fusl_ has quit IRC (ny.us.hub irc.choopa.net) |
|
01:22
🔗
|
|
mistym has quit IRC (ny.us.hub irc.choopa.net) |
|
01:26
🔗
|
|
Fusl has joined #archiveteam-bs |
|
01:27
🔗
|
|
mistym- has joined #archiveteam-bs |
|
01:31
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
01:31
🔗
|
icedice |
Sanqui: I think even smaller Discords are ok if they're engaged in illegal acts that are legal to archive |
|
01:31
🔗
|
icedice |
Say extremist Discord servers |
|
01:32
🔗
|
icedice |
I assume those exist, at least |
|
01:33
🔗
|
icedice |
* ok to archive |
|
01:34
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
01:47
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
01:50
🔗
|
|
Mayeau is now known as Mayonaise |
|
01:51
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
01:59
🔗
|
|
VerifiedJ has quit IRC (Quit: Leaving) |
|
02:01
🔗
|
|
RedType has joined #archiveteam-bs |
|
02:05
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
02:05
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
02:06
🔗
|
|
PotcFdk has joined #archiveteam-bs |
|
02:06
🔗
|
|
icedice has joined #archiveteam-bs |
|
02:09
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
02:13
🔗
|
|
branden has joined #archiveteam-bs |
|
02:13
🔗
|
|
qw3rty118 has joined #archiveteam-bs |
|
02:14
🔗
|
|
wmvhater has joined #archiveteam-bs |
|
02:14
🔗
|
|
squires has joined #archiveteam-bs |
|
02:14
🔗
|
|
sep332 has joined #archiveteam-bs |
|
02:14
🔗
|
|
JTL has joined #archiveteam-bs |
|
02:14
🔗
|
|
dxrt_ has joined #archiveteam-bs |
|
02:14
🔗
|
|
dxrt sets mode: +o dxrt_ |
|
02:14
🔗
|
|
kiska1 has joined #archiveteam-bs |
|
02:14
🔗
|
|
PhrackD has joined #archiveteam-bs |
|
02:14
🔗
|
|
TigerbotH has joined #archiveteam-bs |
|
02:19
🔗
|
|
REiN^ has joined #archiveteam-bs |
|
02:22
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
02:26
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
02:35
🔗
|
SketchCow |
Archive |
|
02:35
🔗
|
SketchCow |
Every |
|
02:35
🔗
|
SketchCow |
Discord |
|
02:35
🔗
|
SketchCow |
You |
|
02:35
🔗
|
SketchCow |
Are |
|
02:35
🔗
|
SketchCow |
Allowed |
|
02:35
🔗
|
SketchCow |
On |
|
02:38
🔗
|
|
Martle_ has joined #archiveteam-bs |
|
02:38
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
02:38
🔗
|
Martle_ |
SketchCow: What tool do you recommend for archiving Discord servers? |
|
02:40
🔗
|
|
Martle has quit IRC (Ping timeout: 252 seconds) |
|
02:40
🔗
|
|
Martle_ is now known as Martle |
|
02:43
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
02:43
🔗
|
anarcat |
Martle: https://www.archiveteam.org/index.php?title=Discord |
|
02:43
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
02:43
🔗
|
Martle |
anarcat: Should have known, thanks! |
|
02:44
🔗
|
|
icedice has joined #archiveteam-bs |
|
02:49
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
02:49
🔗
|
|
icedice has joined #archiveteam-bs |
|
03:16
🔗
|
ivan` |
is Discord about to end its incredible adventure? |
|
03:16
🔗
|
|
ivan` is now known as ivan |
|
03:16
🔗
|
hdch |
nah |
|
03:51
🔗
|
SketchCow |
I actually don't know |
|
03:51
🔗
|
SketchCow |
Discord is NOT |
|
03:51
🔗
|
SketchCow |
But it is definitely culture and things worth saving |
|
04:35
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
04:37
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
04:38
🔗
|
|
qw3rty119 has joined #archiveteam-bs |
|
04:43
🔗
|
|
qw3rty118 has quit IRC (Ping timeout: 600 seconds) |
|
04:51
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
04:54
🔗
|
|
odemg has quit IRC (Ping timeout: 260 seconds) |
|
04:55
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:06
🔗
|
|
odemg has joined #archiveteam-bs |
|
05:08
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
05:11
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:12
🔗
|
|
VADemon has quit IRC (Read error: Connection reset by peer) |
|
05:24
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
05:27
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:39
🔗
|
|
hdch has quit IRC (Remote host closed the connection) |
|
06:00
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
06:01
🔗
|
|
Jusque has quit IRC (Ping timeout: 260 seconds) |
|
06:02
🔗
|
|
Jusque has joined #archiveteam-bs |
|
06:05
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
06:09
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
06:22
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
06:25
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
06:38
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
06:40
🔗
|
|
Martle has quit IRC (Read error: Connection reset by peer) |
|
06:40
🔗
|
|
Martle has joined #archiveteam-bs |
|
06:41
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
06:56
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
06:59
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
07:10
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
07:15
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
07:41
🔗
|
|
fredgido_ has joined #archiveteam-bs |
|
07:44
🔗
|
Ryz |
Here's a noteworthy link that has to do with Flicker, there's Flicker Hive Mind, it's "a data mining tool for the Flickr database of photography" - https://hiveminer.com/Tags/mosaic%2Cnuggets |
|
07:45
🔗
|
|
fredgido has quit IRC (Ping timeout: 360 seconds) |
|
07:57
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
07:59
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
08:00
🔗
|
|
eprillios has quit IRC (Ping timeout: 360 seconds) |
|
08:00
🔗
|
|
Pixi` has joined #archiveteam-bs |
|
08:03
🔗
|
|
znak_ has joined #archiveteam-bs |
|
08:03
🔗
|
|
znak has quit IRC (Read error: Operation timed out) |
|
08:03
🔗
|
|
arkiver has quit IRC (Read error: Operation timed out) |
|
08:05
🔗
|
|
balrog has quit IRC (Read error: Operation timed out) |
|
08:05
🔗
|
|
twigfoot has quit IRC (Ping timeout: 360 seconds) |
|
08:05
🔗
|
|
moufu has quit IRC (Read error: Connection reset by peer) |
|
08:05
🔗
|
|
moufu_ has joined #archiveteam-bs |
|
08:05
🔗
|
|
superkuh has quit IRC (Excess Flood) |
|
08:05
🔗
|
|
arkiver has joined #archiveteam-bs |
|
08:05
🔗
|
|
balrog has joined #archiveteam-bs |
|
08:05
🔗
|
|
swebb sets mode: +o balrog |
|
08:06
🔗
|
|
superkuh has joined #archiveteam-bs |
|
08:07
🔗
|
|
unlobito has quit IRC (Ping timeout: 360 seconds) |
|
08:07
🔗
|
|
Somebody2 has quit IRC (Ping timeout: 360 seconds) |
|
08:07
🔗
|
|
twigfoot has joined #archiveteam-bs |
|
08:07
🔗
|
|
unlobito has joined #archiveteam-bs |
|
08:08
🔗
|
|
Somebody2 has joined #archiveteam-bs |
|
08:09
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 360 seconds) |
|
08:09
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
08:10
🔗
|
|
eprillios has joined #archiveteam-bs |
|
08:13
🔗
|
|
Pixi has quit IRC (Read error: Operation timed out) |
|
08:14
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
08:18
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
08:31
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
08:33
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
09:12
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
09:14
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
09:28
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
09:30
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
09:47
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
10:06
🔗
|
|
DopefishJ has joined #archiveteam-bs |
|
10:06
🔗
|
|
swebb sets mode: +o DopefishJ |
|
10:06
🔗
|
|
apache2_ has joined #archiveteam-bs |
|
10:07
🔗
|
|
apache2 has quit IRC (Read error: Connection reset by peer) |
|
10:07
🔗
|
|
vectr0n_ has joined #archiveteam-bs |
|
10:08
🔗
|
|
DFJustin has quit IRC (Ping timeout: 260 seconds) |
|
10:08
🔗
|
|
hiroi has left Be back later... |
|
10:09
🔗
|
|
vectr0n has quit IRC (Ping timeout: 260 seconds) |
|
10:09
🔗
|
|
vectr0n_ is now known as vectr0n |
|
10:11
🔗
|
|
t2t2 has quit IRC (Ping timeout: 260 seconds) |
|
10:11
🔗
|
|
jodizzle has quit IRC (Ping timeout: 260 seconds) |
|
10:11
🔗
|
|
t2t2 has joined #archiveteam-bs |
|
10:11
🔗
|
|
jodizzle has joined #archiveteam-bs |
|
10:11
🔗
|
|
Odd0002 has quit IRC (Ping timeout: 260 seconds) |
|
10:12
🔗
|
|
Odd0002 has joined #archiveteam-bs |
|
10:12
🔗
|
|
brayden_ has quit IRC (Ping timeout: 260 seconds) |
|
10:12
🔗
|
|
brayden has joined #archiveteam-bs |
|
10:12
🔗
|
|
swebb sets mode: +o brayden |
|
10:17
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
10:20
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
10:20
🔗
|
|
Ryz has quit IRC (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) |
|
10:48
🔗
|
|
DopefishJ is now known as DFJustin |
|
10:51
🔗
|
VoynichCr |
what is the best way to upload image albums to IA? |
|
10:51
🔗
|
VoynichCr |
if you upload a zip or directory into an item, it generates a slideshow? |
|
10:58
🔗
|
|
m007a83_ has joined #archiveteam-bs |
|
11:03
🔗
|
|
m007a83 has quit IRC (Read error: Operation timed out) |
|
11:14
🔗
|
VoynichCr |
is there any documentation on how items in image collection are rendered? |
|
11:15
🔗
|
|
adinbied has quit IRC (Read error: Connection reset by peer) |
|
11:16
🔗
|
eientei95 |
VoynichCr: Image albums? Probably as a zip |
|
11:16
🔗
|
eientei95 |
I know if you name a zip <something>_images.zip it makes them into a book |
|
11:17
🔗
|
|
adinbied has joined #archiveteam-bs |
|
11:17
🔗
|
VoynichCr |
eientei95: thanks for the info |
|
11:18
🔗
|
Sanqui |
ADD is getting distracted by archiving discord servers when everything else (irl) is on fire |
|
11:18
🔗
|
Sanqui |
https://etc.sanqui.net/discord_stats/ |
|
11:33
🔗
|
|
m007a83__ has joined #archiveteam-bs |
|
11:37
🔗
|
|
m007a83_ has quit IRC (Ping timeout: 252 seconds) |
|
12:23
🔗
|
eientei95 |
Sanqui: Why is pret listed twice |
|
12:23
🔗
|
Sanqui |
eientei95: because it moved |
|
12:23
🔗
|
eientei95 |
... huh |
|
12:24
🔗
|
Sanqui |
the original was abandoned |
|
12:39
🔗
|
Sanqui |
everybody is moving to discord |
|
12:39
🔗
|
Sanqui |
if you visit band forums, they're dead, and somebody stops by and makes a thread "btw we've all been on discord for the past year, join us" |
|
13:01
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
13:05
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
13:05
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
13:06
🔗
|
|
Stilett0 has quit IRC (Read error: Operation timed out) |
|
13:09
🔗
|
|
Stiletto has quit IRC (Ping timeout: 264 seconds) |
|
13:09
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
13:34
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
13:35
🔗
|
|
Stiletto has quit IRC (Ping timeout: 264 seconds) |
|
13:58
🔗
|
|
VADemon has joined #archiveteam-bs |
|
14:17
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
14:19
🔗
|
|
m007a83__ is now known as m007a83 |
|
14:21
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
14:33
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
14:37
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
14:37
🔗
|
Sanqui |
https://screen.sanqui.net/2018-11-12T15:36:55-Selection.png |
|
14:42
🔗
|
|
hdch has joined #archiveteam-bs |
|
14:50
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
14:52
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
14:53
🔗
|
|
Mateon1 has quit IRC (Ping timeout: 265 seconds) |
|
14:53
🔗
|
|
Mateon1 has joined #archiveteam-bs |
|
14:53
🔗
|
|
m007a83 has quit IRC (Read error: Connection reset by peer) |
|
14:54
🔗
|
|
m007a83 has joined #archiveteam-bs |
|
14:56
🔗
|
|
Ing3b0rg has quit IRC (Quit: woopwoop) |
|
14:56
🔗
|
|
Ing3b0rg has joined #archiveteam-bs |
|
14:58
🔗
|
|
i0npulse has quit IRC (Ping timeout: 252 seconds) |
|
14:59
🔗
|
|
i0npulse has joined #archiveteam-bs |
|
15:11
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
15:16
🔗
|
|
godane has joined #archiveteam-bs |
|
15:35
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
15:40
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
15:48
🔗
|
uzerus |
thanks JAA for adding info :) im now calculating for blogspot.com . However there is no way to get complete list, it's always better than enumeration. |
|
15:50
🔗
|
uzerus |
just waiting for rapid7 response about account validation, that i can download more archives and compare results. Archives are one per month, and every A DNS record archive is size of 15GB. So it will take some time. |
|
15:51
🔗
|
|
hdch has quit IRC (Read error: Operation timed out) |
|
15:52
🔗
|
uzerus |
in the result we have more reasons to start blog warrior project. |
|
15:52
🔗
|
uzerus |
just my 5 pens |
|
15:53
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
15:58
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
16:34
🔗
|
Sanqui |
moufu_: is it just me, or does pullcord essentially not log message timestamps? |
|
16:34
🔗
|
Sanqui |
the timestamps are of fetch time, not contemporary. I can see edit times however only a fraction of messages get edited |
|
16:38
🔗
|
moufu_ |
Sanqui: message timestamps are in the IDs afaik |
|
16:38
🔗
|
moufu_ |
https://discordapp.com/developers/docs/reference#snowflakes |
|
16:39
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
16:39
🔗
|
Sanqui |
oh, I see... dumb owl. thanks |
|
16:40
🔗
|
Sanqui |
moufu_: in any case, i opened some issues, you probably saw them. they all abort the scrape |
|
16:42
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
16:42
🔗
|
moufu_ |
yeah, fixed one already |
|
16:42
🔗
|
moufu_ |
right now I'm handling errors by just restarting pullcord when something bad happens, but I agree it's not ideal because you can't even set up retrying externally since there's no difference between fatal and retry-able errors |
|
16:43
🔗
|
moufu_ |
the #⃣ one looks like an issue with the discord lib I'm using |
|
16:43
🔗
|
Sanqui |
however some of these issues block further scrape of the guild |
|
16:44
🔗
|
moufu_ |
well the idea was to assume all errors are either something temporary (== can retry later) or a bug in pullcord |
|
16:44
🔗
|
Sanqui |
one is literally a discord problem, where they point to a file that's 404 |
|
16:45
🔗
|
Sanqui |
on their cdn |
|
16:45
🔗
|
moufu_ |
yeah fixed that one |
|
16:45
🔗
|
Sanqui |
not much you can do about that |
|
16:45
🔗
|
Sanqui |
missing access are IMO channels you don't have permission to read |
|
16:45
🔗
|
Sanqui |
but if there are newer channels which you do, pullcord won't reach them, I'm assuming |
|
16:46
🔗
|
moufu_ |
it should, I was just lazy and added them all to -C instead of ignoring missing access errors |
|
16:47
🔗
|
Sanqui |
oh, yeah, I guess that'd do it |
|
16:47
🔗
|
Sanqui |
but it's too manual :p |
|
16:47
🔗
|
moufu_ |
yeah it's kinda annoying to do |
|
17:10
🔗
|
|
Martle has quit IRC (Remote host closed the connection) |
|
17:31
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
17:34
🔗
|
moufu_ |
Sanqui: what do the bars on your stats page mean? |
|
17:34
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
17:35
🔗
|
Sanqui |
moufu_: first bar is channels+members, second bar is total size of text data |
|
17:35
🔗
|
Sanqui |
just a quick visualization of size/volume |
|
17:41
🔗
|
Sanqui |
but yeah most of my scrapes terminate on 50001 now and I can't be bothered to workaround that haha |
|
17:41
🔗
|
|
n00b068 has joined #archiveteam-bs |
|
17:41
🔗
|
Sanqui |
(no pressure! :D) |
|
17:42
🔗
|
|
n00b068 has quit IRC (Client Quit) |
|
17:42
🔗
|
|
n00b068 has joined #archiveteam-bs |
|
17:42
🔗
|
|
n00b068 has quit IRC (Client Quit) |
|
17:43
🔗
|
|
n00b905 has joined #archiveteam-bs |
|
17:43
🔗
|
|
n00b905 has quit IRC (Client Quit) |
|
17:47
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
17:50
🔗
|
|
schbirid has joined #archiveteam-bs |
|
17:50
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
17:55
🔗
|
|
Ryz has joined #archiveteam-bs |
|
18:13
🔗
|
|
Stilett0 has quit IRC (Read error: Operation timed out) |
|
18:14
🔗
|
|
Dimtree has quit IRC (Read error: Operation timed out) |
|
18:15
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
18:23
🔗
|
|
Martle has joined #archiveteam-bs |
|
18:24
🔗
|
|
hdch has joined #archiveteam-bs |
|
18:28
🔗
|
uzerus |
https://transfer.sh/JOpU1/blogspot.com-2018-10-26-fdns.tar.gz |
|
18:28
🔗
|
kiska |
Here is mine: https://transfer.sh/xPKBt/blogspot-any-data |
|
18:28
🔗
|
uzerus |
can some1 add it to AT wiki? it's a list of subdomains, 1,1mln |
|
18:29
🔗
|
uzerus |
kiska: how much subdomains? :S |
|
18:29
🔗
|
uzerus |
:D* |
|
18:29
🔗
|
kiska |
wc -l says "1106014" |
|
18:29
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
18:29
🔗
|
uzerus |
1,104 mln :/ |
|
18:30
🔗
|
uzerus |
im waiting for response from rapid7, account confirmation |
|
18:30
🔗
|
kiska |
thats cause my data set is "2018-11-02-1541117143-fdns_any.json.gz" |
|
18:30
🔗
|
uzerus |
so i can get historical data |
|
18:30
🔗
|
uzerus |
i use the A record, not any |
|
18:31
🔗
|
uzerus |
it avoids me to get 2 domains in one line from CNAME record |
|
18:31
🔗
|
uzerus |
google.comfacebook.com looks like :/ |
|
18:32
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
18:33
🔗
|
kiska |
I could get my data from another source namely the dns root servers |
|
18:33
🔗
|
kiska |
But I can't share that, cause there is a thing called NDA"s |
|
18:33
🔗
|
kiska |
NDA's* |
|
18:34
🔗
|
uzerus |
yeah |
|
18:34
🔗
|
uzerus |
i want to get more archives from rapid7 to get more domains :/ |
|
18:35
🔗
|
uzerus |
i think there can be 10x more than we have |
|
18:36
🔗
|
kiska |
Here is the dataset I have access to https://www.impactcybertrust.org/dataset_view?idDataset=884 |
|
18:36
🔗
|
kiska |
However I can't share that... |
|
18:36
🔗
|
uzerus |
im wondering about archiving copy of old archives, but... i don't have money for bigger VPS, im on 5Mbps connection |
|
18:37
🔗
|
uzerus |
wow |
|
18:37
🔗
|
uzerus |
kiska: you are god! |
|
18:38
🔗
|
uzerus |
for this time i don't even have HDD to download it xD |
|
18:38
🔗
|
kiska |
Neither do I |
|
18:39
🔗
|
kiska |
I have signed a "Researcher Memorandum of Agreement" so I can't share it :( |
|
18:40
🔗
|
uzerus |
i want to buy 3x 2TB HDD for home server, you know, ZFS, gentoo, XEN ... windows gaming in DOMu... |
|
18:41
🔗
|
uzerus |
but raidz1 with 3 disks give me read speed x2.5 write speed ~x1.3 and the space :D n disks - 1, so 4TB |
|
18:41
🔗
|
uzerus |
what cpu you have kiska? |
|
18:42
🔗
|
kiska |
Archivebot at my home runs on Dual Xeon X5570's with 24GB of memory + 2x 146GB drives in RAID 0 |
|
18:42
🔗
|
uzerus |
WOW |
|
18:42
🔗
|
kiska |
Anyway I am going back to sleep since its only 5:42am here in Sydney |
|
18:42
🔗
|
uzerus |
ive fx8350 |
|
18:42
🔗
|
uzerus |
ok, goodn..day? |
|
18:44
🔗
|
kiska |
Oh and my desktop runs a Dual Xeon E5-2670 with 64 GB of DDR3-ECC and 8x 4TB drives in RAID 5 |
|
18:45
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
18:47
🔗
|
Martle |
kiska: Sweet rig |
|
18:50
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
19:01
🔗
|
|
VerifiedJ has quit IRC (Read error: Connection reset by peer) |
|
19:20
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
19:22
🔗
|
godane |
i'm starting to upload 1968 episodes of ABC Evening News : https://archive.org/details/ABC-evening-news-1968-08-05 |
|
19:25
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
19:28
🔗
|
Ryz |
I have another ArchiveBot idea, companies that were acquired by other companies; there's almost no way their websites would not change at all |
|
19:28
🔗
|
|
hdch has quit IRC (Remote host closed the connection) |
|
19:29
🔗
|
|
hdch has joined #archiveteam-bs |
|
19:31
🔗
|
Ryz |
Saying this since inXile Entertainment is acquired by Microsoft, and that Obsidian Entertainment will be too afterward |
|
19:31
🔗
|
Ryz |
Like, there's not much remains of the old PopCap website now that EA (Electronic Arts) owns that company |
|
19:37
🔗
|
|
unlobito has quit IRC (Ping timeout: 600 seconds) |
|
19:37
🔗
|
|
unlobito has joined #archiveteam-bs |
|
19:48
🔗
|
JAA |
His website has been hugged to death, it seems: http://therealstanlee.com/ I'll throw it into ArchiveBot once it comes back online. |
|
19:49
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
19:49
🔗
|
|
odemg has joined #archiveteam-bs |
|
19:50
🔗
|
SketchCow |
Active Interface: eth0 Interface Speed: unknown |
|
19:50
🔗
|
SketchCow |
Current RX Speed: 55343.21 KB/s Current TX Speed: 11975.39 KB/s |
|
19:50
🔗
|
SketchCow |
Graph Top RX Speed: 59788.25 KB/s Graph Top TX Speed: 59827.72 KB/s |
|
19:50
🔗
|
SketchCow |
Overall Top RX Speed: 114946.09 KB/s Overall Top TX Speed: 98109.55 KB/s |
|
19:50
🔗
|
SketchCow |
Received Packets: 30227631106 Transmitted Packets: 20659419156 |
|
19:50
🔗
|
SketchCow |
GBytes Received: 99990.275 GB GBytes Transmitted: 93133.099 GB |
|
19:50
🔗
|
SketchCow |
Errors on Receiving: 0 Errors on Transmission: 0 |
|
19:50
🔗
|
SketchCow |
Thus concludes me running Slurm for 3 days |
|
19:52
🔗
|
anarcat |
i take it that's a gigabit link? |
|
19:52
🔗
|
anarcat |
i fixed that "Interface Speed: unknown" bug btw - https://github.com/mattthias/slurm/pull/29 |
|
19:55
🔗
|
Martle |
Matt Drudge deleted all his tweets, anybody have them? |
|
19:55
🔗
|
Martle |
https://www.twitter.com/DRUDGE |
|
20:00
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
20:03
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
20:06
🔗
|
Sanqui |
moufu_: is running `go get github.com/tsudoko/pullcord/...` again supposed to fetch me master? |
|
20:07
🔗
|
Sanqui |
because I'm still getting the reaction problem |
|
20:12
🔗
|
|
wp494 has quit IRC (Ping timeout: 255 seconds) |
|
20:12
🔗
|
|
wp494 has joined #archiveteam-bs |
|
20:13
🔗
|
moufu_ |
you need to add -u (go get -u (...)) |
|
20:16
🔗
|
anarcat |
go get you! |
|
20:17
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
20:21
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
20:21
🔗
|
moufu_ |
alternatively you could cd $GOPATH/src/github.com/tsudoko/pullcord/cmd/pullcord && git pull --recurse-submodules && go install |
|
20:24
🔗
|
Sanqui |
moufu_: https://pastebin.com/raw/PXsDq97d |
|
20:24
🔗
|
Sanqui |
why does this feel so flimsy ?! |
|
20:25
🔗
|
moufu_ |
¯\_(ツ)_/¯ |
|
20:25
🔗
|
Sanqui |
https://pastebin.com/raw/MiegQ2LT |
|
20:26
🔗
|
moufu_ |
you need to go to cmd/pullcord |
|
20:26
🔗
|
moufu_ |
the repo should've been on master after running the first command btw |
|
20:26
🔗
|
moufu_ |
it just failed to pull the submodule |
|
20:27
🔗
|
Sanqui |
alright, did the trick, and no more error |
|
20:27
🔗
|
Sanqui |
thanks! |
|
20:31
🔗
|
moufu_ |
Sanqui: btw is the source code for your stats page up somewhere? |
|
20:31
🔗
|
Sanqui |
moufu_: it's a small python script I wrote just for this purpose but I can publish it |
|
20:38
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
20:38
🔗
|
Sanqui |
moufu_: https://github.com/Sanqui/pullcord-discord-stats |
|
20:39
🔗
|
moufu_ |
thanks |
|
20:39
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
20:41
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
20:52
🔗
|
|
hdch has quit IRC (Remote host closed the connection) |
|
20:52
🔗
|
|
hdch has joined #archiveteam-bs |
|
21:03
🔗
|
|
odemg has quit IRC (Ping timeout: 260 seconds) |
|
21:14
🔗
|
Ryz |
Weeks ago, I randomly found http://www.keepstake.com/all-marks?page=92 - which has a database of randomly submitted links going as far back as 2002; those links could be majorly archive-worthy |
|
21:15
🔗
|
|
odemg has joined #archiveteam-bs |
|
21:16
🔗
|
Ryz |
It's called Keepstake to note |
|
21:16
🔗
|
|
schbirid has quit IRC (Remote host closed the connection) |
|
21:22
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
21:25
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
21:37
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
21:42
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
21:45
🔗
|
|
Martle has quit IRC (Read error: Connection reset by peer) |
|
21:55
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
21:57
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
22:08
🔗
|
|
Meroje has quit IRC (Quit: bye!) |
|
22:09
🔗
|
VoynichCr |
i am again here to talk about image galleries in IA items |
|
22:09
🔗
|
|
Meroje has joined #archiveteam-bs |
|
22:10
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
22:10
🔗
|
VoynichCr |
if you upload 100 pics (5 Mb each one, average resolution today), when you browse the item, all images are downloaded at full resolution and shown in the slideshow |
|
22:10
🔗
|
VoynichCr |
what the hell man |
|
22:10
🔗
|
godane |
SketchCow: so i'm using book pavilion program |
|
22:10
🔗
|
godane |
i doesn't have the weird slow scan issues that vuescan has |
|
22:12
🔗
|
JAA |
VoynichCr: You might want to ask info@archive.org about that if you don't get an answer here. |
|
22:14
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
22:16
🔗
|
VoynichCr |
JAA: sure, though the usability for image items seems poor. Probably i will have to upload a resized version of images (so the system generates a small size slideshow) and a full resolution files in a separate zip |
|
22:16
🔗
|
JAA |
Yeah, probably. At least you can still download individual images from within a zip on IA. |
|
22:17
🔗
|
|
CarlM has joined #archiveteam-bs |
|
22:18
🔗
|
CarlM |
Hihi |
|
22:18
🔗
|
CarlM |
[17:16:59] <CarlM> Noob question: How do I build pullcord? Is there a specific order in which I have to build the subdirectories or anything or? |
|
22:19
🔗
|
moufu_ |
cd cmd/pullcord && go install |
|
22:20
🔗
|
|
moufu_ is now known as moufu |
|
22:21
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
22:21
🔗
|
CarlM |
Alright |
|
22:29
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
22:29
🔗
|
* |
CarlM goes :| at Chocolatey and Git |
|
22:33
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
22:35
🔗
|
CarlM |
Bluh, I can't remember how to include stuff brought in from other repositories (discordgo in this case) when cloning |
|
22:35
🔗
|
* |
CarlM facedesks at his stupidity |
|
22:36
🔗
|
moufu |
git submodule update --init |
|
22:37
🔗
|
CarlM |
Thanks x_x |
|
22:37
🔗
|
VoynichCr |
JAA: email sent |
|
22:39
🔗
|
CarlM |
https://paste.ee/p/7y8bu wtf |
|
22:39
🔗
|
moufu |
the repo needs to be in your $GOPATH |
|
22:39
🔗
|
VoynichCr |
i would like to move my image albums from flickr to IA, and use just IA, but the usability isnt good right now |
|
22:39
🔗
|
CarlM |
Ah >_< |
|
22:41
🔗
|
CarlM |
https://paste.ee/p/WMft5 |
|
22:42
🔗
|
CarlM |
(the same error results when trying to run `go build`, if that matters) |
|
22:42
🔗
|
moufu |
okay I wasn't specific enough |
|
22:45
🔗
|
moufu |
you need to move the repo directory to $GOPATH/src/github.com/tsudoko |
|
22:45
🔗
|
CarlM |
WTF |
|
22:45
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
22:46
🔗
|
moufu |
`go get github.com/tsudoko/pullcord/...` would've done that for you automatically, sorry, I assumed you used `go get` to get the repo |
|
22:47
🔗
|
CarlM |
No, I used `git clone` :x |
|
22:47
🔗
|
moufu |
now I kinda understand a bit why so many people complain about gopath |
|
22:47
🔗
|
anarcat |
haven't they fixed that in 1.12? or 1.11? |
|
22:49
🔗
|
moufu |
there are modules, yeah, haven't looked into them yet |
|
22:50
🔗
|
anarcat |
hmm.. yeah, but even without modules, i think GOPATH is not necessary anymore |
|
22:50
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
22:50
🔗
|
CarlM |
`2018/11/12 17:50:04 opening the websocket connection failed:websocket: close 4004: Authentication failed.` How do I authenticate? |
|
22:51
🔗
|
anarcat |
moufu: no, you're right, modules are the alternative to gopath |
|
22:51
🔗
|
anarcat |
https://blog.golang.org/go1.11 |
|
22:51
🔗
|
moufu |
CarlM: you need to pass a token or username and password |
|
22:51
🔗
|
moufu |
CarlM: see `pullcord -h` |
|
22:52
🔗
|
CarlM |
Sorry I'm so stupid >_<; |
|
22:52
🔗
|
CarlM |
And it fails because I have two-factor authentication enabled :( |
|
22:55
🔗
|
moufu |
well 2fa isn't implemented in any discord lib afaik because automating 2fa login is a ban trigger |
|
22:55
🔗
|
CarlM |
Huh |
|
22:55
🔗
|
moufu |
according to https://github.com/discordapp/discord-api-docs/issues/69#issuecomment-223886862 you can use the token you get after logging in, but I haven't tried it |
|
22:56
🔗
|
CarlM |
It seems to work for me... right up until it tries to change an avatar's extension from .png.part to .png and gets told off because something else is also using that file, so it dies |
|
22:57
🔗
|
|
uzerus has quit IRC (Ping timeout: 255 seconds) |
|
22:59
🔗
|
CarlM |
If I do the renaming for it, it proceeds to choke on the next avatar in the same way :x |
|
23:02
🔗
|
moufu |
you're on windows, right? |
|
23:02
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
23:03
🔗
|
CarlM |
I am |
|
23:04
🔗
|
moufu |
I don't have any windows machines atm, but I'll look into it if I get access to one |
|
23:05
🔗
|
|
odemg has quit IRC (Ping timeout: 260 seconds) |
|
23:06
🔗
|
CarlM |
OK :x |
|
23:06
🔗
|
moufu |
okay I think I know why it happens |
|
23:06
🔗
|
* |
CarlM 's desktop can also boot Mac OS X, but given that it has an NVIDIA graphics card and runs Mojave, he's content to let that OS sit in mothballs for the time being |
|
23:06
🔗
|
CarlM |
Oh? |
|
23:07
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
23:08
🔗
|
moufu |
try pulling from the repo and rebuilding, might be fixed now |
|
23:14
🔗
|
CarlM |
It appears to be working now |
|
23:15
🔗
|
moufu |
good |
|
23:17
🔗
|
|
Martle has joined #archiveteam-bs |
|
23:17
🔗
|
|
odemg has joined #archiveteam-bs |
|
23:19
🔗
|
Flashfire |
Stan lee is dead did we save his stuff?? |
|
23:20
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
23:21
🔗
|
CarlM |
And I ran into issue #4, yaaaaaaaaaaaaaay :( |
|
23:24
🔗
|
|
BartoCH has quit IRC (Remote host closed the connection) |
|
23:24
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
23:24
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
23:25
🔗
|
moufu |
you can exclude channels with -C for now |
|
23:26
🔗
|
Lord_Nigh |
"<anonymous> so jacob mathias settled for 12 million dollars https://torrentfreak.com/images/romsjudg.pdf, I wonder how much he actually made" |
|
23:30
🔗
|
CarlM |
Even after passing that argument, no matter whether or not I include the guild ID, it chokes on the same channel for the same reason |
|
23:35
🔗
|
CarlM |
Now it's working again |
|
23:37
🔗
|
|
Sk1d has quit IRC (Read error: Operation timed out) |
|
23:39
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
23:40
🔗
|
|
Macro has joined #archiveteam-bs |
|
23:46
🔗
|
|
twoTBHetz has joined #archiveteam-bs |