| Time |
Nickname |
Message |
|
00:04
🔗
|
|
odemg has joined #archiveteam-bs |
|
00:14
🔗
|
|
pnJay has quit IRC (Leaving) |
|
00:33
🔗
|
SketchCow |
One moment, off to destroy my systems |
|
00:33
🔗
|
|
SketchCow has quit IRC (Quit: leaving) |
|
00:48
🔗
|
|
SketchCow has joined #archiveteam-bs |
|
00:48
🔗
|
|
swebb sets mode: +o SketchCow |
|
01:10
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
02:18
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
02:26
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
02:40
🔗
|
|
pizzaiolo has quit IRC (Remote host closed the connection) |
|
02:46
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
03:03
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
03:05
🔗
|
|
ndiddy has quit IRC () |
|
03:16
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
03:19
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
03:24
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
03:32
🔗
|
|
squires has quit IRC (Ping timeout (120 seconds)) |
|
03:38
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
04:01
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
04:17
🔗
|
|
odemg2 has joined #archiveteam-bs |
|
04:20
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
|
04:36
🔗
|
|
odemg has joined #archiveteam-bs |
|
04:39
🔗
|
|
Stiletto has joined #archiveteam-bs |
|
04:39
🔗
|
|
odemg2 has quit IRC (Read error: Operation timed out) |
|
04:40
🔗
|
|
Stilett0 has quit IRC (Ping timeout: 244 seconds) |
|
04:41
🔗
|
|
odemg2 has joined #archiveteam-bs |
|
04:42
🔗
|
|
odemg has quit IRC (Read error: Operation timed out) |
|
04:43
🔗
|
|
inittux has quit IRC (Read error: Operation timed out) |
|
04:51
🔗
|
|
inittux has joined #archiveteam-bs |
|
04:56
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
05:43
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
06:05
🔗
|
|
rocode has quit IRC (Ping timeout: 246 seconds) |
|
06:05
🔗
|
|
luckcolor has quit IRC (Ping timeout: 245 seconds) |
|
06:06
🔗
|
|
luckcolor has joined #archiveteam-bs |
|
06:07
🔗
|
|
rocode has joined #archiveteam-bs |
|
06:24
🔗
|
|
brayden has quit IRC (Read error: Connection reset by peer) |
|
06:25
🔗
|
|
brayden has joined #archiveteam-bs |
|
06:25
🔗
|
|
swebb sets mode: +o brayden |
|
06:47
🔗
|
|
inittux has quit IRC (Read error: Operation timed out) |
|
06:48
🔗
|
|
inittux has joined #archiveteam-bs |
|
06:49
🔗
|
|
Stiletto has quit IRC (Read error: Operation timed out) |
|
06:49
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
07:08
🔗
|
|
arbin_ has quit IRC (Read error: Connection reset by peer) |
|
07:35
🔗
|
|
odemg2 has quit IRC (Remote host closed the connection) |
|
07:37
🔗
|
|
vitzli has joined #archiveteam-bs |
|
07:44
🔗
|
vitzli |
SketchCow, downloading, editing and uploading _scandata.xml files works for a simple user, item's bookreader got updated immediately, thumbnail - some time later (after the derive was done) |
|
07:55
🔗
|
|
w0rp has quit IRC (Read error: Connection reset by peer) |
|
07:55
🔗
|
|
w0rp has joined #archiveteam-bs |
|
07:56
🔗
|
|
JAA has joined #archiveteam-bs |
|
07:58
🔗
|
JAA |
Sanqui, SketchCow: I would recommend simp_le over Certbot. Although the latter is probably a bit easier to use (as in: just run a command, set up a cron job, and forget about it), it must be run as root and modifies the web server's configuration files. |
|
07:59
🔗
|
JAA |
It's also a very complex program, meaning it's a very painful task to verify that it's doing what it claims it's doing. |
|
08:00
🔗
|
Sanqui |
also an option. Personally I trust LE and EFF. |
|
08:00
🔗
|
JAA |
simp_le is a little bit more complicated to set up, but it's still only a few steps. It can run as any user, which needs to have sudo privileges to reload the web server. Otherwise, it can be run entirely isolated. |
|
08:08
🔗
|
JAA |
Yeah, I don't think that LE or EFF are doing anything funky, but I prefer having control over the process and not unnecessarily running stuff as root. |
|
08:10
🔗
|
JAA |
Note, the original simp_le by koba is broken and unmaintained. Here's an active fork: https://github.com/zenhack/simp_le |
|
08:18
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
08:22
🔗
|
|
bwn has joined #archiveteam-bs |
|
09:24
🔗
|
|
Jonison has joined #archiveteam-bs |
|
09:51
🔗
|
|
GE has joined #archiveteam-bs |
|
11:16
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
11:58
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
12:05
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
12:10
🔗
|
|
Stilett0 has quit IRC (Read error: Connection reset by peer) |
|
12:39
🔗
|
|
bwn has quit IRC (Ping timeout: 244 seconds) |
|
12:44
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
12:45
🔗
|
|
Stilett0 is now known as Stiletto |
|
12:48
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
12:49
🔗
|
|
bwn has joined #archiveteam-bs |
|
12:57
🔗
|
|
GE has joined #archiveteam-bs |
|
13:23
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
13:39
🔗
|
SketchCow |
vitzli: I'm surprised to hear it but happy it is the case. |
|
13:41
🔗
|
|
JAA has quit IRC (Ping timeout: 268 seconds) |
|
13:42
🔗
|
|
JAA has joined #archiveteam-bs |
|
14:05
🔗
|
|
Dahnak has quit IRC (Quit: Dahnak Quit) |
|
14:11
🔗
|
|
Dahnak has joined #archiveteam-bs |
|
14:20
🔗
|
|
Dahnak has quit IRC (Quit: Dahnak Quit) |
|
14:21
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
14:24
🔗
|
|
Dahnak has joined #archiveteam-bs |
|
14:58
🔗
|
|
Petri152 has quit IRC (Read error: Operation timed out) |
|
15:05
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
15:10
🔗
|
|
Petri152 has joined #archiveteam-bs |
|
15:10
🔗
|
|
VADemon has joined #archiveteam-bs |
|
15:22
🔗
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
|
15:40
🔗
|
midas |
joepie91: the drupal soap is real |
|
15:52
🔗
|
godane |
SketchCow: your getting a special Toys R Us catalog |
|
15:52
🔗
|
godane |
from japan in 1998 |
|
15:54
🔗
|
godane |
https://archive.org/details/Toys-R-Us-Japan-1998-Holiday-Catalog |
|
16:02
🔗
|
joepie91 |
FYI: Sixxs shutting down |
|
16:02
🔗
|
joepie91 |
https://www.sixxs.net/sunset/ |
|
16:13
🔗
|
xmc |
SketchCow: i'm still interested in any scandata.xml docs you can drop on me, btw |
|
16:15
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
16:20
🔗
|
|
vitzli has quit IRC (Quit: Leaving) |
|
16:22
🔗
|
|
bwn has quit IRC (Ping timeout: 960 seconds) |
|
16:48
🔗
|
|
RichardG has joined #archiveteam-bs |
|
16:57
🔗
|
zino |
Do we have a sanctioned way of archiving youtube channels? I continuously archive several for my own personal use with youtube-sync, but that only stores the videos, no meta-data besides title and or no comments. |
|
16:57
🔗
|
zino |
Re: JAAs comment in #archiveteam about SourceFed shutting down. |
|
17:04
🔗
|
PurpleSym |
Wrt youtube: What happened to videobot? |
|
17:21
🔗
|
arkiver |
videobot supports twitter and periscope |
|
17:21
🔗
|
arkiver |
not yet youtube |
|
17:21
🔗
|
arkiver |
I really need to get on with adding youtube |
|
17:21
🔗
|
arkiver |
#videobot |
|
17:21
🔗
|
arkiver |
can archive single twitter videos, full twitter accounts, periscope videos |
|
17:22
🔗
|
arkiver |
also hashtags |
|
17:22
🔗
|
arkiver |
all videos will be uploaded as individual video items to the videobot collection on IA |
|
17:29
🔗
|
|
JAA has joined #archiveteam-bs |
|
18:11
🔗
|
|
bwn has joined #archiveteam-bs |
|
18:16
🔗
|
rocode |
JAA, it looks like mininova changed since I last visited it. How much data are we talking here if we grab the stuff that they are single seeder on? |
|
18:17
🔗
|
|
bwn has quit IRC (Read error: Operation timed out) |
|
18:24
🔗
|
|
bwn has joined #archiveteam-bs |
|
18:29
🔗
|
JAA |
rocode: here comes a rough estimate... |
|
18:30
🔗
|
JAA |
Of the ~13k music torrents, ~2k have 2+ seeders. For the Games > Windows category, a bit less than ~5k of ~43k have 2+ seeders. |
|
18:30
🔗
|
JAA |
As an upper estimate, let's say that 10% are seeded sufficiently, i.e. 90% would need to be archived. |
|
18:31
🔗
|
JAA |
The median size for Music torrents from a random page (200 torrents) is 55 MiB. |
|
18:31
🔗
|
JAA |
The games are much smaller it seems. |
|
18:31
🔗
|
JAA |
Let's say 40 MiB on average. |
|
18:32
🔗
|
JAA |
That would be 90% * 72k torrents * 40 MiB/torrent = 2.6 TiB |
|
18:33
🔗
|
JAA |
Which actually doesn't seem that big. Not sure how I ended up with the two-digit TB estimate earlier. |
|
18:34
🔗
|
JAA |
If 90% is single-seeded anyway, might as well grab everything for 2.9 TiB total. |
|
18:37
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
18:38
🔗
|
JAA |
Average size for games seems to be on the order of 3-5 MiB. |
|
18:55
🔗
|
|
pnJay has joined #archiveteam-bs |
|
18:57
🔗
|
|
Dark_Star has quit IRC (Ping timeout: 633 seconds) |
|
18:58
🔗
|
|
Dark_Star has joined #archiveteam-bs |
|
20:01
🔗
|
|
tammy_ has joined #archiveteam-bs |
|
20:10
🔗
|
|
odemg has joined #archiveteam-bs |
|
20:15
🔗
|
|
GE has joined #archiveteam-bs |
|
20:33
🔗
|
JAA |
Mininova status so far: INFO Duration: 23:24:44. Speed: 11.1 KiB/s. INFO Downloaded: 55196 files, 746.4 MiB. |
|
20:33
🔗
|
JAA |
Probably not going to finish in time at this rate, decreasing --wait a bit again |
|
20:47
🔗
|
tammy_ |
window merge |
|
20:50
🔗
|
|
sep332 has quit IRC (Quit: konversation out) |
|
20:54
🔗
|
JAA |
Shit, I forgot --warc-append. :-( |
|
20:59
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
21:00
🔗
|
|
odemg has joined #archiveteam-bs |
|
21:01
🔗
|
|
GE_ has joined #archiveteam-bs |
|
21:02
🔗
|
|
GE has quit IRC (Ping timeout: 255 seconds) |
|
21:02
🔗
|
|
GE_ is now known as GE |
|
21:10
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
21:10
🔗
|
|
odemg has joined #archiveteam-bs |
|
21:23
🔗
|
|
sep332 has joined #archiveteam-bs |
|
21:30
🔗
|
|
Stiletto has quit IRC (Ping timeout: 250 seconds) |
|
21:34
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
21:46
🔗
|
|
godane has joined #archiveteam-bs |
|
22:01
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
22:05
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
22:13
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
22:31
🔗
|
godane |
so i think this close to what IA wants for the internet: https://github.com/lbryio/lbry |
|
22:33
🔗
|
pizzaiolo |
SketchCow criticized it briefly but I'd like to hear more on why they're scummy |
|
22:33
🔗
|
godane |
i'm just found out about it again |
|
22:34
🔗
|
godane |
i don't remember seeing it before |
|
22:34
🔗
|
godane |
main website: https://lbry.io/ |
|
22:38
🔗
|
Sanqui |
ipfs does it better. |
|
22:39
🔗
|
Sanqui |
some words from a friend: "Just because blockchains are the in thing right now does not make them suited to everything." "The transfer model is rather crude - non-resumable, single-source downloads. No chunking." "It's luring people in with 'make money by publishing stuff.'" |
|
22:42
🔗
|
|
odemg has joined #archiveteam-bs |
|
22:44
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
23:06
🔗
|
joepie91 |
Sanqui: obligatory: https://gist.github.com/joepie91/e49d2bdc9dfec4adc9da8a8434fd029b |
|
23:06
🔗
|
joepie91 |
also, no amount of blockchainery is going to give you assurances about data integrity |
|
23:12
🔗
|
Sanqui |
joepie91: nice, thanks |
|
23:14
🔗
|
|
Dark_Star has quit IRC (Ping timeout: 245 seconds) |
|
23:14
🔗
|
|
Jonison has quit IRC (Read error: Connection reset by peer) |
|
23:15
🔗
|
|
BartoCH has joined #archiveteam-bs |
|
23:17
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
23:19
🔗
|
|
BartoCH has quit IRC (Ping timeout: 260 seconds) |
|
23:26
🔗
|
|
Dark_Star has joined #archiveteam-bs |
|
23:29
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
23:59
🔗
|
|
antiufo_ has joined #archiveteam-bs |