| Time |
Nickname |
Message |
|
00:01
🔗
|
|
WIDOW has left |
|
00:07
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
00:12
🔗
|
JAA |
tammy_: I'm off to bed. Let me know if you have questions or encounter any problems. (I'll read the logs.) |
|
00:12
🔗
|
tammy_ |
JAA: when installing wpull: !!! WARNING !!! The Trollius project is now deprecated! |
|
00:12
🔗
|
JAA |
Hah, talk about timing. |
|
00:12
🔗
|
tammy_ |
my skeptisism levels are over 9000 |
|
00:12
🔗
|
tammy_ |
:) |
|
00:15
🔗
|
|
godane has joined #archiveteam-bs |
|
00:15
🔗
|
JAA |
Yeah, I think I had that as well. Trollius was replaced in version 2.0, but that's buggy. I think you can just ignore it. |
|
00:16
🔗
|
tammy_ |
so just create script.py in my mounted array folder and run the command in gistfile1.txt ? |
|
00:16
🔗
|
JAA |
Yep |
|
00:25
🔗
|
tammy_ |
JAA: it's going to town |
|
00:26
🔗
|
JAA |
Nice! |
|
00:29
🔗
|
tammy_ |
incoming rate: 5145 kbps |
|
00:29
🔗
|
tammy_ |
bouncing lots |
|
00:31
🔗
|
JAA |
Did you keep the concurrency and wait values from my command? |
|
00:31
🔗
|
tammy_ |
yeah, I left it all alone |
|
00:33
🔗
|
JAA |
I got 800 kB/s in my test earlier. Some 'Connection closed', but not too many. (And wpull will retry those at the end anyway.) |
|
00:33
🔗
|
tammy_ |
oh good, cause I'm seeing some connection closed's as well |
|
00:37
🔗
|
JAA |
Alright, really off to bed now, cya tomorrow |
|
00:37
🔗
|
tammy_ |
see ya |
|
00:38
🔗
|
|
JAA has quit IRC (Quit: Page closed) |
|
01:23
🔗
|
|
chfoo has quit IRC (Read error: Operation timed out) |
|
01:24
🔗
|
|
Meroje has quit IRC (Ping timeout: 260 seconds) |
|
01:28
🔗
|
|
chfoo has joined #archiveteam-bs |
|
01:37
🔗
|
|
Meroje has joined #archiveteam-bs |
|
01:38
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
01:41
🔗
|
|
pizzaiolo has left |
|
03:09
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
04:23
🔗
|
|
DopefishJ has joined #archiveteam-bs |
|
04:24
🔗
|
|
DFJustin has quit IRC (Read error: Operation timed out) |
|
04:26
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
04:32
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
04:32
🔗
|
|
Sk1d has quit IRC (Connection closed) |
|
04:34
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
04:34
🔗
|
|
Sk1d has quit IRC (Connection Closed) |
|
05:15
🔗
|
|
woktenna has left Leaving |
|
07:00
🔗
|
|
wp494 has quit IRC (Read error: Connection reset by peer) |
|
07:09
🔗
|
|
schbirid has joined #archiveteam-bs |
|
07:25
🔗
|
|
wp494 has joined #archiveteam-bs |
|
07:40
🔗
|
|
Jonison has joined #archiveteam-bs |
|
07:49
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
08:33
🔗
|
|
GE has joined #archiveteam-bs |
|
09:30
🔗
|
|
BlueMaxim has quit IRC (Read error: Operation timed out) |
|
09:32
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
09:42
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
09:53
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
10:40
🔗
|
|
odemg has joined #archiveteam-bs |
|
11:25
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
11:27
🔗
|
|
GE has joined #archiveteam-bs |
|
12:01
🔗
|
|
godane has quit IRC (Quit: Leaving.) |
|
12:02
🔗
|
|
godane has joined #archiveteam-bs |
|
12:04
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
12:08
🔗
|
|
bsmith093 has quit IRC (Ping timeout: 250 seconds) |
|
13:49
🔗
|
odemg |
someone run this |
|
13:49
🔗
|
odemg |
wget http://datahoarder2.eieidoh.net:2052/contact/chaturbate_links_13Apr.txt && cat chaturbate_links_13Apr.txt | parallel --jobs 8 'wget -m -np -c -U "DataHoarder:$(date +%s)" --reject "index.html*" {}' |
|
13:50
🔗
|
Kaz |
uh |
|
13:50
🔗
|
Kaz |
are you trying to get a mirror or smth? |
|
13:51
🔗
|
odemg |
yeah, just writing up release for r/Datahoarder /contact is 7TB the video content is 1.7PB |
|
13:59
🔗
|
|
Stilett0 is now known as Stiletto |
|
14:14
🔗
|
|
kniffy has quit IRC (Quit: --) |
|
14:18
🔗
|
|
fie has quit IRC (Read error: Connection reset by peer) |
|
14:27
🔗
|
HCross2 |
odemg: where do you get all this storage? |
|
14:31
🔗
|
|
fie has joined #archiveteam-bs |
|
14:32
🔗
|
|
pnJay has joined #archiveteam-bs |
|
14:35
🔗
|
SketchCow |
-rw-r--r-- 1 root root 576594901908 Apr 11 05:31 2017-04-10.download.nvidia.com.zip |
|
14:35
🔗
|
SketchCow |
-rw-r--r-- 1 root root 17268187 Apr 13 14:29 2017-04-10.download.nvidia.com.zip.txt |
|
14:35
🔗
|
SketchCow |
ha HA |
|
14:42
🔗
|
odemg |
sexy |
|
14:51
🔗
|
godane |
https://groups.google.com/forum/#!topic/phantomjs/9aI5d-LDuNE |
|
14:52
🔗
|
godane |
looks like the maintainer of phantomjs is stepping down |
|
14:57
🔗
|
|
kniffy has joined #archiveteam-bs |
|
15:00
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
15:10
🔗
|
joepie91 |
that was a matter of time, really |
|
15:39
🔗
|
odemg |
Kaz, can we give it to archivebot? |
|
15:40
🔗
|
odemg |
turns out i can only keep it online for the month |
|
15:53
🔗
|
|
Jonison has quit IRC (Read error: Connection reset by peer) |
|
16:19
🔗
|
|
Boppen has joined #archiveteam-bs |
|
16:34
🔗
|
DopefishJ |
sounds too big |
|
16:34
🔗
|
|
DopefishJ is now known as DFJustin |
|
16:35
🔗
|
|
Smiley has quit IRC (Read error: Connection reset by peer) |
|
16:35
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
16:35
🔗
|
|
Smiley has joined #archiveteam-bs |
|
16:36
🔗
|
DFJustin |
also there's not much value in warcing temporary URLs like that, it would be better to upload to IA as items |
|
16:50
🔗
|
odemg |
DFJustin, how do i automate getting 7tb into ia |
|
16:51
🔗
|
odemg |
100,000's of files |
|
16:53
🔗
|
|
odemg2 has joined #archiveteam-bs |
|
16:55
🔗
|
odemg2 |
DFJustin, that's the only thing holding me back pushing to ia is i want to set and forget |
|
17:03
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
17:03
🔗
|
|
odemg has quit IRC (Ping timeout: 633 seconds) |
|
17:06
🔗
|
|
pizzaiolo has quit IRC (Ping timeout: 255 seconds) |
|
17:08
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
17:13
🔗
|
DFJustin |
https://internetarchive.readthedocs.io/en/latest/cli.html#upload |
|
17:14
🔗
|
DFJustin |
it's more work but I just did an archivebot job that blew up after 50gb so there's no way 7tb is in the cards |
|
17:17
🔗
|
DFJustin |
alternatively you can set up your own archivebot locally https://github.com/ludios/grab-site |
|
17:19
🔗
|
DFJustin |
hmm I guess that doesn't have the auto-uploader piece |
|
17:22
🔗
|
odemg2 |
nope |
|
17:23
🔗
|
odemg2 |
is there a oneliner to use on a dir with python ia? |
|
17:26
🔗
|
xmc |
IA will accept a .csv so maybe that will do what you want? |
|
17:28
🔗
|
odemg2 |
yeah I looked at the .csv format and I'm not a fan of manually writing shit in and I'm too high to figure out how I'd ls/tree > csv |
|
17:28
🔗
|
odemg2 |
why is there a 2 after my name |
|
17:53
🔗
|
SketchCow |
You're twice the man the rest of us are |
|
17:54
🔗
|
xmc |
except for HCross2 and hook54321 |
|
17:55
🔗
|
HCross2 |
Mainly because I can't be bothered to RDP into my server atm |
|
17:55
🔗
|
schbirid |
odemg2: you pinged out (connection died silently), you could /nick odemg back to it |
|
17:55
🔗
|
schbirid |
impressive collection! |
|
17:55
🔗
|
|
odemg2 is now known as odemg |
|
18:15
🔗
|
|
yuitimoth has quit IRC (Ping timeout: 260 seconds) |
|
18:21
🔗
|
|
yuitimoth has joined #archiveteam-bs |
|
18:41
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
18:47
🔗
|
|
signius has joined #archiveteam-bs |
|
18:48
🔗
|
|
signius has quit IRC (Client Quit) |
|
18:59
🔗
|
|
signius has joined #archiveteam-bs |
|
19:27
🔗
|
|
icedice has joined #archiveteam-bs |
|
20:01
🔗
|
|
C4K3_ has joined #archiveteam-bs |
|
20:03
🔗
|
|
C4K3 has quit IRC (Read error: Operation timed out) |
|
20:05
🔗
|
|
zino has quit IRC (Remote host closed the connection) |
|
20:12
🔗
|
|
GE has joined #archiveteam-bs |
|
20:17
🔗
|
|
VeganMars has quit IRC (Quit: ZNC - http://znc.in) |
|
20:18
🔗
|
|
VeganMars has joined #archiveteam-bs |
|
20:23
🔗
|
|
signius has quit IRC (Leaving) |
|
20:25
🔗
|
|
C4K3_ is now known as C4K3 |
|
20:47
🔗
|
|
pnJay has quit IRC (Quit: Leaving) |
|
20:53
🔗
|
Lord_Nigh |
SketchCow: https://www.dropbox.com/s/pw9kl909dxtk5l9/arcade%20asset%20holders.txt?dl=0 |
|
20:54
🔗
|
Lord_Nigh |
and https://twitter.com/JohnAndersen21/status/851151734319853568 |
|
20:54
🔗
|
Lord_Nigh |
who owns what IP in the arcade/video game world is a fucking mess |
|
21:00
🔗
|
odemg |
https://www.reddit.com/r/DataHoarder/comments/6583s2/the_petabyte_porn_problem_public_webcam_social |
|
21:14
🔗
|
SketchCow |
That is a messy and complicated document |
|
21:14
🔗
|
SketchCow |
Also, lists Nintendo as "does not care" and definitely cares |
|
21:14
🔗
|
SketchCow |
Was going to put this into the MAME documentation myself, based on takedowns |
|
21:14
🔗
|
SketchCow |
#2: JUNE 1984. |
|
21:15
🔗
|
|
pizzaiol1 has joined #archiveteam-bs |
|
21:19
🔗
|
|
pizzaiolo has quit IRC (Read error: Operation timed out) |
|
21:20
🔗
|
wp494 |
wait a sec, why is recommended project ipernity when it's currently stalled out due to a wave of 403s |
|
21:21
🔗
|
wp494 |
and URLTeam seems to be chugging along fine |
|
21:35
🔗
|
|
schbirid has quit IRC (Quit: Leaving) |
|
21:42
🔗
|
|
antomatic has quit IRC (Ping timeout: 250 seconds) |
|
21:43
🔗
|
Lord_Nigh |
SketchCow: lemme add that then |
|
21:44
🔗
|
Lord_Nigh |
SketchCow: updated |
|
21:45
🔗
|
Lord_Nigh |
SketchCow: i'd love to add your version of to MAME docs if you submit a pr |
|
21:45
🔗
|
Lord_Nigh |
i'm also guessing bandai-namco cares due to pac man, but i don't recall any mention of that by you |
|
22:02
🔗
|
|
antomatic has joined #archiveteam-bs |
|
22:05
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
22:08
🔗
|
|
pizzaiol1 has quit IRC (Ping timeout: 260 seconds) |
|
22:09
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
22:21
🔗
|
|
htw has quit IRC (Quit.) |
|
22:21
🔗
|
|
htw has joined #archiveteam-bs |
|
22:21
🔗
|
|
htw has quit IRC (Client Quit) |
|
22:22
🔗
|
|
htw has joined #archiveteam-bs |
|
22:22
🔗
|
|
htw has quit IRC (Client Quit) |
|
22:38
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
22:39
🔗
|
|
RichardG has joined #archiveteam-bs |
|
22:45
🔗
|
|
Stiletto has quit IRC (Ping timeout: 260 seconds) |
|
22:50
🔗
|
|
htw has joined #archiveteam-bs |
|
22:52
🔗
|
|
htw has quit IRC (Client Quit) |
|
22:52
🔗
|
|
htw has joined #archiveteam-bs |
|
23:18
🔗
|
|
Stilett0 has joined #archiveteam-bs |
|
23:37
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
23:49
🔗
|
|
Odd0002 has joined #archiveteam-bs |
|
23:49
🔗
|
Odd0002 |
port forwarding is running but the "server" is giving me no data |
|
23:50
🔗
|
Kaz |
Odd0002: if possible, set the adapter to bridge mode, so it gets its own IP on the network |
|
23:52
🔗
|
|
RichardG_ has joined #archiveteam-bs |
|
23:52
🔗
|
Odd0002 |
even running wget localhost:8001 inside the VM responds with "HTTP request sent, awaiting response... No data received." |
|
23:54
🔗
|
|
RichardG has quit IRC (Ping timeout: 370 seconds) |
|
23:55
🔗
|
Odd0002 |
no, even when it gets its own IP, http://192.168.1.25:8001/ still says that no data is being sent |