| Time |
Nickname |
Message |
|
00:10
🔗
|
|
icedice has quit IRC (Quit: Leaving) |
|
00:19
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
00:29
🔗
|
JensRex |
https://www.wired.com/2017/02/diehard-coders-just-saved-nasas-earth-science-data/ |
|
00:55
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
01:13
🔗
|
|
Oddy has quit IRC (Read error: Operation timed out) |
|
01:58
🔗
|
MrRadar |
arkiver (or anyone with access to the tracker): Please queue more IMDB items |
|
02:00
🔗
|
MrRadar |
Also, update on my troubles with Scaleway: I've done enough testing to determine that either Scaleway's network is corrupting outgoing packets or Cogent is. Note that all my servers are in their Amsterdam data center, I haven't tested Paris |
|
02:00
🔗
|
arkiver |
have a look at the tracker |
|
02:00
🔗
|
MrRadar |
Ooops, need to upgrade my scripts |
|
02:01
🔗
|
MrRadar |
(I just glanced at it and though it was still the "no more items" message) |
|
02:03
🔗
|
MrRadar |
If you want to see the amazing data corruption for yourself, download http://scaleway1.2by2.info:8000/test.dat (32 MB of random garbage) and hash it with sha1sum. The correct checksum is 7a205b814a593d6d96bf5a209c2ce4db1aa41810 but I've never gotten a non-corrupted version over plain HTTP at home, work, or on my phone (over cellular data) |
|
02:03
🔗
|
MrRadar |
(^^^ regarding Scaleway/Cogent) |
|
02:07
🔗
|
|
grafchokr has joined #archiveteam-bs |
|
02:09
🔗
|
|
User404 has quit IRC (Read error: Operation timed out) |
|
02:09
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
02:10
🔗
|
spiko |
MrRadar, a bit off topic but I banned whole IP ranges of scaleway and ovh from accessing my websites - so much wordpress trackback spam/ddos attempts |
|
02:10
🔗
|
spiko |
have not such a good opinion about them |
|
02:10
🔗
|
|
odemg has joined #archiveteam-bs |
|
02:10
🔗
|
MrRadar |
Yeah, I only went with them because they were dirt cheap and warriors don't need much beyond reliable network... and they can't even provide that |
|
02:11
🔗
|
MrRadar |
If their support doesn't get back to me with good news I'll just cut my losses and find another VPS provider. I should only be out about $10 |
|
02:12
🔗
|
spiko |
support might help yeah.. anyways, sleep timebb |
|
02:12
🔗
|
|
grafchoke has quit IRC (Read error: Operation timed out) |
|
02:14
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
02:15
🔗
|
|
odemg has joined #archiveteam-bs |
|
02:18
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
02:19
🔗
|
|
odemg has joined #archiveteam-bs |
|
02:24
🔗
|
|
spiko has quit IRC (Leaving) |
|
02:26
🔗
|
|
ndiddy has quit IRC (Read error: Connection reset by peer) |
|
02:27
🔗
|
|
ndiddy has joined #archiveteam-bs |
|
02:31
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
02:32
🔗
|
|
odemg has joined #archiveteam-bs |
|
02:35
🔗
|
SN4T14 |
JensRex, sucks that there's no mention there of our 150TB of stuff from ftp-gov |
|
02:58
🔗
|
|
pizzaiolo has quit IRC (Remote host closed the connection) |
|
03:02
🔗
|
godane |
someone should grab this: https://online.wr.usgs.gov/calendar/archives.html |
|
03:28
🔗
|
SN4T14 |
godane, this doesn't look *that* big |
|
03:29
🔗
|
SN4T14 |
Or am I missing something? |
|
03:34
🔗
|
SN4T14 |
It's 165 lectures, they seem to be about 500MB on average, that's only 80GB or so |
|
03:55
🔗
|
|
User404 has joined #archiveteam-bs |
|
04:05
🔗
|
|
GE has joined #archiveteam-bs |
|
04:18
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
04:34
🔗
|
|
odemg has joined #archiveteam-bs |
|
04:48
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
04:56
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
04:57
🔗
|
|
odemg has joined #archiveteam-bs |
|
05:22
🔗
|
|
Sk1d has joined #archiveteam-bs |
|
05:45
🔗
|
|
Aoede has quit IRC (Ping timeout: 260 seconds) |
|
06:28
🔗
|
|
Aoede has joined #archiveteam-bs |
|
06:29
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
06:30
🔗
|
Aoede |
I think my DNS died... Added google dns to resolv.conf and now stuff works again |
|
06:38
🔗
|
|
kniffy has quit IRC (Ping timeout: 240 seconds) |
|
06:45
🔗
|
|
kniffy has joined #archiveteam-bs |
|
06:50
🔗
|
Aoede |
no wait it's just my broken ipv6 |
|
06:59
🔗
|
|
Honno has joined #archiveteam-bs |
|
07:10
🔗
|
|
superkuh has quit IRC (Read error: Operation timed out) |
|
07:33
🔗
|
|
superkuh has joined #archiveteam-bs |
|
07:39
🔗
|
|
schbirid has joined #archiveteam-bs |
|
07:41
🔗
|
|
schbirid has quit IRC (Client Quit) |
|
07:46
🔗
|
|
schbirid has joined #archiveteam-bs |
|
07:50
🔗
|
|
Aoede has quit IRC (Ping timeout: 260 seconds) |
|
07:51
🔗
|
|
bwn has quit IRC (Ping timeout: 244 seconds) |
|
07:56
🔗
|
|
bwn has joined #archiveteam-bs |
|
07:59
🔗
|
|
Aoede has joined #archiveteam-bs |
|
08:07
🔗
|
|
icedice has joined #archiveteam-bs |
|
08:17
🔗
|
|
HP has joined #archiveteam-bs |
|
08:49
🔗
|
|
ravetcofx has quit IRC (Read error: Operation timed out) |
|
09:00
🔗
|
|
Oddy has joined #archiveteam-bs |
|
09:13
🔗
|
|
GE has joined #archiveteam-bs |
|
09:15
🔗
|
|
superkuh has quit IRC (Read error: Operation timed out) |
|
09:19
🔗
|
|
superkuh has joined #archiveteam-bs |
|
09:21
🔗
|
|
Oddy has quit IRC (Read error: Operation timed out) |
|
09:48
🔗
|
|
Aoede has quit IRC (Read error: Connection reset by peer) |
|
09:51
🔗
|
|
icedice has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) |
|
09:59
🔗
|
|
Aoede has joined #archiveteam-bs |
|
10:02
🔗
|
Aoede |
Well I fixed it... No idea what I did though |
|
10:11
🔗
|
|
icedice has joined #archiveteam-bs |
|
10:18
🔗
|
|
GE has quit IRC (Remote host closed the connection) |
|
10:19
🔗
|
|
altlabel has joined #archiveteam-bs |
|
11:22
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
11:35
🔗
|
|
User405 has joined #archiveteam-bs |
|
11:37
🔗
|
|
User404 has quit IRC (Read error: Connection reset by peer) |
|
11:41
🔗
|
|
Honno_ has joined #archiveteam-bs |
|
11:42
🔗
|
|
User405 has quit IRC (Quit: Leaving) |
|
11:45
🔗
|
|
Honno has quit IRC (Ping timeout: 370 seconds) |
|
11:45
🔗
|
|
GE has joined #archiveteam-bs |
|
11:58
🔗
|
JensRex |
Someone with Wiki access, please add a note to the imdb page about limiting concurrency to 1, to avoid debilitating rate limiting or even IP bans. |
|
12:17
🔗
|
|
RichardG has joined #archiveteam-bs |
|
12:36
🔗
|
|
VADemon has joined #archiveteam-bs |
|
12:38
🔗
|
|
Boppen has quit IRC (Ping timeout: 194 seconds) |
|
12:38
🔗
|
|
Boppen has joined #archiveteam-bs |
|
13:10
🔗
|
icedice |
You can sign up for the wiki yourself if you want |
|
13:10
🔗
|
icedice |
The signup password should yahoosucks |
|
13:10
🔗
|
icedice |
ping JensRex |
|
13:11
🔗
|
icedice |
*should be |
|
13:11
🔗
|
JensRex |
Alright. I didn't know how stingy AT is with handing out Wiki access to internet strangers :) |
|
13:12
🔗
|
Aoede |
I think the password was changed, after someone spammed the wiki |
|
13:13
🔗
|
JensRex |
I have created an unholy abomination in VirtualBox. |
|
13:14
🔗
|
JensRex |
My warrior with 8GB RAM is out of memory running ftp-gov. |
|
13:15
🔗
|
JensRex |
So I created a ram disk in Windows. Mounted it as a shared folder. Created an ext4 filesystem in a file. Mounted it as a loopback device. Created a swapfile there and enabled that. |
|
13:15
🔗
|
JensRex |
I don't know if this will work :/ |
|
13:26
🔗
|
JensRex |
It's not going well. |
|
13:29
🔗
|
VADemon |
Wpull or some under the hood processes has insane RAM requirements |
|
13:29
🔗
|
JensRex |
Indeed. ftp-gov pulled a 9,1GB file. |
|
13:29
🔗
|
JensRex |
Something is wonky with vbox shared folders. |
|
13:30
🔗
|
JensRex |
cat /proc/swaps |
|
13:30
🔗
|
JensRex |
Filename Type Size Used Priority |
|
13:30
🔗
|
JensRex |
/mnt/ffs/dongs file 9215996 2850440 -1 |
|
13:30
🔗
|
JensRex |
Still, grind grind grind. |
|
13:32
🔗
|
JensRex |
45 MB/s on the mounted "RAM" drive. |
|
13:33
🔗
|
icedice |
Btw, what makes you prefer wpull over wget? |
|
13:33
🔗
|
icedice |
Just curious |
|
13:33
🔗
|
icedice |
(Noob here) |
|
13:35
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
14:37
🔗
|
sep332 |
what' the channel for the Yahoo Answers grab? |
|
14:39
🔗
|
VADemon |
#noanswers / whois |
|
15:05
🔗
|
sep332 |
thanks VADemon |
|
15:06
🔗
|
VADemon |
;) |
|
15:31
🔗
|
|
icedice has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) |
|
15:34
🔗
|
raiden_0x |
can i archiveteam pizzahut |
|
15:34
🔗
|
raiden_0x |
whois VADemon |
|
15:34
🔗
|
raiden_0x |
#whois VADemon |
|
15:34
🔗
|
raiden_0x |
@whois VADemon |
|
15:35
🔗
|
VADemon |
~whois VADemon |
|
15:47
🔗
|
joepie91 |
raiden_0x: which projects? |
|
15:59
🔗
|
raiden_0x |
PDFY |
|
15:59
🔗
|
raiden_0x |
PDFY2 |
|
16:00
🔗
|
raiden_0x |
Whichever |
|
16:00
🔗
|
raiden_0x |
Something that is ephemeral document storage to the public |
|
16:00
🔗
|
raiden_0x |
Go there upload file send short link sort of thing |
|
16:01
🔗
|
raiden_0x |
Scribd be damnged |
|
16:01
🔗
|
raiden_0x |
*damnge |
|
16:01
🔗
|
raiden_0x |
**damnged |
|
16:01
🔗
|
raiden_0x |
****Damned |
|
16:21
🔗
|
joepie91 |
raiden_0x: not sure I'd consider 'ephemeral' a feature there |
|
16:23
🔗
|
raiden_0x |
More of fan letters from ACDC get off my back ) |
|
16:24
🔗
|
raiden_0x |
* :) |
|
16:44
🔗
|
|
ravetcofx has joined #archiveteam-bs |
|
17:49
🔗
|
|
Honno_ has quit IRC (Ping timeout: 245 seconds) |
|
18:23
🔗
|
|
Aranje has joined #archiveteam-bs |
|
18:37
🔗
|
|
Ravenloft has quit IRC (Read error: Operation timed out) |
|
18:55
🔗
|
|
odemg has joined #archiveteam-bs |
|
18:59
🔗
|
t2t2 |
JensRex: ftp-gov needs up to 20GB of RAM with current default settings (2*item_size) |
|
19:18
🔗
|
|
kristian_ has joined #archiveteam-bs |
|
19:40
🔗
|
JensRex |
Madness. |
|
19:57
🔗
|
|
tapedrive has quit IRC (Ping timeout: 244 seconds) |
|
19:57
🔗
|
|
whydomain has quit IRC (Ping timeout: 244 seconds) |
|
19:59
🔗
|
VADemon |
Why again do we use wpull and not wget for ftp? |
|
20:01
🔗
|
mls |
JensRex: VADemon: Usually it's ExtractRecordsInfo that causes everything to stall and eventually die if my kernel deems it necessary. |
|
20:02
🔗
|
mls |
I've been wondering if it does something different compared to issuing --warc-cdx to the wpull process |
|
20:02
🔗
|
mls |
Though I'm low on space so I haven't been very eager to test it |
|
20:14
🔗
|
|
btfo has quit IRC (Read error: Operation timed out) |
|
20:32
🔗
|
|
btfo has joined #archiveteam-bs |
|
20:40
🔗
|
|
icedice has joined #archiveteam-bs |
|
20:42
🔗
|
|
mls has quit IRC (Ping timeout: 250 seconds) |
|
20:44
🔗
|
|
mls has joined #archiveteam-bs |
|
21:01
🔗
|
|
grafchoke has joined #archiveteam-bs |
|
21:01
🔗
|
|
grafchokr has quit IRC (Read error: Connection reset by peer) |
|
21:35
🔗
|
|
BlueMaxim has joined #archiveteam-bs |
|
21:55
🔗
|
|
schbirid has quit IRC (Remote host closed the connection) |
|
22:02
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
22:09
🔗
|
|
grafchoke has quit IRC (Read error: Operation timed out) |
|
22:14
🔗
|
|
odemg has quit IRC (Remote host closed the connection) |
|
22:15
🔗
|
|
odemg has joined #archiveteam-bs |
|
22:53
🔗
|
|
pizzaiolo has quit IRC (Read error: Connection reset by peer) |
|
22:55
🔗
|
|
pizzaiolo has joined #archiveteam-bs |
|
23:57
🔗
|
|
ravetcofx has quit IRC (Read error: Operation timed out) |
|
23:57
🔗
|
|
GE has quit IRC (Remote host closed the connection) |