[00:07] *** JesseW has joined #archiveteam-bs [00:09] chfoo yipdw ^ [00:46] *** primus105 has quit IRC (Leaving.) [00:53] *** arkiver2 has joined #archiveteam-bs [01:01] it should be working but i can't do anything about rsync [01:01] *** arkiver2 has quit IRC (Quit: Nettalk6 - www.ntalk.de) [01:17] *** schbirid2 has joined #archiveteam-bs [01:19] *** schbirid has quit IRC (Read error: Operation timed out) [02:44] *** JesseW has quit IRC (Read error: Operation timed out) [02:59] *** vitzli has joined #archiveteam-bs [03:39] *** aaaaaaaaa has quit IRC (Leaving) [04:07] *** BlueMaxim has joined #archiveteam-bs [04:21] *** JesseW has joined #archiveteam-bs [05:07] *** Stilett0 has joined #archiveteam-bs [05:09] *** Stiletto has quit IRC (Read error: Operation timed out) [05:11] *** vitzli has quit IRC (Quit: Leaving) [05:17] bentpins: I fixed the permissions on that rsync directory [05:17] it should be writable by the rsync user [05:17] yipdw: legend [05:17] *** dashcloud has quit IRC (Read error: Operation timed out) [05:18] nah just ssh access [05:20] *** dashcloud has joined #archiveteam-bs [06:06] *** primus104 has joined #archiveteam-bs [06:09] *** primus105 has joined #archiveteam-bs [06:13] *** primus104 has quit IRC (Read error: Operation timed out) [06:23] *** logan2 has joined #archiveteam-bs [06:26] *** logan has quit IRC (Read error: Operation timed out) [06:45] garyrh: so, what did a aDrive Basic URL look like? [06:46] It appears to be of this form: https://www.adrive.com/public/PJ4y7B/Adult_Sentencing_Manual_2008_ErrataSheetFTRSO2ndSubsequent.pdf [06:47] which linked to https://downloadwww31.adrive.com/public/view/PJ4y7B.html [06:48] a google search for "site:adrive.com inurl:public" gives 77 entries [06:54] garyrh: I've made a wiki page for aDrive: http://archiveteam.org/index.php?title=ADrive [07:31] *** JesseW has quit IRC (Read error: Operation timed out) [07:32] *** Infreq_ is now known as Infreq [08:01] Morning. Whats the Thingiverse channel? [08:06] I don't think there is one [08:08] *** PurpleSym has joined #archiveteam-bs [08:15] *** schbirid2 has quit IRC (Ping timeout: 306 seconds) [09:39] *** schbirid has joined #archiveteam-bs [09:43] *** primus105 has quit IRC (Leaving.) [09:53] *** signius has quit IRC (Read error: Operation timed out) [10:05] *** signius has joined #archiveteam-bs [10:06] *** mksplg has quit IRC (Remote host closed the connection) [10:29] *** SimpBrain has quit IRC (Quit: Leaving) [10:33] *** BlueMaxim has quit IRC (Quit: Leaving) [10:52] *** sylt has joined #archiveteam-bs [10:53] *** schbirid has quit IRC (Read error: Operation timed out) [10:54] *** schbirid has joined #archiveteam-bs [11:14] *** zenguy_pc has quit IRC (Read error: Operation timed out) [11:18] *** zenguy_pc has joined #archiveteam-bs [11:30] *** primus104 has joined #archiveteam-bs [11:52] as you can see on this url, researchgate is all about high quality http://www.researchgate.net/publication/51391010_%21CDATA_Evaluation_of_cultures_of_Saccharomyces_cerevisae_as_baits_for_Triatoma_dimidiata_and_Triatoma_pallidipennis_ [12:16] *** primus104 has quit IRC (Leaving.) [12:21] *** GLaDOS has quit IRC (Ping timeout: 252 seconds) [12:24] schbirid: I can't pretend to understand the subject matter, but what's wrong with that? [12:25] *** mksplg has joined #archiveteam-bs [12:34] * joepie91 reports more UX bugs on rocketchat... [12:36] *** GLaDOS has joined #archiveteam-bs [12:36] *** midas sets mode: +o GLaDOS [13:03] *** godane has quit IRC (Leaving.) [13:23] sylt: i meant the URL [13:23] CDATA :D [13:24] I didn't catch that, I've taken to just assuming there's nothing in a URL worth reading by a human [13:24] most services have insane schemes that make no sense to anyoen [13:28] :\ [13:29] *** mksplg has quit IRC (Quit: WeeChat 1.0.1) [13:32] sven@linux-etoq:~> curl -k -H "Accept: application/json" https://brackets-registry.aboutweb.com/ | jq '.registry[] | select(.metadata.name == "jade-preprocessors")' [13:32] jq <3 [13:34] would be nicer if people just stopped writing terrible javascript frontends. [13:35] sylt: ? [13:35] that's an API [13:35] jade is some javascript renderer isn't it? [13:35] no [13:35] it's a preprocessor language for HTML [13:36] (you typically do the compiling either as a build step or in your server application) [13:36] it's nodejs, close enough. [13:36] what? [13:36] Node.js has exactly 0 to do with frontend anything [13:36] "jade, node template engine" [13:36] yes... [13:37] eh, I thought it was like angular or whatever the current fad is. [13:37] sylt: no, it isn't. it's a runtime like CPython, but for JS [13:37] it's unrelated to frontend code [13:37] * sylt shrugs [13:37] (also, fuck Angular) [13:37] like I said, I was mistaken. [13:39] well all of these things are an unfortunate combination of difficult to scrape, slow, and packed with a million dependancies. [13:39] Angular is. Node (or anything else backend) isn't [13:40] things like React, Riot and supposedly Ember have server-side rendering, so if used correctly, that shouldn't get in the way of scraping, nor should it require JS to work [13:41] (if anything, Node is _improving_ scrapeability, now that frontend JS frameworks are getting more and more popular - having the same language on the backend means you can, in most cases, just render everything on the server that you wrote for the client) [13:41] (with little added effort) [14:45] *** primus104 has joined #archiveteam-bs [15:00] *** SN4T14 has quit IRC (Read error: Connection reset by peer) [15:06] *** SN4T14 has joined #archiveteam-bs [15:23] *** mksplg has joined #archiveteam-bs [15:42] *** SimpBrain has joined #archiveteam-bs [16:02] *** zenguy_pc has quit IRC (Read error: Operation timed out) [16:02] *** dashcloud has quit IRC (Read error: Operation timed out) [16:08] *** zenguy_pc has joined #archiveteam-bs [16:17] *** dashcloud has joined #archiveteam-bs [16:35] *** SimpBrain has quit IRC (Quit: Leaving) [16:41] good idea joepie91 [16:41] HCross: okay, so sda is a WD Black [16:41] and sdb is an IntelliPower drive (a la green, red) [16:41] so the numbers are not strange [16:41] but $friend says you should disable head parking [16:41] on sdb [16:41] ping SN4T14 [16:41] pong [16:41] WD2002FYPS is a RE4 [16:41] kgo [16:41] HCross is the guy with those drives? [16:41] yes [16:41] zhongfu: with IntelliPower, apparently. [16:42] I thought that was only Green/Red but okay [16:42] HCross, http://www.jzab.de/content/wdidle-bootcd follow that guide to disable head parking unless you want your drive to die. :p [16:42] zhongfu: going by http://www.rm.com/support/productinformation.asp?cref=prd2403012 [16:42] oh [16:42] SN4T14: mind that it's in softraid [16:42] SN4T14, on sdb? [16:42] joepie91, sure [16:42] HCross, yeah [16:42] oh wait [16:42] this requires boooting from an ISO [16:42] I need KVM to do that [16:43] HCross: you'll have to request IP KVM [16:43] yeah [16:43] Linux always has some disk activity a few times a minute, head parking usually happens after 5-10 seconds depending on the drive, mix those two, and you get a few load cycle counts per minute [16:43] HCross: they're on loan for 24 hours [16:43] free, as far as I can tell [16:43] so should be okay [16:43] Will ticket in now [16:45] * joepie91 is pleasantly surprised at support so far [16:45] just ticketed [16:45] *** JesseW has joined #archiveteam-bs [16:46] *** sylt has quit IRC (Ping timeout: 240 seconds) [16:47] *** robink has quit IRC (Read error: Operation timed out) [16:58] *** Ravenloft has joined #archiveteam-bs [17:04] *** midas has quit IRC (Ping timeout: 362 seconds) [17:09] *** dashcloud has quit IRC (Read error: Operation timed out) [17:16] *** dashcloud has joined #archiveteam-bs [17:37] joepie91, https://billing.dacentec.com not loading for me again [17:38] HCross: prob getting ddosed again [17:38] works for me though [17:38] Yup. =/ Its the LET community idiots [17:39] HCross: wtf is up with that anyway? [17:39] They call it the "LET Welcome" [17:39] HCross: right, but who is doing it and why? [17:40] Dont know who. Its always done when a host puts out an awesome deal as a way of stopping others getting it [17:40] after 2 mins it loaded [17:40] *** aaaaaaaaa has joined #archiveteam-bs [17:40] *** swebb sets mode: +o aaaaaaaaa [17:41] weird. [17:42] atm I am also dealing with the fact that the ColoCrossing network has taken a dump [17:44] colocrossing.. :) [17:45] ColoCrossing <-> OVH is typically 700Mbps. Now - 7Mbps [17:45] HCross: what else have you tested against? [17:46] HostMyBytes and the Dacentec. Take a look in the "ColoCrossing adds Telia" thread and ive put a load of results there [17:46] HCross: hold on, let me get you a test URL on core backbone [17:47] The CC backbone? [17:47] HCross: core backbone is the name of the datacenter :) [17:47] they have a very good network [17:48] Ok. Its taken it 10 mins to move 1GB [17:48] just a min [17:48] grabbing a 1GB test file now [17:48] :P [17:49] hmm [17:49] it's fluctuate-y today [17:49] only 18MB/sec [17:50] HCross: haless.cryto.net/1000Mo.dat [17:50] joepie91, http://harrycross.me/6d1.png [17:50] er [17:50] http://haless.cryto.net/1000Mo.dat [17:50] try downloading the above [17:51] Just waiting for this wget to finish then I will do that one [17:53] joepie91, how do you do code on LET again? [17:53] HCross: 

[17:54]  doing that wget, after an inital burst up to 20M/s we are back down to 700K/s
[17:55]  HCross: yeah, your speed is falling
[17:55]  HCross: sitting at like 6mbps now
[17:55]  HCross: it's in Germany, btw
[17:55]  but you should still get better speeds than that
[17:55]  Ah, OVH with their worldwide network was pants
[17:55]  HCross: that's why I wanted to check this one
[17:55]  to see if it was limited to OVH
[17:55]  :P
[17:56]  OVH take it as far as New York, then hand it over
[17:56]  HCross: any particular other location/region you want to test against?
[17:56]  just had login stuff for KVM from Dacentec. Will kill my warriors and do that. You got anything in the USA?
[17:56]  HCross: sure, name a state
[17:56]  one with cheap datacenters
[17:56]  lol
[17:57]  I have a bunch of shit all over the place
[17:57]  New York area?
[17:57] * joepie91 thinks
[17:57]  I think that's one area where I don't have anything, anymore... 
[17:58]  Just waiting for the last blingee script to peacefully stop
[17:58] * joepie91 grabs google maps
[17:59]  HCross: I have BHS, Miami (via LES, so idk), Lenoir ofc
[17:59]  Can I try BHS then please
[17:59]  HCross: Atlanta also
[17:59]  mind, BHS is OVH
[17:59]  Go on, atlanta then please
[17:59]  okay, moment
[18:00]  ok. Hopefully this one will have finished by then
[18:01]  HCross: RAM Host: http://cryto.net/~joepie91/100MB-newark.bin, RamNode: http://wire.cryto.net/100MB-newark.bin
[18:01]  both Colo@, RAM Host runs their own network
[18:01]  no idea about RamNode
[18:02] *** Ravenloft has quit IRC (Read error: Connection reset by peer)
[18:02]  (I _think_ RamNode is in Colo@, not sure now actually, but should def be Atlanta)
[18:02] *** zenguy_pc has quit IRC (Read error: Connection reset by peer)
[18:02]  can also do Colo@s own network if needed, via TSS
[18:02]  oh wait, I don't think I have that box anymore
[18:02]  anyhow, both should be Atlanta
[18:02]  Trying http://wire.cryto.net/100MB-newark.bin and its painful. 51K/s
[18:02]  jesus
[18:03]  Just testing it with my home line too to see
[18:03]  HCross: did you upgrade your server to dialup? :P
[18:03]  Home line, 40Mbps
[18:03]  yeah
[18:03]  that sounds about right
[18:04]  for a UK line on my ISP
[18:04]  should get a bit more even, if you're geographically close
[18:04]  oh, then it's fine
[18:04]  yeah
[18:04]  Thats on the Liberty Global network too
[18:04]  HCross: heh, I get 82.2MB/sec between those two servers
[18:04]  and it was still going up
[18:05]  64 bytes from 98.142.213.226: icmp_req=2 ttl=58 time=0.570 ms
[18:05]  that would probably be why
[18:05] *** JesseW has quit IRC (Read error: Operation timed out)
[18:06]  Test to British Telecom, pathetic
[18:08]  Online.net is the only remotely fast one and still, that shot up to 16M/s and then straight down to around 1M/s
[18:11]  one more grab to upload, then I can do the disk tweak
[18:19] *** zenguy_pc has joined #archiveteam-bs
[18:27]  ugh, I cant hit delete on my KVM fast enough
[18:27] *** SimpBrain has joined #archiveteam-bs
[18:33] *** Ravenloft has joined #archiveteam-bs
[18:33]  urgh, so annoying
[18:33]  I get 3min of packet loss every now and then
[18:44] *** JesseW has joined #archiveteam-bs
[19:04] *** aaaaaaaa_ has joined #archiveteam-bs
[19:04] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
[19:04] *** swebb sets mode: +o aaaaaaaa_
[19:11] *** aaaaaaaa_ is now known as aaaaaaaaa
[19:30] *** ersi has quit IRC (Read error: Operation timed out)
[19:45] *** robink has joined #archiveteam-bs
[19:49] *** ersi has joined #archiveteam-bs
[19:49] *** swebb sets mode: +o ersi
[19:51] *** JesseW has quit IRC (Read error: Operation timed out)
[19:54] *** dashcloud has quit IRC (Read error: Operation timed out)
[20:01] *** dashcloud has joined #archiveteam-bs
[20:05] *** JesseW has joined #archiveteam-bs
[20:10] *** aaaaaaaa_ has joined #archiveteam-bs
[20:10] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
[20:10] *** swebb sets mode: +o aaaaaaaa_
[20:18] *** aaaaaaaa_ is now known as aaaaaaaaa
[20:20] *** JesseW has quit IRC (Read error: Operation timed out)
[20:21] *** godane has joined #archiveteam-bs
[20:23] *** RichardG has quit IRC (Read error: Operation timed out)
[20:25] *** schbirid has quit IRC (Quit: Leaving)
[20:26] *** JesseW has joined #archiveteam-bs
[20:30] *** RichardG has joined #archiveteam-bs
[20:32] *** JesseW has quit IRC (Read error: Operation timed out)
[20:38] *** aaaaaaaa_ has joined #archiveteam-bs
[20:38] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
[20:38] *** swebb sets mode: +o aaaaaaaa_
[20:43] *** dashcloud has quit IRC (Read error: Operation timed out)
[20:50] *** dashcloud has joined #archiveteam-bs
[20:52] *** phuzion has quit IRC (Read error: Operation timed out)
[21:04] *** aaaaaaaa_ is now known as aaaaaaaaa
[21:08] *** aaaaaaaaa has quit IRC (Read error: Connection reset by peer)
[21:14] *** SimpBrain has quit IRC (Read error: Connection reset by peer)
[21:17] *** dx has quit IRC (Quit: RIP)
[21:17] *** dx has joined #archiveteam-bs
[21:47] *** fie has joined #archiveteam-bs
[21:50] *** PurpleSym has quit IRC (Remote host closed the connection)
[21:56] *** robink has quit IRC (Ping timeout: 492 seconds)
[21:57] *** robink has joined #archiveteam-bs
[21:59] *** JesseW has joined #archiveteam-bs
[22:03] *** zhongfu_ has joined #archiveteam-bs
[22:05] *** zhongfu has quit IRC (Ping timeout: 483 seconds)
[22:11] *** garyrh has quit IRC (hub.dk irc.homelien.no)
[22:11] *** limebyte has quit IRC (hub.dk irc.homelien.no)
[22:11] *** i0npulse has quit IRC (hub.dk irc.homelien.no)
[22:11] *** yipdw has quit IRC (hub.dk irc.homelien.no)
[22:11] *** altlabel has quit IRC (hub.dk irc.homelien.no)
[22:11] *** Pythia has quit IRC (hub.dk irc.homelien.no)
[22:16] *** yipdw_ has joined #archiveteam-bs
[22:18] *** HCross has quit IRC (Ping timeout: 252 seconds)
[22:20] *** diacope has quit IRC (Ping timeout: 252 seconds)
[22:20] *** Rickster has quit IRC (Ping timeout: 252 seconds)
[22:20] *** dx has quit IRC (Ping timeout: 252 seconds)
[22:21] *** Famicoman has quit IRC (Ping timeout: 252 seconds)
[22:25] *** diacope has joined #archiveteam-bs
[22:25] *** HCross has joined #archiveteam-bs
[22:31] *** diacope has quit IRC (Remote host closed the connection)
[22:33] *** Rickster has joined #archiveteam-bs
[22:35] *** diacope has joined #archiveteam-bs
[22:38] *** Famicoman has joined #archiveteam-bs
[22:48]  teehee
[22:50]  I am being unusually polite today.
[22:50]  :)
[22:50]  might as well be, I think it's a reasonable request to honor user wishes for now
[22:50]  unreasonable is something like twitpic
[22:50]  I personally don't care much for it, tbh
[22:51]  if you don't want something saved, don't publicly post it
[22:51]  because it _is_ going to be saved
[22:51]  and then I'd rather it be for 'the public good'
[22:51]  from a technical perspective I agree
[22:52]  then there's the wishes-against-infrastructure that I recently think ought to be honored for Common People anyway
[22:52]  yeah
[22:53]  this is hardly a single person asking for their posts to not be archived, though
[22:53]  sure, but it's a decently small community anyhow
[22:53]  it's not, it's an admin on behalf of their users
[22:53]  fine though
[22:54]  I mean that's a netadmin/site admin's responsibility anyway
[22:54]  it's an admin. whether it's on behalf of their users remains up for discussion
[22:54]  ok yes we can pick the lines but meh
[22:54]  whether it's 'small' or not is not a terribly relevant datapoint to me personally
[22:55]  if the admin's wishes are not in alignment with their userbase, archive team is well-known enough for said userbase to come here and correct the problem
[22:55]  i'm not that worried about misalignment
[22:55]  nothing is relevant to you personally as a datapoint
[22:55]  lol
[22:56]  in fact, who knows, maybe the administrator of that job is a user
[22:56]  I don't know who started it
[22:57]  yipdw_: userbase may not necessarily know about what the admin requests.
[22:57]  often doesn't, in fact
[22:57]  especially for smaller things
[22:57]  yes
[22:57]  ersi: sure it is. I can understand personal requests
[22:58]  and at this point we have a channel open from admin and if it turns out to be a user they can have a good productive chat
[22:58]  issue marked as SELFRESOLVING
[22:59]  shit I wish I had that as a JIRA resolution, I should go add that
[23:00]  lol
[23:00]  it's way better than "Won't Fix"
[23:00] *** Muad-Dib has quit IRC (Quit: ZNC - http://znc.in)
[23:00]  even if it is equivalent
[23:01]  I tend to think if people don't like it, wait a good number of years before putting the grab out there and it should hopefully be all better
[23:01]  or at least makes the date you need to deal with it 'not right now' :P
[23:20] *** godane has quit IRC (Read error: Operation timed out)
[23:21] *** aaaaaaaaa has joined #archiveteam-bs
[23:21] *** swebb sets mode: +o aaaaaaaaa
[23:30] *** dashcloud has quit IRC (Read error: Operation timed out)
[23:37] *** dashcloud has joined #archiveteam-bs
[23:38] *** garyrh has joined #archiveteam-bs
[23:38] *** limebyte has joined #archiveteam-bs
[23:38] *** i0npulse has joined #archiveteam-bs
[23:38] *** altlabel has joined #archiveteam-bs
[23:38] *** Pythia has joined #archiveteam-bs
[23:41] *** ersi has quit IRC (Ping timeout: 240 seconds)
[23:43] *** ersi has joined #archiveteam-bs
[23:43] *** swebb sets mode: +o ersi
[23:57] *** BlueMaxim has joined #archiveteam-bs