[00:45] *** mistym has quit IRC (Remote host closed the connection) [01:05] *** ripvanwin has quit IRC (Read error: Operation timed out) [01:06] *** Jonimus has quit IRC (Ping timeout: 370 seconds) [01:12] *** ripvanwin has joined #archiveteam-bs [01:14] *** kyan has joined #archiveteam-bs [01:15] *** mistym has joined #archiveteam-bs [01:26] *** schbirid2 has quit IRC (Read error: Operation timed out) [01:33] *** JesseW has joined #archiveteam-bs [01:37] *** schbirid2 has joined #archiveteam-bs [01:43] *** mistym has quit IRC (Remote host closed the connection) [01:45] *** mistym has joined #archiveteam-bs [02:17] *** kyan has quit IRC (Ping timeout: 258 seconds) [02:26] *** primus104 has quit IRC (Leaving.) [02:35] *** Command-S has joined #archiveteam-bs [02:39] *** lytv has quit IRC (Ping timeout: 252 seconds) [02:40] *** mistym has quit IRC (Remote host closed the connection) [02:42] *** Control-S has quit IRC (Read error: Operation timed out) [02:42] *** lytv has joined #archiveteam-bs [02:46] *** mistym has joined #archiveteam-bs [02:51] *** vitzli has joined #archiveteam-bs [03:05] *** Start has quit IRC (Read error: Connection reset by peer) [03:05] *** Start_ has joined #archiveteam-bs [03:14] *** bzc6p_ has joined #archiveteam-bs [03:14] *** swebb sets mode: +o bzc6p_ [03:16] *** Start_ is now known as Start [03:18] *** bzc6p has quit IRC (Read error: Operation timed out) [03:31] Pomf is a nightmare all the way down [03:57] why? [03:57] *** mistym has quit IRC (Remote host closed the connection) [03:57] oh backlog [03:58] All of Pomf is a nightmare, the whole thing. [03:58] The users are shitbags, the content is shitbag, the process was shitbag, and the result is now people are going "now you have shitbag" [03:59] Meanwhile, Wired is killing http://haitirewired.wired.com/ [03:59] O' [03:59] I've set archivebot on it but we'll see how that goes. [04:05] sorta a pain seeing everyday someone pops into the pomf chan asking when its up on wayback [04:14] well, fuck em [04:17] needy bastards [04:23] *** mistym has joined #archiveteam-bs [04:31] *** aaaaaaaaa has quit IRC (Leaving) [04:32] duplicate storage is an issue; archivebot doesn't really do anything about it, but if we were smarter we would examine the index and send requests with etag/last-modified [04:32] at which point you can do a delta [04:32] yipdw: (What's TW?) [04:32] trigger warning [04:32] ohhhh [04:32] * ersi rolls eyes and backs away [04:32] I figured you'd do that [04:32] anyway [04:32] for me, the point of WARC is accessibility [04:32] an archive means pretty much nothing if you can't actually get to it [04:34] yes "sql" is popular and even postgresql is popular but postgresql's binary format from x.x.x in 2015 is not necessarily going to be something people 10 (or 20 or 30) years from now will be able to easily get at [04:35] you could have a sql database indexing which warc and position the stuff is at for example [04:35] ersi: Check. [04:35] Why should I invest my time and effort (and money for storage) into WARC for the point of "accessibility". If someone cared enough for this data then they would make sense of it. Who says your WARC format wont be lost to the ages either? [04:35] it's published in standards [04:35] it's plain text [04:35] I get the feeling that we're not going to convince you [04:35] heh [04:35] such is the internet [04:36] It's also the format that's actually well supported by the tools we care about for the job. [04:36] warc is just the stuff so the storage is gonna be the same as what you're doing now if you do it the same way [04:36] Which is itself a strong selling point. [04:36] I mean, if you don't want to do WARC, that's totally cool [04:36] I wasn't expecting a debate over a storage format [04:36] at all [04:36] we'll keep using it [04:36] I mean don't take this as me yelling at you by any means, archiving is great [04:36] the more archiving the happier we are [04:37] just if you come into a room full of specific subject-matter nerds and start talking about your thing you made they will have opinions [04:37] As expected [04:38] and it seems to me like you're reinventing the wheel a little bit [04:38] It's just so much overhead any other way [04:39] well let's unpack that, what overhead do you mean [04:39] actually this has been good, I need to figure out why that lazerprincess archive isn't actually working as it did [04:39] maybe I deleted something [04:39] (Let me begin by saying that I have only briefly glanced over WARC a few times in the last few months. Feel free to correct me and I may be completely wrong in my understanding) [04:41] First off HTTP Headers. Why? Second, the whole HTML page body is stored. Every time. This included the pages (which already include the post body) AND the posts (same content again). Both of these include the Tumblr theme's html code everytime. [04:41] When you archive 3k blogs this becomes a massive amount of duplicate data [04:41] is html really your biggest space issue with a tumblr full of gifs and images though? [04:42] The HTTP headers contain useful information about the content, the time of archiving, etc. [04:42] *** vitzli has quit IRC (Quit: Leaving) [04:42] And how would you *not* store the whole HTML without a lot of effort? [04:42] pikhq, Tumblr has an API [04:42] And keep in mind that both of these are stored *compressed*. [04:43] the WARC and HTTP headers typically come out to around ~1-2 kB of overhead, uncompressed [04:43] ~1-2 kB/record, that is [04:43] DFJustin, of course not, but we hash all media and check if we have a file that matches. [04:43] And, of course, that this is *generic* infrastructure that works on *any damned website*. [04:43] Which eliminates duplicates. [04:43] when you're grabbing GIFs and videos and images it just hasn't been an issue [04:43] yeah the duplicate checking and checking for new posts is something we could use for sure [04:43] The WARC infrastructure literally works without us thinking about it for any site period. [04:44] we've been kind of focused on rescue crawls of stuff that's about to disappear and not continuing archiving of long-running sites [04:44] pikhq, which is a great tool to have for websites which need to be archived without much effort [04:45] This tumblr archiver has been the result of 3 months of work haha [04:45] oh hey nertsy [04:45] Which is what we have focused on. We literally deal mostly in archiving sites that are about to die so we need to go in and take all the data from the fire. [04:45] i see you're talking about the thing i made [04:45] I would just say give some thought to maybe writing out a WARC at the same time as you're doing your SQL thing, and then upload that off to the internet archive periodically since you don't have the space [04:45] Ctrl-S, yeah we chose the wrong storage backend [04:45] well shit [04:45] * Nertsy blames twkr [04:46] so how do we unfuck ourselves? [04:46] we have data we can't replace [04:46] don't worry about it [04:46] this is just us arguing in favor of something we know and llove [04:46] i'll push the latest code too github so you can see how we do things atm [04:47] live site is here btw https://t.archive.horse/blogs [04:47] They know Ctrl-S [04:47] in a sense this whole discussion is not unlike trying to figure out which Doctor was better [04:48] https://github.com/woodenphone/tumblrsagi [04:48] So, if I understand correctly what you've done here is instead you've cloned Tumblr's infrastructure in some sense so you can run a live site with archived Tumblr content. [04:48] ah hm so you're pulling the post content through the api as well? [04:48] (along with a way to mirror it via the API) [04:48] pikhq, exactly [04:49] DFJustin, yes [04:49] we actually keep each posts API data [04:49] ah so you can't easily save to warc on the side [04:49] the display side we have should be able to be wiped and rebuilt without any remote requests [04:49] for new stuff i guess we could [04:49] setting up a mirror of tumblr's infrastructure is a neat thing [04:49] Yeah we never hit a user page [04:49] it's all over the API [04:49] Well, given that the API is *itself* done over HTTP you could just shove that into WARC. [04:49] does it reproduce the fancy ajax scrolling and such? [04:50] but who wants to see json ? :P [04:50] DFJustin, eww infiniscroll [04:50] yes hello libgen mirrors need indexing [04:50] I need to sleep, but main libgen is dead [04:50] And no it doesn't (yet). [04:50] It probably wouldn't play nice with the Wayback Machine though. [04:51] Tumblr uses some weird iframe junk for photosets though. I can't see the logic behind it [04:51] there is some amount of libgen in ia already [04:51] something I'd love to see, related to Tumblr, is a way to reblog posts from tumblr into other services (like Diaspora, Ello, GNU Social, etc.) [04:51] feel free to reuse our code [04:51] we just want to make tumblr suck less [04:52] literally blogs disappeared while we were working on this archiver [04:52] certainly understandable goal. :-) [04:52] Ctrl-S: I can't say much about the code, but at least as a concept that is some neat shit. [04:52] get_* is where it is run from [04:52] Ctrl-S did nearly all of the work on it though. All cred is due to him [04:53] i have no idea how to impliment WARC stuff [04:54] Ctrl-S: WARC is intentionally designed to be similar to HTTP. [04:54] there's Python WARC libraries [04:54] ATM i use a single function for pretty much all web requests though, so it will hopefully be doable [04:54] chfoo wrote a few, too [04:54] that and wpull has a WARC output mode [04:54] depending on the way the fetcher works, you may not even need to deal with writing WARC directly [04:55] https://github.com/woodenphone/tumblrsagi/blob/master/get_posts.py [04:55] have you had any trouble from tumblr about using the API this way? [04:55] we havent even got 1k blogs saved yet [04:55] they prolly dont even know we exist [04:56] heh [04:56] JesseW, from what i have read tumblr doesn't limit per day or anything like that [04:56] the only thing of concern AFAIK is requests per second [04:56] they definitely don't seem to care on their HTTP frontend [04:56] er, HTML [04:56] and we haven't had any issues yet [04:56] if you can make it easy to do things your way, we'll probably do it your way [04:57] you don't need to :P [04:57] see get() here https://github.com/woodenphone/tumblrsagi/blob/master/utils.py [04:57] almost all web requests use that [04:57] your way certainly *also* seems useful -- it's just a different idea from the archiving-about-to-die-sites [04:57] we archive about to die blogs [04:57] there's no problem in having two methods of archiving Tumblrs [04:58] my main issue with adding WARC stuff is i don't have a clue how [04:58] Tumblr certainly doesn't seem to care; we typically hit Tumblr at 6-8 concurrent requests [04:58] yep, and it's good for that -- as long as *tumblr* as a whole continues to exist. [04:58] Ctrl-S: We're happy to help in that regard. [04:59] right now i'm not at my best for coding, but i'll help however i can [04:59] /notice Ctrl-S Hey im going to bed. Sorry I didn't ask them. I got sidetracked trying to see what they thought about your project. I'm really sorry. :( [04:59] >.> [04:59] jesus christ this isn't about winning [04:59] Ctrl-S: No worries. You're doing neat shit and saving data. [05:00] and that is useful no matter *how* you do it [05:00] This was the nitpick brigade. :) [05:00] there are like two places we don't use those two get() functions there [05:00] but the API all goes through it [05:01] Nertsy: please add a link to your code (and the live site, if you want) to: http://archiveteam.org/index.php?title=Tumblr [05:01] that way people will be able to find it again later [05:02] there's also a 4chan archive we found that has posts we cant find elsewhrere [05:02] archivebot! [05:02] *** _desu_ has joined #archiveteam-bs [05:03] http://archive.pony-party.tk/ [05:03] any chance of help grabbing the posts? [05:03] can't find a way to contact the admin to ask them for a db dump [05:04] I don't remember how to get archivebot to start going. [05:04] We don't want to flood it [05:04] I don't remember how to get archivebot to start going. [05:04] it's going [05:04] Oh okay then. [05:05] basically this is the only one that has posts going back to the beginning of the board [05:05] great [05:05] JesseW thanks for the invitation but I can't remember my credentials maybe Ctrl-S could do it [05:06] kk [05:06] My next place I should put together a dedicated archivebot box. [05:06] it's not as easy as it should be [05:06] I'm willing to make a project of it. [05:07] Dammit I need to make use of my new, better Internet somehow. :P [05:07] So with warc, I'm assuming that when this gets finished I can download the whole site in one file? [05:07] Also I'm excited for my upcoming Google Fiber connection :D [05:07] one or more files; archivebot splits every 5 GB [05:08] warcs are designed so that you can easily concatenate them [05:08] Alas, I won't have Google Fiber because Google doesn't have Fiber near their freaking headquarters. [05:09] um i think i lost my password to it [05:10] Google might have many perks but "we get you the service we offer in KC" is not one of 'em. [05:11] heh, ok I'll add the links to the wiki. [05:13] okay, made an account and added the links [05:14] Uhh Ctrl-S did you remove our api key from the git? [05:14] Ctrl-S: ah, thanks [05:15] Ok Nvm it's not there [05:15] Thanks JesseW [05:15] Seriously WTF Google, gimme Fiber! [05:15] Living in nashville is finally paying off [05:16] the API key is in the config.py file which is ignored by git [05:16] I should probably put a new example one there [05:16] You'd figure they could offer it in Silicon Valley but noooo [05:16] Gotta go with Comcast. [05:16] So Ctrl-S we need to update the sample config for the new options [05:16] yeah [05:16] i'll just sanitize mine [05:16] What speeds do they offer there? [05:17] 2Gbps, so it's not like Fiber is *needed*, but still. :P [05:17] I get 105Mbps down and 25Mbps up. I complained enough times about it being slow so they over provisioned me [05:17] And good lord how much is that??? Mines $200 a month [05:17] I didn't check. [05:17] I should though because sign me the fuck up. [05:18] How long have you had them? [05:18] beats my 16/1 for $85/month [05:18] A monthly bill doesn't seem like some expense you can just write off [05:18] I haven't -- I'm about to move *to* the Bay Area. [05:19] Just be happy you aren't in Australia, i'm walking distance from the city and on ADSL2 [05:19] Here in St Louis I'm paying like $50/month for 50/4. [05:19] on the other hand I do get publicly routable IPv6 addresses that sometimes work so I guess that's a plus [05:20] Ah, looks like it's $300/month for the 2 gig service. ... *Might* be worth it. [05:21] Oh I was about to say you need business class [05:21] But it seems like nashville is the only market with a data cap on residential connections [05:22] I wouldn't dare pay that for 2 gig with a cap. [05:22] Yeah you only get 250Gb a mo [05:22] Then $10 for every 50Gb over [05:23] Reminds me of this bill I had one time https://www.dropbox.com/s/ev47xx4r6m5qplw/crap.PNG?dl=0 [05:24] See, if a data cap was on the line I would *have to* get a business line. [05:24] Nertsy: holy shit [05:24] Jesus. [05:24] *** SketchCow changes topic to: Archive Team: After Five Years, You'd Think We'd Know What We're Doing [05:24] :) [05:24] *** yipdw changes topic to: Archive Team: After Five Years, You'd Think We'd Know What We're Doing | Sometimes We Don't [05:26] I thought I'd have to take out a loan for a little bit haha [05:27] Played dumb claimed I took off wifi pw. Got most of it taken off [05:27] SketchCow: Curses! I can't sign up for shit involving being at the Internet Archive right now because I'm not there yet! [05:27] (re: twitter) [05:33] *** bzc6p_ has quit IRC (Ping timeout: 600 seconds) [05:35] *** mistym has quit IRC (Remote host closed the connection) [05:35] *** mistym has joined #archiveteam-bs [05:43] *** godane has quit IRC (Ping timeout: 252 seconds) [06:24] *** vitzli has joined #archiveteam-bs [06:31] *** mistym has quit IRC (Remote host closed the connection) [06:32] *** mistym has joined #archiveteam-bs [06:35] *** JesseW has quit IRC (Quit: Leaving.) [06:51] *** DopefishJ has joined #archiveteam-bs [06:51] *** swebb sets mode: +o DopefishJ [06:51] *** mistym has quit IRC (Remote host closed the connection) [06:51] *** mistym has joined #archiveteam-bs [06:52] *** mistym has quit IRC (Remote host closed the connection) [07:00] *** DFJustin has quit IRC (Ping timeout: 740 seconds) [07:30] Bröl. [07:33] *** DopefishJ is now known as DFJustin [07:45] bröööl [07:52] *** mistym has joined #archiveteam-bs [08:05] *** mistym has quit IRC (Ping timeout: 606 seconds) [08:18] *** oldcad has joined #archiveteam-bs [08:20] *** dashcloud has quit IRC (Read error: Operation timed out) [08:23] *** dashcloud has joined #archiveteam-bs [08:53] *** dan- has joined #archiveteam-bs [09:11] *** primus104 has joined #archiveteam-bs [09:22] *** bzc6p has joined #archiveteam-bs [09:22] *** swebb sets mode: +o bzc6p [09:25] *** godane has joined #archiveteam-bs [09:38] *** vitzli has quit IRC (Quit: Leaving) [10:08] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [10:26] *** brayden has joined #archiveteam-bs [10:26] *** swebb sets mode: +o brayden [10:27] SketchCow: your going to be getting the Atomic Magazine full run very soon [10:29] is that the australian computer mag? [10:29] and will the CDs be included? [10:32] i wonder if they even still do cover CDs [10:37] it is a australian computer magazine [10:37] i don't have any of the cds [10:38] i'll keep an eye out for any i might have lying around [10:38] i used to have a sucscription a few years ago [10:47] if the guys at atomic cant give you the cds, this guy might have them, he worked there http://www.furaffinity.net/user/bruyaglovae/ [10:47] wait wrong link [10:47] http://dansdata.com/ [10:47] damnit clipboard [10:57] *** Fusl has quit IRC (Read error: Operation timed out) [11:00] i'm starting to upload it [11:00] just know the first 12 issues had no ads so i'm not uploading those [11:00] but from issue 13 and up are complete with ads [11:01] uploaded: https://archive.org/details/Atomic-013-2002-02 [11:18] *** swebb has quit IRC (Read error: Operation timed out) [11:18] *** atlogbot has quit IRC (Read error: Operation timed out) [11:23] *** Fusl has joined #archiveteam-bs [11:26] *** swebb has joined #archiveteam-bs [11:40] *** atlogbot has joined #archiveteam-bs [12:07] *** primus104 has quit IRC (Leaving.) [12:09] *** schbirid2 has quit IRC (Read error: Operation timed out) [12:15] *** schbirid2 has joined #archiveteam-bs [12:22] *** dashcloud has quit IRC (Read error: Operation timed out) [12:29] heh linkedin aquired lynda.com [12:37] *** dashcloud has joined #archiveteam-bs [12:53] *** sankin has joined #archiveteam-bs [13:09] speaking about broadband, i'd like to take a moment to brag about the $70 (USD) 2G/1G fiber available to everywhere here :) [13:19] * Infreq cries [13:19] im among the group of aussies [13:28] You sick bastard [13:29] * Ctrl-S goes back to futilely waiting [13:29] it's at the point where we may as well just run our own fiber lines between trees [13:29] just hang them from gumtrees [13:31] trade bandwidth for power for repeaters [13:37] on just under 90Mbit/s here [13:37] gotta get dat telstra cable connection [13:38] not too likely but if your house has foxtel cable connections Infreq, ring them up and ask if they support cable net [13:45] have cable but it still really slow; maybe peeps on my street just congest the line; always pretty funny with telstra give you 1tb for the month knowing you wont ever be able to use it all up considering hte line speed [13:47] that's dodgy, it might be worth calling them up and asking for a lines test, 133933 [13:48] otherwise might be worth getting a telstra tech out there to take a look at it, if it's not their problem they charge you ~$180, we got a guy out a few weeks ago and he replaced some dodgy connectors and rusted stuff up in the powerlines [13:50] haha that brings up memories few years back had a mate who had a problem with lines, telstra called out a tech; tech siad there was nothing wrong; he called another telco about it they sent out a tech said the pit was full of water & corroded wires [13:52] ha, sounds about right [13:52] up at work, we've had some fun times with telstra [13:52] when we were first getting net and phones setup in our first business, waited about three weeks for a tech to come out and wire us up [13:53] >_< [13:53] had to end up crimping our own wires in the telco box [13:53] far out [13:53] oh, and we had to get them to fix some issues, net dropping out every day etc, was a problem on their end [13:54] tech went out to the exchange, got out lines disconnected and halfway through working on them etc, got called out to a hospital [13:54] (when hospital calls come in the techs drop everything and go right out) [13:54] oh my [13:54] and told nobody our wires weren't finished, took them another three weeks to get a tech out there and finally see why we hadn't had any connection at all [13:55] * Infreq facepalms [13:55] oh, and we moved into a new shop a year ago or so [13:55] "your business is important to us" yet we'll dick you over attitude is a speciality of telstra [13:55] we're a computer shop, so we rang early and confirmed a 20Mbps connection, minimum [13:56] all confirmed weeks in advance, confirmed week in advance, half a week in advance of us moving to the new store [13:56] telstra calls us two days before moving in [13:56] "sorry, we have no lines at all. we cannot get a connection at all in the new premises. sorry, good luck" [13:57] :/ [13:58] on them for 8 hours a day for about a week, finally got them to hook up half of a cable pair of a phone line to get us adsl [13:59] computer shop by the way, so that was awesome for running ~12 computers all the time doing all sorts of different stuff, updates drivers etc [13:59] that sound not too fun at all [14:00] managed to get a few technicians we know out to hook some stuff up for us, we're on about 3mbps right now [14:00] not great but it does the job at least [14:01] oh, and literally any time anyone at telstra touches our account, almost everything falls over [14:01] least so 1/6th of the speed thou [14:01] telstra rep called a while ago and asked if we wanted to upgrade our phone plan, boss refused [14:02] next week, no internet, no phone lines at all to the shop [14:02] XD [14:02] we call up telstra, "oh, in here it says a rep called you last week and approved total cancellation of your service" [14:02] wtf [14:03] yeah their "how can we improve your service" calls do more bad than good [14:03] do they record their support line then? [14:04] oh they do, we've been over stuff lots with them [14:04] had about five case managers, taken them to court once or twice [14:07] what can you do, but honestly for my home connection telstra have been wonderful [14:08] probably because we could change isps where my home is, at work they own all the lines and you can't move to another provider even if you wanted to :p [14:08] I couldn't say the same but hey my area atm only has telstra to work with so I'm bumbed [14:09] was with iinet previous for 5 years never had a problem [14:10] fair enough, problem with going anyone but telstra is usually telstra owns all the lines anyway [14:10] so if it is an issue with the lines, you ring iinet, iinet rings telstra, and telstra just take their time since it's not one of their customers [14:10] at least out here, might be different there [14:11] back in my old area iinet put in their own hardware into the exchange so they self serviced it all which was rad [14:12] ooh nice, that's pretty cool [14:15] iinet were getting bought by tpg or something, should be interesting to see how that goes [14:16] don't see too many directly-iinet customers here, mostly westnet customers that were migrated over when iinet bought them out [14:17] ha, that reminds me of when I went out to a lady's house to install a new modem since her one had died [14:17] her telstra password was literally '2', told me about how they kept ringing her to try and change it but just gave up after a few weeks [14:21] XD [14:22] yeah should be interesting tpg taking over iinet, not a good thing considering how many complaints about tpg I've had from friends [14:22] heard* [14:26] we should just nationalize the lines [14:26] selling telstra just made them worst [14:27] heh just saying dont think it will get better anytime soon [14:28] our govt hates internet stuff [14:28] ^ [14:28] it's just another thing to demonize to them [14:31] *** mistym has joined #archiveteam-bs [14:33] I like how, at least here, all the pollies are saying NBN is happening right now, we're getting switched on as we speak [14:34] the actual techs tell us they're replacing all the lines, getting the whole few-suburbs wired up [14:35] and then around christmas (earliest), they switch absolutely everyone over to the new lines and the new tech all at the same time [14:35] ohgodno [14:35] certainly going to be fun when that happens [14:35] found the article new crap they passed http://www.itnews.com.au/News/405557,australia-passes-law-to-block-overseas-piracy-sites.aspx [14:35] *** dashcloud has quit IRC (Read error: Operation timed out) [14:36] so rather than just turning it on and then adding people as they get it installed over a few moneths or years, they do it all at once? [14:37] they could just turn them on when the line goes to the house and have that wonderful gradual increase that makes debugging so much nicer [14:37] yep, everybody on at the same time [14:38] *** dashcloud has joined #archiveteam-bs [14:38] reminds me of an old optus engineer I was talking to [14:39] apparently their rule was to never ever reverse code, if it breaks just keep working on it and pushing it forwards until it's working [14:39] morons [14:40] so basically erryone is gonna get a VPN now [14:40] and that law is def gonna be abused like hell [14:41] no way to contest a block is there? [14:41] who knows... just hate the fact that the net's going to filtered to this degree [14:42] im already on a vpn and trying to convince family to use one [14:42] are we taking bets on how long it takes for the IA to be blocked? [14:42] got a vps with openvpn setup if that counts rarely need to use thou [14:43] XD [14:43] "Circumvention information" [14:43] "Infomation on illegal activities" [14:44] *** mistym has quit IRC (Remote host closed the connection) [14:45] *** primus104 has joined #archiveteam-bs [14:46] been trying to get aria2 and vpn hooked up on a raspberry pi at home for easy downloading [14:46] put a link to 192.168... on lil bro's desktop and take him to a web page to add urls and torrent files [14:47] but software is annoying, especially with multiple interfaces >_> [14:47] i bought a router but still havent gottten around to setting it up for the vpn, idea is everything goes through it and it wraps it in the vpn [14:50] *** dashcloud has quit IRC (Read error: Operation timed out) [14:52] got to say hate the added latency with vpn's [14:57] *** dashcloud has joined #archiveteam-bs [14:57] *** mistym has joined #archiveteam-bs [15:01] better than the spying and censorshit tho [15:02] yeah [15:04] *** dashcloud has quit IRC (Read error: Operation timed out) [15:10] *** dashcloud has joined #archiveteam-bs [15:10] *** primus104 has quit IRC (Leaving.) [15:13] *** bzc6p_ has joined #archiveteam-bs [15:17] *** bzc6p has quit IRC (Read error: Operation timed out) [15:32] *** bzc6p_ is now known as bzc6p [15:52] *** mistym has quit IRC (Remote host closed the connection) [16:08] *** mistym has joined #archiveteam-bs [16:43] *** dashcloud has quit IRC (Read error: Operation timed out) [16:50] *** dashcloud has joined #archiveteam-bs [16:50] *** garyrh has quit IRC (Read error: Operation timed out) [17:09] *** sankin has quit IRC (Ping timeout: 601 seconds) [17:26] *** aaaaaaaaa has joined #archiveteam-bs [18:43] *** kvieta has quit IRC (Read error: Operation timed out) [18:44] *** primus104 has joined #archiveteam-bs [18:55] *** mistym has quit IRC (Remote host closed the connection) [18:57] *** mistym has joined #archiveteam-bs [19:16] *** mistym has quit IRC (Remote host closed the connection) [19:17] *** mistym has joined #archiveteam-bs [19:43] *** mistym has quit IRC (Remote host closed the connection) [19:45] *** mistym has joined #archiveteam-bs [19:48] SketchCow: any updates on SourceForge? I has been a week since they showed up and the grab stopped. [19:50] *** tephra has quit IRC (Ping timeout: 258 seconds) [19:51] *** tephra has joined #archiveteam-bs [19:51] *** dashcloud has quit IRC (Read error: Operation timed out) [20:01] *** dashcloud has joined #archiveteam-bs [20:47] *** mistym has quit IRC (Remote host closed the connection) [21:00] *** garyrh has joined #archiveteam-bs [21:00] *** mistym has joined #archiveteam-bs [21:10] to all: [21:10] "If you ever end up working on anything that needs a large amount of storage, reasonable amounts of bandwidth, and a very very very low likelihood of it attracting negative attention (takedown notices, abuse complaints, raids, etc) I could probably set help." [21:10] (offer from somebody I know) [21:12] *** Stilett0 has joined #archiveteam-bs [21:13] joepie91: that sounds like someone who wants to do ia.bak ... [21:13] *** Stiletto has quit IRC (Read error: Operation timed out) [21:14] xmc: hmm, good point. should I point them at that? [21:22] i would suggest it [21:23] makes sense to me. [21:28] *** mistym has quit IRC (Remote host closed the connection) [21:37] joepie91: and how does he avoid takedown notices? [21:38] still, yes, large amount of storage makes me think ia.bak too [21:38] winr4r: what do you mean? [21:39] joepie91: why is he immune to takedown notices and raids and abuse complaints more than anyone else is? [21:39] i think you misread? [21:40] winr4r: yeah, you misread :P [21:40] okay [21:40] winr4r: the request was to only suggest stuff that's low on such things [21:40] ie. *not* causing problems [21:40] oh, right, yes, i did misread [21:40] hehe [21:40] winr4r: that being said, he's been rather helpful in the past for keeping some stuff running that would cause issues with most hosts... it really depends on how much of the infra you run yourself [21:41] (ie. how much pressure can be applied to you through upstreams) [21:41] get him on ia.bak then [21:42] *** JesseW has joined #archiveteam-bs [21:44] *** mistym has joined #archiveteam-bs [21:44] alright [21:44] sending email [21:44] \o/ [21:53] .title http://www.futurism.com/links/view/a-dutch-city-will-start-experimenting-with-unconditional-basic-income-this-summer/ [21:53] joepie91: A Dutch City Will Start Experimenting with Unconditional Basic Income This Summer - Futurism [21:53] winr4r: he might pop in here, also gave him this IRC channel [21:53] :p [22:10] https://cloud.google.com/tools/cloud-repositories/ [22:12] "Cloud Source Repositories are fully-featured private Git repositories hosted on Google Cloud Platform." If they had better timing, they could have used that as some sort of pivot for Google Code. [22:23] *** JesseW has quit IRC (Ping timeout: 252 seconds) [22:30] *** JesseW has joined #archiveteam-bs [22:32] lol [23:11] *** BlueMaxim has joined #archiveteam-bs [23:11] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [23:11] *** BlueMaxim has joined #archiveteam-bs [23:18] *** JesseW1 has joined #archiveteam-bs [23:18] *** JesseW has quit IRC (Ping timeout: 252 seconds)