#archiveteam-bs 2015-06-25,Thu

↑back Search

Time Nickname Message
00:45 🔗 mistym has quit IRC (Remote host closed the connection)
01:05 🔗 ripvanwin has quit IRC (Read error: Operation timed out)
01:06 🔗 Jonimus has quit IRC (Ping timeout: 370 seconds)
01:12 🔗 ripvanwin has joined #archiveteam-bs
01:14 🔗 kyan has joined #archiveteam-bs
01:15 🔗 mistym has joined #archiveteam-bs
01:26 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
01:33 🔗 JesseW has joined #archiveteam-bs
01:37 🔗 schbirid2 has joined #archiveteam-bs
01:43 🔗 mistym has quit IRC (Remote host closed the connection)
01:45 🔗 mistym has joined #archiveteam-bs
02:17 🔗 kyan has quit IRC (Ping timeout: 258 seconds)
02:26 🔗 primus104 has quit IRC (Leaving.)
02:35 🔗 Command-S has joined #archiveteam-bs
02:39 🔗 lytv has quit IRC (Ping timeout: 252 seconds)
02:40 🔗 mistym has quit IRC (Remote host closed the connection)
02:42 🔗 Control-S has quit IRC (Read error: Operation timed out)
02:42 🔗 lytv has joined #archiveteam-bs
02:46 🔗 mistym has joined #archiveteam-bs
02:51 🔗 vitzli has joined #archiveteam-bs
03:05 🔗 Start has quit IRC (Read error: Connection reset by peer)
03:05 🔗 Start_ has joined #archiveteam-bs
03:14 🔗 bzc6p_ has joined #archiveteam-bs
03:14 🔗 swebb sets mode: +o bzc6p_
03:16 🔗 Start_ is now known as Start
03:18 🔗 bzc6p has quit IRC (Read error: Operation timed out)
03:31 🔗 SketchCow Pomf is a nightmare all the way down
03:57 🔗 Pythia why?
03:57 🔗 mistym has quit IRC (Remote host closed the connection)
03:57 🔗 Pythia oh backlog
03:58 🔗 SketchCow All of Pomf is a nightmare, the whole thing.
03:58 🔗 SketchCow The users are shitbags, the content is shitbag, the process was shitbag, and the result is now people are going "now you have shitbag"
03:59 🔗 SketchCow Meanwhile, Wired is killing http://haitirewired.wired.com/
03:59 🔗 SketchCow O'
03:59 🔗 SketchCow I've set archivebot on it but we'll see how that goes.
04:05 🔗 Infreq sorta a pain seeing everyday someone pops into the pomf chan asking when its up on wayback
04:14 🔗 ersi well, fuck em
04:17 🔗 ersi needy bastards
04:23 🔗 mistym has joined #archiveteam-bs
04:31 🔗 aaaaaaaaa has quit IRC (Leaving)
04:32 🔗 yipdw duplicate storage is an issue; archivebot doesn't really do anything about it, but if we were smarter we would examine the index and send requests with etag/last-modified
04:32 🔗 yipdw at which point you can do a delta
04:32 🔗 ersi yipdw: (What's TW?)
04:32 🔗 yipdw trigger warning
04:32 🔗 ersi ohhhh
04:32 🔗 * ersi rolls eyes and backs away
04:32 🔗 yipdw I figured you'd do that
04:32 🔗 yipdw anyway
04:32 🔗 yipdw for me, the point of WARC is accessibility
04:32 🔗 yipdw an archive means pretty much nothing if you can't actually get to it
04:34 🔗 DFJustin yes "sql" is popular and even postgresql is popular but postgresql's binary format from x.x.x in 2015 is not necessarily going to be something people 10 (or 20 or 30) years from now will be able to easily get at
04:35 🔗 DFJustin you could have a sql database indexing which warc and position the stuff is at for example
04:35 🔗 pikhq ersi: Check.
04:35 🔗 Nertsy Why should I invest my time and effort (and money for storage) into WARC for the point of "accessibility". If someone cared enough for this data then they would make sense of it. Who says your WARC format wont be lost to the ages either?
04:35 🔗 DFJustin it's published in standards
04:35 🔗 yipdw it's plain text
04:35 🔗 yipdw I get the feeling that we're not going to convince you
04:35 🔗 yipdw heh
04:35 🔗 yipdw such is the internet
04:36 🔗 pikhq It's also the format that's actually well supported by the tools we care about for the job.
04:36 🔗 DFJustin warc is just the stuff so the storage is gonna be the same as what you're doing now if you do it the same way
04:36 🔗 pikhq Which is itself a strong selling point.
04:36 🔗 yipdw I mean, if you don't want to do WARC, that's totally cool
04:36 🔗 Nertsy I wasn't expecting a debate over a storage format
04:36 🔗 Nertsy at all
04:36 🔗 yipdw we'll keep using it
04:36 🔗 DFJustin I mean don't take this as me yelling at you by any means, archiving is great
04:36 🔗 DFJustin the more archiving the happier we are
04:37 🔗 DFJustin just if you come into a room full of specific subject-matter nerds and start talking about your thing you made they will have opinions
04:37 🔗 Nertsy As expected
04:38 🔗 DFJustin and it seems to me like you're reinventing the wheel a little bit
04:38 🔗 Nertsy It's just so much overhead any other way
04:39 🔗 DFJustin well let's unpack that, what overhead do you mean
04:39 🔗 yipdw actually this has been good, I need to figure out why that lazerprincess archive isn't actually working as it did
04:39 🔗 yipdw maybe I deleted something
04:39 🔗 Nertsy (Let me begin by saying that I have only briefly glanced over WARC a few times in the last few months. Feel free to correct me and I may be completely wrong in my understanding)
04:41 🔗 Nertsy First off HTTP Headers. Why? Second, the whole HTML page body is stored. Every time. This included the pages (which already include the post body) AND the posts (same content again). Both of these include the Tumblr theme's html code everytime.
04:41 🔗 Nertsy When you archive 3k blogs this becomes a massive amount of duplicate data
04:41 🔗 DFJustin is html really your biggest space issue with a tumblr full of gifs and images though?
04:42 🔗 pikhq The HTTP headers contain useful information about the content, the time of archiving, etc.
04:42 🔗 vitzli has quit IRC (Quit: Leaving)
04:42 🔗 pikhq And how would you *not* store the whole HTML without a lot of effort?
04:42 🔗 Nertsy pikhq, Tumblr has an API
04:42 🔗 pikhq And keep in mind that both of these are stored *compressed*.
04:43 🔗 yipdw the WARC and HTTP headers typically come out to around ~1-2 kB of overhead, uncompressed
04:43 🔗 yipdw ~1-2 kB/record, that is
04:43 🔗 Nertsy DFJustin, of course not, but we hash all media and check if we have a file that matches.
04:43 🔗 pikhq And, of course, that this is *generic* infrastructure that works on *any damned website*.
04:43 🔗 Nertsy Which eliminates duplicates.
04:43 🔗 yipdw when you're grabbing GIFs and videos and images it just hasn't been an issue
04:43 🔗 DFJustin yeah the duplicate checking and checking for new posts is something we could use for sure
04:43 🔗 pikhq The WARC infrastructure literally works without us thinking about it for any site period.
04:44 🔗 DFJustin we've been kind of focused on rescue crawls of stuff that's about to disappear and not continuing archiving of long-running sites
04:44 🔗 Nertsy pikhq, which is a great tool to have for websites which need to be archived without much effort
04:45 🔗 Nertsy This tumblr archiver has been the result of 3 months of work haha
04:45 🔗 Ctrl-S oh hey nertsy
04:45 🔗 pikhq Which is what we have focused on. We literally deal mostly in archiving sites that are about to die so we need to go in and take all the data from the fire.
04:45 🔗 Ctrl-S i see you're talking about the thing i made
04:45 🔗 DFJustin I would just say give some thought to maybe writing out a WARC at the same time as you're doing your SQL thing, and then upload that off to the internet archive periodically since you don't have the space
04:45 🔗 Nertsy Ctrl-S, yeah we chose the wrong storage backend
04:45 🔗 Ctrl-S well shit
04:45 🔗 * Nertsy blames twkr
04:46 🔗 Ctrl-S so how do we unfuck ourselves?
04:46 🔗 Ctrl-S we have data we can't replace
04:46 🔗 yipdw don't worry about it
04:46 🔗 yipdw this is just us arguing in favor of something we know and llove
04:46 🔗 Ctrl-S i'll push the latest code too github so you can see how we do things atm
04:47 🔗 Ctrl-S live site is here btw https://t.archive.horse/blogs
04:47 🔗 Nertsy They know Ctrl-S
04:47 🔗 yipdw in a sense this whole discussion is not unlike trying to figure out which Doctor was better
04:48 🔗 Ctrl-S https://github.com/woodenphone/tumblrsagi
04:48 🔗 pikhq So, if I understand correctly what you've done here is instead you've cloned Tumblr's infrastructure in some sense so you can run a live site with archived Tumblr content.
04:48 🔗 DFJustin ah hm so you're pulling the post content through the api as well?
04:48 🔗 pikhq (along with a way to mirror it via the API)
04:48 🔗 Nertsy pikhq, exactly
04:49 🔗 Nertsy DFJustin, yes
04:49 🔗 Ctrl-S we actually keep each posts API data
04:49 🔗 DFJustin ah so you can't easily save to warc on the side
04:49 🔗 Ctrl-S the display side we have should be able to be wiped and rebuilt without any remote requests
04:49 🔗 Ctrl-S for new stuff i guess we could
04:49 🔗 JesseW setting up a mirror of tumblr's infrastructure is a neat thing
04:49 🔗 Nertsy Yeah we never hit a user page
04:49 🔗 Nertsy it's all over the API
04:49 🔗 pikhq Well, given that the API is *itself* done over HTTP you could just shove that into WARC.
04:49 🔗 DFJustin does it reproduce the fancy ajax scrolling and such?
04:50 🔗 Nertsy but who wants to see json ? :P
04:50 🔗 Nertsy DFJustin, eww infiniscroll
04:50 🔗 joepie91 yes hello libgen mirrors need indexing
04:50 🔗 joepie91 I need to sleep, but main libgen is dead
04:50 🔗 Nertsy And no it doesn't (yet).
04:50 🔗 pikhq It probably wouldn't play nice with the Wayback Machine though.
04:51 🔗 Nertsy Tumblr uses some weird iframe junk for photosets though. I can't see the logic behind it
04:51 🔗 DFJustin there is some amount of libgen in ia already
04:51 🔗 JesseW something I'd love to see, related to Tumblr, is a way to reblog posts from tumblr into other services (like Diaspora, Ello, GNU Social, etc.)
04:51 🔗 Ctrl-S feel free to reuse our code
04:51 🔗 Ctrl-S we just want to make tumblr suck less
04:52 🔗 Nertsy literally blogs disappeared while we were working on this archiver
04:52 🔗 JesseW certainly understandable goal. :-)
04:52 🔗 pikhq Ctrl-S: I can't say much about the code, but at least as a concept that is some neat shit.
04:52 🔗 Ctrl-S get_* is where it is run from
04:52 🔗 Nertsy Ctrl-S did nearly all of the work on it though. All cred is due to him
04:53 🔗 Ctrl-S i have no idea how to impliment WARC stuff
04:54 🔗 pikhq Ctrl-S: WARC is intentionally designed to be similar to HTTP.
04:54 🔗 yipdw there's Python WARC libraries
04:54 🔗 Ctrl-S ATM i use a single function for pretty much all web requests though, so it will hopefully be doable
04:54 🔗 yipdw chfoo wrote a few, too
04:54 🔗 yipdw that and wpull has a WARC output mode
04:54 🔗 yipdw depending on the way the fetcher works, you may not even need to deal with writing WARC directly
04:55 🔗 Ctrl-S https://github.com/woodenphone/tumblrsagi/blob/master/get_posts.py
04:55 🔗 JesseW have you had any trouble from tumblr about using the API this way?
04:55 🔗 Ctrl-S we havent even got 1k blogs saved yet
04:55 🔗 Ctrl-S they prolly dont even know we exist
04:56 🔗 JesseW heh
04:56 🔗 Nertsy JesseW, from what i have read tumblr doesn't limit per day or anything like that
04:56 🔗 Nertsy the only thing of concern AFAIK is requests per second
04:56 🔗 yipdw they definitely don't seem to care on their HTTP frontend
04:56 🔗 yipdw er, HTML
04:56 🔗 Nertsy and we haven't had any issues yet
04:56 🔗 Ctrl-S if you can make it easy to do things your way, we'll probably do it your way
04:57 🔗 yipdw you don't need to :P
04:57 🔗 Ctrl-S see get() here https://github.com/woodenphone/tumblrsagi/blob/master/utils.py
04:57 🔗 Ctrl-S almost all web requests use that
04:57 🔗 JesseW your way certainly *also* seems useful -- it's just a different idea from the archiving-about-to-die-sites
04:57 🔗 Ctrl-S we archive about to die blogs
04:57 🔗 yipdw there's no problem in having two methods of archiving Tumblrs
04:58 🔗 Ctrl-S my main issue with adding WARC stuff is i don't have a clue how
04:58 🔗 yipdw Tumblr certainly doesn't seem to care; we typically hit Tumblr at 6-8 concurrent requests
04:58 🔗 JesseW yep, and it's good for that -- as long as *tumblr* as a whole continues to exist.
04:58 🔗 pikhq Ctrl-S: We're happy to help in that regard.
04:59 🔗 Ctrl-S right now i'm not at my best for coding, but i'll help however i can
04:59 🔗 Nertsy /notice Ctrl-S Hey im going to bed. Sorry I didn't ask them. I got sidetracked trying to see what they thought about your project. I'm really sorry. :(
04:59 🔗 Nertsy >.>
04:59 🔗 yipdw jesus christ this isn't about winning
04:59 🔗 pikhq Ctrl-S: No worries. You're doing neat shit and saving data.
05:00 🔗 JesseW and that is useful no matter *how* you do it
05:00 🔗 pikhq This was the nitpick brigade. :)
05:00 🔗 Ctrl-S there are like two places we don't use those two get() functions there
05:00 🔗 Ctrl-S but the API all goes through it
05:01 🔗 JesseW Nertsy: please add a link to your code (and the live site, if you want) to: http://archiveteam.org/index.php?title=Tumblr
05:01 🔗 JesseW that way people will be able to find it again later
05:02 🔗 Ctrl-S there's also a 4chan archive we found that has posts we cant find elsewhrere
05:02 🔗 DFJustin archivebot!
05:02 🔗 _desu_ has joined #archiveteam-bs
05:03 🔗 Ctrl-S http://archive.pony-party.tk/
05:03 🔗 Ctrl-S any chance of help grabbing the posts?
05:03 🔗 Ctrl-S can't find a way to contact the admin to ask them for a db dump
05:04 🔗 pikhq I don't remember how to get archivebot to start going.
05:04 🔗 Nertsy We don't want to flood it
05:04 🔗 pikhq I don't remember how to get archivebot to start going.
05:04 🔗 yipdw it's going
05:04 🔗 pikhq Oh okay then.
05:05 🔗 Ctrl-S basically this is the only one that has posts going back to the beginning of the board
05:05 🔗 DFJustin great
05:05 🔗 Nertsy JesseW thanks for the invitation but I can't remember my credentials maybe Ctrl-S could do it
05:06 🔗 Ctrl-S kk
05:06 🔗 pikhq My next place I should put together a dedicated archivebot box.
05:06 🔗 yipdw it's not as easy as it should be
05:06 🔗 pikhq I'm willing to make a project of it.
05:07 🔗 pikhq Dammit I need to make use of my new, better Internet somehow. :P
05:07 🔗 Nertsy So with warc, I'm assuming that when this gets finished I can download the whole site in one file?
05:07 🔗 Nertsy Also I'm excited for my upcoming Google Fiber connection :D
05:07 🔗 yipdw one or more files; archivebot splits every 5 GB
05:08 🔗 DFJustin warcs are designed so that you can easily concatenate them
05:08 🔗 pikhq Alas, I won't have Google Fiber because Google doesn't have Fiber near their freaking headquarters.
05:09 🔗 Ctrl-S um i think i lost my password to it
05:10 🔗 pikhq Google might have many perks but "we get you the service we offer in KC" is not one of 'em.
05:11 🔗 JesseW heh, ok I'll add the links to the wiki.
05:13 🔗 Ctrl-S okay, made an account and added the links
05:14 🔗 Nertsy Uhh Ctrl-S did you remove our api key from the git?
05:14 🔗 JesseW Ctrl-S: ah, thanks
05:15 🔗 Nertsy Ok Nvm it's not there
05:15 🔗 Nertsy Thanks JesseW
05:15 🔗 pikhq Seriously WTF Google, gimme Fiber!
05:15 🔗 Nertsy Living in nashville is finally paying off
05:16 🔗 Ctrl-S the API key is in the config.py file which is ignored by git
05:16 🔗 Ctrl-S I should probably put a new example one there
05:16 🔗 pikhq You'd figure they could offer it in Silicon Valley but noooo
05:16 🔗 pikhq Gotta go with Comcast.
05:16 🔗 Nertsy So Ctrl-S we need to update the sample config for the new options
05:16 🔗 Ctrl-S yeah
05:16 🔗 Ctrl-S i'll just sanitize mine
05:16 🔗 Nertsy What speeds do they offer there?
05:17 🔗 pikhq 2Gbps, so it's not like Fiber is *needed*, but still. :P
05:17 🔗 Nertsy I get 105Mbps down and 25Mbps up. I complained enough times about it being slow so they over provisioned me
05:17 🔗 Nertsy And good lord how much is that??? Mines $200 a month
05:17 🔗 pikhq I didn't check.
05:17 🔗 pikhq I should though because sign me the fuck up.
05:18 🔗 Nertsy How long have you had them?
05:18 🔗 yipdw beats my 16/1 for $85/month
05:18 🔗 Nertsy A monthly bill doesn't seem like some expense you can just write off
05:18 🔗 pikhq I haven't -- I'm about to move *to* the Bay Area.
05:19 🔗 Ctrl-S Just be happy you aren't in Australia, i'm walking distance from the city and on ADSL2
05:19 🔗 pikhq Here in St Louis I'm paying like $50/month for 50/4.
05:19 🔗 yipdw on the other hand I do get publicly routable IPv6 addresses that sometimes work so I guess that's a plus
05:20 🔗 pikhq Ah, looks like it's $300/month for the 2 gig service. ... *Might* be worth it.
05:21 🔗 Nertsy Oh I was about to say you need business class
05:21 🔗 Nertsy But it seems like nashville is the only market with a data cap on residential connections
05:22 🔗 pikhq I wouldn't dare pay that for 2 gig with a cap.
05:22 🔗 Nertsy Yeah you only get 250Gb a mo
05:22 🔗 Nertsy Then $10 for every 50Gb over
05:23 🔗 Nertsy Reminds me of this bill I had one time https://www.dropbox.com/s/ev47xx4r6m5qplw/crap.PNG?dl=0
05:24 🔗 pikhq See, if a data cap was on the line I would *have to* get a business line.
05:24 🔗 yipdw Nertsy: holy shit
05:24 🔗 pikhq Jesus.
05:24 🔗 SketchCow changes topic to: Archive Team: After Five Years, You'd Think We'd Know What We're Doing
05:24 🔗 pikhq :)
05:24 🔗 yipdw changes topic to: Archive Team: After Five Years, You'd Think We'd Know What We're Doing | Sometimes We Don't
05:26 🔗 Nertsy I thought I'd have to take out a loan for a little bit haha
05:27 🔗 Nertsy Played dumb claimed I took off wifi pw. Got most of it taken off
05:27 🔗 pikhq SketchCow: Curses! I can't sign up for shit involving being at the Internet Archive right now because I'm not there yet!
05:27 🔗 pikhq (re: twitter)
05:33 🔗 bzc6p_ has quit IRC (Ping timeout: 600 seconds)
05:35 🔗 mistym has quit IRC (Remote host closed the connection)
05:35 🔗 mistym has joined #archiveteam-bs
05:43 🔗 godane has quit IRC (Ping timeout: 252 seconds)
06:24 🔗 vitzli has joined #archiveteam-bs
06:31 🔗 mistym has quit IRC (Remote host closed the connection)
06:32 🔗 mistym has joined #archiveteam-bs
06:35 🔗 JesseW has quit IRC (Quit: Leaving.)
06:51 🔗 DopefishJ has joined #archiveteam-bs
06:51 🔗 swebb sets mode: +o DopefishJ
06:51 🔗 mistym has quit IRC (Remote host closed the connection)
06:51 🔗 mistym has joined #archiveteam-bs
06:52 🔗 mistym has quit IRC (Remote host closed the connection)
07:00 🔗 DFJustin has quit IRC (Ping timeout: 740 seconds)
07:30 🔗 ersi Bröl.
07:33 🔗 DopefishJ is now known as DFJustin
07:45 🔗 Rotab br���l
07:52 🔗 mistym has joined #archiveteam-bs
08:05 🔗 mistym has quit IRC (Ping timeout: 606 seconds)
08:18 🔗 oldcad has joined #archiveteam-bs
08:20 🔗 dashcloud has quit IRC (Read error: Operation timed out)
08:23 🔗 dashcloud has joined #archiveteam-bs
08:53 🔗 dan- has joined #archiveteam-bs
09:11 🔗 primus104 has joined #archiveteam-bs
09:22 🔗 bzc6p has joined #archiveteam-bs
09:22 🔗 swebb sets mode: +o bzc6p
09:25 🔗 godane has joined #archiveteam-bs
09:38 🔗 vitzli has quit IRC (Quit: Leaving)
10:08 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
10:26 🔗 brayden has joined #archiveteam-bs
10:26 🔗 swebb sets mode: +o brayden
10:27 🔗 godane SketchCow: your going to be getting the Atomic Magazine full run very soon
10:29 🔗 Ctrl-S is that the australian computer mag?
10:29 🔗 Ctrl-S and will the CDs be included?
10:32 🔗 Ctrl-S i wonder if they even still do cover CDs
10:37 🔗 godane it is a australian computer magazine
10:37 🔗 godane i don't have any of the cds
10:38 🔗 Ctrl-S i'll keep an eye out for any i might have lying around
10:38 🔗 Ctrl-S i used to have a sucscription a few years ago
10:47 🔗 Ctrl-S if the guys at atomic cant give you the cds, this guy might have them, he worked there http://www.furaffinity.net/user/bruyaglovae/
10:47 🔗 Ctrl-S wait wrong link
10:47 🔗 Ctrl-S http://dansdata.com/
10:47 🔗 Ctrl-S damnit clipboard
10:57 🔗 Fusl has quit IRC (Read error: Operation timed out)
11:00 🔗 godane i'm starting to upload it
11:00 🔗 godane just know the first 12 issues had no ads so i'm not uploading those
11:00 🔗 godane but from issue 13 and up are complete with ads
11:01 🔗 godane uploaded: https://archive.org/details/Atomic-013-2002-02
11:18 🔗 swebb has quit IRC (Read error: Operation timed out)
11:18 🔗 atlogbot has quit IRC (Read error: Operation timed out)
11:23 🔗 Fusl has joined #archiveteam-bs
11:26 🔗 swebb has joined #archiveteam-bs
11:40 🔗 atlogbot has joined #archiveteam-bs
12:07 🔗 primus104 has quit IRC (Leaving.)
12:09 🔗 schbirid2 has quit IRC (Read error: Operation timed out)
12:15 🔗 schbirid2 has joined #archiveteam-bs
12:22 🔗 dashcloud has quit IRC (Read error: Operation timed out)
12:29 🔗 Infreq heh linkedin aquired lynda.com
12:37 🔗 dashcloud has joined #archiveteam-bs
12:53 🔗 sankin has joined #archiveteam-bs
13:09 🔗 zhongfu speaking about broadband, i'd like to take a moment to brag about the $70 (USD) 2G/1G fiber available to everywhere here :)
13:19 🔗 * Infreq cries
13:19 🔗 Infreq im among the group of aussies
13:28 🔗 Ctrl-S You sick bastard
13:29 🔗 * Ctrl-S goes back to futilely waiting
13:29 🔗 Ctrl-S it's at the point where we may as well just run our own fiber lines between trees
13:29 🔗 Ctrl-S just hang them from gumtrees
13:31 🔗 Ctrl-S trade bandwidth for power for repeaters
13:37 🔗 dan- on just under 90Mbit/s here
13:37 🔗 dan- gotta get dat telstra cable connection
13:38 🔗 dan- not too likely but if your house has foxtel cable connections Infreq, ring them up and ask if they support cable net
13:45 🔗 Infreq have cable but it still really slow; maybe peeps on my street just congest the line; always pretty funny with telstra give you 1tb for the month knowing you wont ever be able to use it all up considering hte line speed
13:47 🔗 dan- that's dodgy, it might be worth calling them up and asking for a lines test, 133933
13:48 🔗 dan- otherwise might be worth getting a telstra tech out there to take a look at it, if it's not their problem they charge you ~$180, we got a guy out a few weeks ago and he replaced some dodgy connectors and rusted stuff up in the powerlines
13:50 🔗 Infreq haha that brings up memories few years back had a mate who had a problem with lines, telstra called out a tech; tech siad there was nothing wrong; he called another telco about it they sent out a tech said the pit was full of water & corroded wires
13:52 🔗 dan- ha, sounds about right
13:52 🔗 dan- up at work, we've had some fun times with telstra
13:52 🔗 dan- when we were first getting net and phones setup in our first business, waited about three weeks for a tech to come out and wire us up
13:53 🔗 Infreq >_<
13:53 🔗 dan- had to end up crimping our own wires in the telco box
13:53 🔗 Infreq far out
13:53 🔗 dan- oh, and we had to get them to fix some issues, net dropping out every day etc, was a problem on their end
13:54 🔗 dan- tech went out to the exchange, got out lines disconnected and halfway through working on them etc, got called out to a hospital
13:54 🔗 dan- (when hospital calls come in the techs drop everything and go right out)
13:54 🔗 Infreq oh my
13:54 🔗 dan- and told nobody our wires weren't finished, took them another three weeks to get a tech out there and finally see why we hadn't had any connection at all
13:55 🔗 * Infreq facepalms
13:55 🔗 dan- oh, and we moved into a new shop a year ago or so
13:55 🔗 Infreq "your business is important to us" yet we'll dick you over attitude is a speciality of telstra
13:55 🔗 dan- we're a computer shop, so we rang early and confirmed a 20Mbps connection, minimum
13:56 🔗 dan- all confirmed weeks in advance, confirmed week in advance, half a week in advance of us moving to the new store
13:56 🔗 dan- telstra calls us two days before moving in
13:56 🔗 dan- "sorry, we have no lines at all. we cannot get a connection at all in the new premises. sorry, good luck"
13:57 🔗 Infreq :/
13:58 🔗 dan- on them for 8 hours a day for about a week, finally got them to hook up half of a cable pair of a phone line to get us adsl
13:59 🔗 dan- computer shop by the way, so that was awesome for running ~12 computers all the time doing all sorts of different stuff, updates drivers etc
13:59 🔗 Infreq that sound not too fun at all
14:00 🔗 dan- managed to get a few technicians we know out to hook some stuff up for us, we're on about 3mbps right now
14:00 🔗 dan- not great but it does the job at least
14:01 🔗 dan- oh, and literally any time anyone at telstra touches our account, almost everything falls over
14:01 🔗 Infreq least so 1/6th of the speed thou
14:01 🔗 dan- telstra rep called a while ago and asked if we wanted to upgrade our phone plan, boss refused
14:02 🔗 dan- next week, no internet, no phone lines at all to the shop
14:02 🔗 Infreq XD
14:02 🔗 dan- we call up telstra, "oh, in here it says a rep called you last week and approved total cancellation of your service"
14:02 🔗 Infreq wtf
14:03 🔗 Infreq yeah their "how can we improve your service" calls do more bad than good
14:03 🔗 Ctrl-S do they record their support line then?
14:04 🔗 dan- oh they do, we've been over stuff lots with them
14:04 🔗 dan- had about five case managers, taken them to court once or twice
14:07 🔗 dan- what can you do, but honestly for my home connection telstra have been wonderful
14:08 🔗 dan- probably because we could change isps where my home is, at work they own all the lines and you can't move to another provider even if you wanted to :p
14:08 🔗 Infreq I couldn't say the same but hey my area atm only has telstra to work with so I'm bumbed
14:09 🔗 Infreq was with iinet previous for 5 years never had a problem
14:10 🔗 dan- fair enough, problem with going anyone but telstra is usually telstra owns all the lines anyway
14:10 🔗 dan- so if it is an issue with the lines, you ring iinet, iinet rings telstra, and telstra just take their time since it's not one of their customers
14:10 🔗 dan- at least out here, might be different there
14:11 🔗 Infreq back in my old area iinet put in their own hardware into the exchange so they self serviced it all which was rad
14:12 🔗 dan- ooh nice, that's pretty cool
14:15 🔗 dan- iinet were getting bought by tpg or something, should be interesting to see how that goes
14:16 🔗 dan- don't see too many directly-iinet customers here, mostly westnet customers that were migrated over when iinet bought them out
14:17 🔗 dan- ha, that reminds me of when I went out to a lady's house to install a new modem since her one had died
14:17 🔗 dan- her telstra password was literally '2', told me about how they kept ringing her to try and change it but just gave up after a few weeks
14:21 🔗 Infreq XD
14:22 🔗 Infreq yeah should be interesting tpg taking over iinet, not a good thing considering how many complaints about tpg I've had from friends
14:22 🔗 Infreq heard*
14:26 🔗 Ctrl-S we should just nationalize the lines
14:26 🔗 Ctrl-S selling telstra just made them worst
14:27 🔗 Infreq heh just saying dont think it will get better anytime soon
14:28 🔗 Ctrl-S our govt hates internet stuff
14:28 🔗 Infreq ^
14:28 🔗 Ctrl-S it's just another thing to demonize to them
14:31 🔗 mistym has joined #archiveteam-bs
14:33 🔗 dan- I like how, at least here, all the pollies are saying NBN is happening right now, we're getting switched on as we speak
14:34 🔗 dan- the actual techs tell us they're replacing all the lines, getting the whole few-suburbs wired up
14:35 🔗 dan- and then around christmas (earliest), they switch absolutely everyone over to the new lines and the new tech all at the same time
14:35 🔗 Ctrl-S ohgodno
14:35 🔗 dan- certainly going to be fun when that happens
14:35 🔗 Infreq found the article new crap they passed http://www.itnews.com.au/News/405557,australia-passes-law-to-block-overseas-piracy-sites.aspx
14:35 🔗 dashcloud has quit IRC (Read error: Operation timed out)
14:36 🔗 Ctrl-S so rather than just turning it on and then adding people as they get it installed over a few moneths or years, they do it all at once?
14:37 🔗 Ctrl-S they could just turn them on when the line goes to the house and have that wonderful gradual increase that makes debugging so much nicer
14:37 🔗 dan- yep, everybody on at the same time
14:38 🔗 dashcloud has joined #archiveteam-bs
14:38 🔗 dan- reminds me of an old optus engineer I was talking to
14:39 🔗 dan- apparently their rule was to never ever reverse code, if it breaks just keep working on it and pushing it forwards until it's working
14:39 🔗 Ctrl-S morons
14:40 🔗 Ctrl-S so basically erryone is gonna get a VPN now
14:40 🔗 Ctrl-S and that law is def gonna be abused like hell
14:41 🔗 Ctrl-S no way to contest a block is there?
14:41 🔗 Infreq who knows... just hate the fact that the net's going to filtered to this degree
14:42 🔗 Ctrl-S im already on a vpn and trying to convince family to use one
14:42 🔗 Ctrl-S are we taking bets on how long it takes for the IA to be blocked?
14:42 🔗 Infreq got a vps with openvpn setup if that counts rarely need to use thou
14:43 🔗 Infreq XD
14:43 🔗 Ctrl-S "Circumvention information"
14:43 🔗 Ctrl-S "Infomation on illegal activities"
14:44 🔗 mistym has quit IRC (Remote host closed the connection)
14:45 🔗 primus104 has joined #archiveteam-bs
14:46 🔗 dan- been trying to get aria2 and vpn hooked up on a raspberry pi at home for easy downloading
14:46 🔗 dan- put a link to 192.168... on lil bro's desktop and take him to a web page to add urls and torrent files
14:47 🔗 dan- but software is annoying, especially with multiple interfaces >_>
14:47 🔗 Ctrl-S i bought a router but still havent gottten around to setting it up for the vpn, idea is everything goes through it and it wraps it in the vpn
14:50 🔗 dashcloud has quit IRC (Read error: Operation timed out)
14:52 🔗 Infreq got to say hate the added latency with vpn's
14:57 🔗 dashcloud has joined #archiveteam-bs
14:57 🔗 mistym has joined #archiveteam-bs
15:01 🔗 Ctrl-S better than the spying and censorshit tho
15:02 🔗 Infreq yeah
15:04 🔗 dashcloud has quit IRC (Read error: Operation timed out)
15:10 🔗 dashcloud has joined #archiveteam-bs
15:10 🔗 primus104 has quit IRC (Leaving.)
15:13 🔗 bzc6p_ has joined #archiveteam-bs
15:17 🔗 bzc6p has quit IRC (Read error: Operation timed out)
15:32 🔗 bzc6p_ is now known as bzc6p
15:52 🔗 mistym has quit IRC (Remote host closed the connection)
16:08 🔗 mistym has joined #archiveteam-bs
16:43 🔗 dashcloud has quit IRC (Read error: Operation timed out)
16:50 🔗 dashcloud has joined #archiveteam-bs
16:50 🔗 garyrh has quit IRC (Read error: Operation timed out)
17:09 🔗 sankin has quit IRC (Ping timeout: 601 seconds)
17:26 🔗 aaaaaaaaa has joined #archiveteam-bs
18:43 🔗 kvieta has quit IRC (Read error: Operation timed out)
18:44 🔗 primus104 has joined #archiveteam-bs
18:55 🔗 mistym has quit IRC (Remote host closed the connection)
18:57 🔗 mistym has joined #archiveteam-bs
19:16 🔗 mistym has quit IRC (Remote host closed the connection)
19:17 🔗 mistym has joined #archiveteam-bs
19:43 🔗 mistym has quit IRC (Remote host closed the connection)
19:45 🔗 mistym has joined #archiveteam-bs
19:48 🔗 aaaaaaaaa SketchCow: any updates on SourceForge? I has been a week since they showed up and the grab stopped.
19:50 🔗 tephra has quit IRC (Ping timeout: 258 seconds)
19:51 🔗 tephra has joined #archiveteam-bs
19:51 🔗 dashcloud has quit IRC (Read error: Operation timed out)
20:01 🔗 dashcloud has joined #archiveteam-bs
20:47 🔗 mistym has quit IRC (Remote host closed the connection)
21:00 🔗 garyrh has joined #archiveteam-bs
21:00 🔗 mistym has joined #archiveteam-bs
21:10 🔗 joepie91 to all:
21:10 🔗 joepie91 "If you ever end up working on anything that needs a large amount of storage, reasonable amounts of bandwidth, and a very very very low likelihood of it attracting negative attention (takedown notices, abuse complaints, raids, etc) I could probably set help."
21:10 🔗 joepie91 (offer from somebody I know)
21:12 🔗 Stilett0 has joined #archiveteam-bs
21:13 🔗 xmc joepie91: that sounds like someone who wants to do ia.bak ...
21:13 🔗 Stiletto has quit IRC (Read error: Operation timed out)
21:14 🔗 joepie91 xmc: hmm, good point. should I point them at that?
21:22 🔗 xmc i would suggest it
21:23 🔗 aaaaaaaaa makes sense to me.
21:28 🔗 mistym has quit IRC (Remote host closed the connection)
21:37 🔗 winr4r joepie91: and how does he avoid takedown notices?
21:38 🔗 winr4r still, yes, large amount of storage makes me think ia.bak too
21:38 🔗 joepie91 winr4r: what do you mean?
21:39 🔗 winr4r joepie91: why is he immune to takedown notices and raids and abuse complaints more than anyone else is?
21:39 🔗 Rotab i think you misread?
21:40 🔗 joepie91 winr4r: yeah, you misread :P
21:40 🔗 winr4r okay
21:40 🔗 joepie91 winr4r: the request was to only suggest stuff that's low on such things
21:40 🔗 joepie91 ie. *not* causing problems
21:40 🔗 winr4r oh, right, yes, i did misread
21:40 🔗 joepie91 hehe
21:40 🔗 joepie91 winr4r: that being said, he's been rather helpful in the past for keeping some stuff running that would cause issues with most hosts... it really depends on how much of the infra you run yourself
21:41 🔗 joepie91 (ie. how much pressure can be applied to you through upstreams)
21:41 🔗 winr4r get him on ia.bak then
21:42 🔗 JesseW has joined #archiveteam-bs
21:44 🔗 mistym has joined #archiveteam-bs
21:44 🔗 joepie91 alright
21:44 🔗 joepie91 sending email
21:44 🔗 winr4r \o/
21:53 🔗 joepie91 .title http://www.futurism.com/links/view/a-dutch-city-will-start-experimenting-with-unconditional-basic-income-this-summer/
21:53 🔗 botpie91 joepie91: A Dutch City Will Start Experimenting with Unconditional Basic Income This Summer - Futurism
21:53 🔗 joepie91 winr4r: he might pop in here, also gave him this IRC channel
21:53 🔗 joepie91 :p
22:10 🔗 aaaaaaaaa https://cloud.google.com/tools/cloud-repositories/
22:12 🔗 aaaaaaaaa "Cloud Source Repositories are fully-featured private Git repositories hosted on Google Cloud Platform." If they had better timing, they could have used that as some sort of pivot for Google Code.
22:23 🔗 JesseW has quit IRC (Ping timeout: 252 seconds)
22:30 🔗 JesseW has joined #archiveteam-bs
22:32 🔗 joepie91 lol
23:11 🔗 BlueMaxim has joined #archiveteam-bs
23:11 🔗 BlueMaxim has quit IRC (Read error: Connection reset by peer)
23:11 🔗 BlueMaxim has joined #archiveteam-bs
23:18 🔗 JesseW1 has joined #archiveteam-bs
23:18 🔗 JesseW has quit IRC (Ping timeout: 252 seconds)
irclogger-viewer