#archiveteam-bs 2017-12-27,Wed

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***ZexaronS has joined #archiveteam-bs [00:19]
.... (idle for 16mn)
Mateon1 has quit IRC (Remote host closed the connection)
Mateon1 has joined #archiveteam-bs
[00:35]
joepie91JAA: oh yeah, I was going to point out re: your earlier remark about my code missing some cases, that CF occasionally changes up their code a bit [00:39]
***dd0a13f37 has quit IRC (Quit: Connection closed for inactivity) [00:44]
icedice has joined #archiveteam-bs [00:50]
JAAYeah. I just implemented all valid 1-3 character combinations of + and ! to be safe.
joepie91: I also implemented generic addition, subtraction, and multiplication rules for all combinations between bools, ints, and strings according to JS's rules.
I just hope they won't switch to real JSFuck code. But that would probably be counterproductive as the code they'd have to send out would become huge.
[00:58]
........... (idle for 53mn)
***svchost03 has joined #archiveteam-bs
svchfoo1 sets mode: +o svchost03
[01:53]
.... (idle for 15mn)
schbirid has quit IRC (Ping timeout: 255 seconds)
MrDignity has quit IRC (Read error: Connection reset by peer)
MrDignity has joined #archiveteam-bs
MrDignity has quit IRC (Read error: Connection reset by peer)
schbirid has joined #archiveteam-bs
[02:08]
godane has quit IRC (Quit: Leaving.) [02:33]
godane has joined #archiveteam-bs [02:45]
....... (idle for 32mn)
bwn has quit IRC (Quit) [03:17]
..... (idle for 23mn)
bwn has joined #archiveteam-bs [03:40]
tomatokin has joined #archiveteam-bs [03:50]
MrDignity has joined #archiveteam-bs [03:57]
.... (idle for 19mn)
icedice has quit IRC (Quit: Leaving) [04:16]
....... (idle for 32mn)
qw3rty113 has joined #archiveteam-bs [04:48]
qw3rty112 has quit IRC (Read error: Operation timed out) [04:54]
..... (idle for 20mn)
MrDignity has quit IRC (Read error: Connection reset by peer) [05:14]
....... (idle for 33mn)
tomatokin has quit IRC (Ping timeout: 360 seconds) [05:47]
..................... (idle for 1h40mn)
dashcloud has quit IRC (Read error: Operation timed out) [07:27]
dashcloud has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
[07:35]
............ (idle for 55mn)
kimmer1 has quit IRC (Ping timeout: 633 seconds) [08:33]
........ (idle for 39mn)
schbirid has quit IRC (Quit: Leaving) [09:12]
.... (idle for 15mn)
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
[09:27]
schbirid has joined #archiveteam-bs [09:35]
.............. (idle for 1h7mn)
BlueMaxim has quit IRC (Quit: Leaving) [10:42]
.... (idle for 16mn)
tar-xvf has joined #archiveteam-bs
odemg_ has quit IRC (Read error: Operation timed out)
REiN^ has quit IRC (Ping timeout: 600 seconds)
[10:58]
...... (idle for 25mn)
REiN^ has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
[11:28]
ZexaronS has quit IRC (Quit: Leaving)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
drumstick has quit IRC (Ping timeout: 248 seconds)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
tomatokin has joined #archiveteam-bs
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
tomatokin has quit IRC (Quit: Leaving)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
pizzaiolo has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
ZexaronS has joined #archiveteam-bs
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
pizzaiolo has quit IRC (Read error: Operation timed out)
pizzaiolo has joined #archiveteam-bs
[11:37]
jacketcha has quit IRC (Remote host closed the connection)
jacketcha has joined #archiveteam-bs
jacketcha has quit IRC (Read error: Connection reset by peer)
jacketcha has joined #archiveteam-bs
[12:24]
............ (idle for 55mn)
JAAjacketcha: Fix your connection please. [13:25]
........... (idle for 54mn)
jrwrJAA: lol [14:19]
***dashcloud has quit IRC (Read error: Operation timed out) [14:19]
.... (idle for 19mn)
dashcloud has joined #archiveteam-bs [14:38]
........ (idle for 39mn)
tar-xvf has quit IRC (Read error: Operation timed out) [15:17]
.... (idle for 16mn)
tar-xvf has joined #archiveteam-bs [15:33]
.... (idle for 18mn)
jrwrSketchCow: if you want to add this to any notes you have for the wiki https://www.archiveteam.org/index.php?title=User:Jrwr
I put some comments on my userpage for if anyone comes in behind me
[15:51]
.... (idle for 17mn)
***schbirid has quit IRC (Ping timeout: 255 seconds) [16:09]
schbirid has joined #archiveteam-bs [16:21]
........ (idle for 37mn)
zino has quit IRC (Remote host closed the connection) [16:58]
........ (idle for 38mn)
jschwart has joined #archiveteam-bs [17:36]
....... (idle for 33mn)
Stiletto has quit IRC (Ping timeout: 260 seconds)
kristian_ has joined #archiveteam-bs
[18:09]
godaneso some good news on my new rpi3
1 the case is alot better and not falling apart when i move it
2 i found a way to maybe port slax linux-live scripts to rpi
[18:12]
***Stilett0 has joined #archiveteam-bs
Stilett0 is now known as Stiletto
[18:26]
ola_norsk has joined #archiveteam-bs [18:31]
ola_norskjrwr: are there any statements made or pages that show IA's diskusage? [18:33]
jrwrSketch was complaining about it yesterday
Ill see if I can dig one up
We budgeted for 1pb of disk space last year, We used 2pb
[18:33]
ola_norskjrwr: In my case, i think that could be a powerful 'punch point' towards getting some other organizations/museums etc to opens their eyes (and their wallets and datacenters) [18:35]
jrwrso
I know its more then 16PB
in use
[18:39]
ola_norskSomebody2: sorry if i remember incorrectly, but it was you who also sent email to that guy in DND/NCS ? If so, did you recieve a response yet? [18:45]
PurpleSymDisk space graphs: https://archive.org/~tracey/mrtg/df.html [18:45]
ola_norskty [18:47]
NCS are holding the 'Yggdrasil Conference' at Sandefjord 23. og 24. april 2018 . And it would be cool if the importance of preserving IA became a topic there.
sadly there no english version of this: https://no.wikipedia.org/wiki/Yggdrasil_(konferanse)
[18:56]
i do not even know how conferences work, since i've never been to one. But, the contact person is Elisabeth Kras of Den norske dataforening (NCS), at elisabeth.kras@dataforeningen.no
https://yggdrasilkonferansen.no/kontakt-oss/
[19:05]
***bitspill has quit IRC (Read error: Connection reset by peer)
ThisAsYou has quit IRC (Read error: Connection reset by peer)
jiphex has quit IRC (Read error: Connection reset by peer)
c0mpass has quit IRC (Read error: Connection reset by peer)
DrasticAc has quit IRC (Read error: Connection reset by peer)
hook54321 has quit IRC (Ping timeout: 245 seconds)
JSharp has quit IRC (Read error: Connection reset by peer)
HCross2 has quit IRC (Read error: Connection reset by peer)
tklk has quit IRC (Read error: Connection reset by peer)
johtso has quit IRC (Read error: Connection reset by peer)
jrwr has quit IRC (Ping timeout: 260 seconds)
Mateon1 has quit IRC (Read error: Operation timed out)
Mateon1 has joined #archiveteam-bs
[19:12]
ola_norskbtw, since someone mentioned that the mirror in Alexandria, Egypt is outdated/behind IA by ~10 years..Was it political climate in Egypt that caused that?
or did it simply not manage to keep up with hardware?
[19:19]
kisspunchFWIW I asked if Dropbox would sponsor a mirror (even in part), they said no [19:22]
ola_norsknah, to get shit done these days it needs at least some "twitter rage" i guess :D [19:23]
kisspunchoh, i work there
for context :)
[19:23]
ola_norskthen some carefully crafted hashtag, and you putting into "trending" should do it ;)
hehe
[19:24]
kisspunchat dropbox, not at twitter [19:25]
ola_norskah
could you make it so that they offer less than 1TB solutions? (I already asked them, and they said no to that as well)..
anyway, it needs some outrage
1GB i meant
[19:25]
kisspunchola_norsk: why do you want that? and i can't do anything personally but i can advocate :) [19:30]
ola_norskkisspunch: i'm guessing it will take Associations or government departments. Private companies, unless there's PR to be garnered, is less likely to be willing i think [19:31]
***DrasticAc has joined #archiveteam-bs
ThisAsYou has joined #archiveteam-bs
jrwr has joined #archiveteam-bs
bitspill has joined #archiveteam-bs
hook54321 has joined #archiveteam-bs
JSharp has joined #archiveteam-bs
xarph has joined #archiveteam-bs
riking has joined #archiveteam-bs
[19:32]
ola_norskkisspunch: the reason i'd prefer dropbox to have a smaller solution than 1TB, is that my harddrive is 100GB (i know, it's small). And price of their 1TB. [19:40]
jrwrget google drive suite
gsuite
their 10$ plan gets you unlimited right now
[19:41]
ola_norski can not afford $10/month :/
and i like the niceness of dropbox integrated into my filemanager
[19:42]
jrwrgoogle drive stream does the same as dropbox + the files don't exist on your machine anymore, they get streamed in on access [19:43]
ola_norskjrwr: the dropbox 1TB is ~9-10USD, and, the _main_ reason it would be nice if dropbox were to offer smaller plans is that i can simply not afford a monthly charge of 10usd [19:46]
jrwrah [19:46]
ola_norski could, in a pinch if i really really needed it, but a smaller plan would both meet my need and wallet :)
i'm well aware that 1TB is small these days though :D
[19:48]
Frogging$10/month for unlimited is... nothing o.o [19:52]
***zyphlar has joined #archiveteam-bs [19:53]
ola_norskFrogging: "All things are relative"..sadly, it's something when already at strained economy for various reason :/ [19:59]
Froggingoh I meant relative to the usual prices for such things, not the value of $10 [20:00]
ola_norskaye indeed. How long will be they offering unlimited though? In the spring i will have no problem affording it [20:01]
Froggingit's definitely not sustainable, so that's a good question [20:02]
ola_norskand, when that offering ends, then what? :/ [20:02]
jrwrFrogging: nether is youtube
with the PBs of videos per minute being uploaded
[20:03]
Froggingindeed [20:03]
ola_norskif they don't plan to suddenly increase price, or delete files, couldn't people just upload dummyfiles like madmen?
just to pre-secure storage space, i mean
[20:03]
more specifically, using e.g 'dd' to generate huge files, upload them to that google solution at hearts content (pun required), to set the drivespace if/when the unlimited offer should end
i'm thinking (fearing) people might want to read the small print in the usage of that google solution :/
[20:10]
jrwrim storing about 600TB of Gdrive right now
I know a pair that are storing 2PB on it
[20:15]
ola_norskfor $10 a month?
and you are certain those 600TB will always be accesible to you for ~10USD ?
[20:16]
astridyeah that's the rub [20:17]
jrwrIts "linux isos"
so Its not a loss if I lose it
[20:17]
ola_norskmy first thought is that _if_ that happens, you're unlikely to be only one :/
but just in case it's google being nice, offering a 'first come first serve' ..there's 'dd' that could easily generate 'iso' files ;)
[20:19]
***kristian_ has quit IRC (Quit: Leaving)
jschwart has quit IRC (Quit: Konversation terminated!)
[20:29]
ola_norskjrwr: by 'a pair' do mean a couple of indiviuals having 2PT stored each?
you mean*
[20:37]
anyway. Someone with twitter might want to ask like (https://youtu.be/w7e1Z0PL1CY) review the terms of use of that google service in worst case scenario. [20:45]
***dashcloud has quit IRC (Read error: Connection reset by peer)
dashcloud has joined #archiveteam-bs
[20:45]
kimmer1 has joined #archiveteam-bs [21:00]
ola_norskmaybe google is aiming to compete with yahoo of being the ones that deleted the most amount of history? :D [21:01]
***kimmer1 has quit IRC (Quit: Yaaic - Yet another Android IRC client - http://www.yaaic.org)
kimmer1 has joined #archiveteam-bs
kimmer1 has quit IRC (Client Quit)
kimmer1 has joined #archiveteam-bs
[21:06]
dashcloud has quit IRC (Read error: Operation timed out) [21:21]
JAAola_norsk: Backblaze B2 is $5 per TB and month. If you store just a few GB, you'll pay some cents per month only. There is a fee for downloading though. [21:21]
***dashcloud has joined #archiveteam-bs [21:24]
ola_norskJAA: that sounds like a more realistic offer than google indeed. But the downloading fee though.. :/ One of the reasons i like dropbox is the syncing [21:25]
***BlueMaxim has joined #archiveteam-bs [21:32]
ola_norskJAA: i kind of think of cloudstorage in ways of "Don't risk it if you can't afford to loose it".. I wouldn't store in the cloud what i couldn't realisticly, if i absolutely had to, be able to keep a copy of by myself
kind of cruel to say it, but i think Vidme might agree :d
[21:37]
JAAOh I agree, cloud storage is just a neat way of doing an off-site backup, but it should never, ever be the only copy of the data. [21:38]
ola_norskaye [21:39]
JAAola_norsk: You might want to look at Online.net's C14 as well. There is an "Intensive" service level for €5 per TB and month and no download fees. It's not as straight-forward though.
It's really more of an archival service.
[21:42]
ola_norskJAA: hehe, yeah, it looks to more like that and not so much as a 'drop or delete a file or folder' kind of thing :D "Create an electronic safe-deposit box, upload up to 40TB of data using FTP, SFTP, Rsync or SCP, and use our simple control panel or API to archive your data in no time."
i'm not exactly keeping the cure for cancer in my Dropbox
JAA: but damn, that seems to be good service for important stuff
[21:53]
JAAIt does. I'm not sure how good they are in practice though. And that archival/unarchival could be really annoying. [22:02]
ola_norskaye "the average time to recover your data is approximately 2 hours." [22:04]
JAAYep, similar to Amazon Glacier. [22:04]
ola_norskit's some 'butler' running around on a segway or roller-blades in some tunnels i guess :)
at least that means it's inpenetrable to hacks
[22:05]
***HCross2 has joined #archiveteam-bs [22:08]
HCross2Apologies for the spam.. IRCcloud was having a meltdown [22:09]
ola_norskHCross2: https://youtu.be/1VD_pJOFnZ0
it's quite amazing that IRC have been around this long :D
[22:10]
***zyphlar has quit IRC (Quit: Connection closed for inactivity) [22:12]
ola_norskthe efnet server i'm using 'irc.homelien.no' , was there in the times of 'Spider' a norwegian tv program in ~94-96 :D [22:15]
***RichardG_ has joined #archiveteam-bs [22:15]
ola_norskand still today, Twitch uses irc [22:15]
***RichardG has quit IRC (Read error: Connection reset by peer) [22:16]
ola_norsklol..'pentium 133, running netscape'..wow :D https://youtu.be/4yd9khAQCug
back in the times when DAT tapes were fancy..
[22:17]
JAAGetting quite offtopicky in here. [22:19]
ola_norsknot if i archive it .. https://tv.nrk.no/serie/spider [22:20]
SketchCowI have a request for help, for me
textfiles.com doesn't handle .txt properly
I'm sure I fucked up an option
[22:20]
ola_norskthe http server? [22:21]
SketchCowola_norsk: shh
https://stackoverflow.com/questions/10542639/apache-returns-content-type-text-plain-instead-of-text-html helps a bit
I'm sure I just have apache configured wrong
[22:21]
ola_norskthats what i meant by http server [22:22]
SketchCowI know.
Shhhh.
[22:22]
ola_norskaye [22:22]
SketchCowhttp://www.textfiles.com/drugs/ should have .txt open in browser
I am going to have to track down why it treats it as a download
[22:23]
Igloo<LocationMatch "\.(?i:txt)$">
ForceType text/plain
Header set Content-Disposition inline
</LocationMatch>
^^ SketchCow
[22:26]
ola_norskmight this be relevant? https://serverfault.com/questions/82505/how-can-i-set-apache-to-serve-files-as-text
what igloo said
[22:26]
JAASketchCow: Just randomly checked 2015.txt, and that starts with a NUL byte. Cf. https://stackoverflow.com/a/7877252
amph.txt works, for example.
So I doubt it's a configuration error; it's just that the browser finds the NUL byte, thinks it isn't a text file, and therefore offers the download instead.
[22:26]
ola_norsknot sure how Apache rules work in priority, but maybe "AddType text/plain .txt" could at least be used to override any config mistakes until the cause is found? [22:30]
JAAThe server sends "Content-Type: text/plain" already.
There's also no "Content-Disposition: download" header.
It might be necessary to also specify the encoding of the files, but I doubt it'll ever work if the file starts with a NUL byte.
Every file except 2015.txt seems to work.
[22:31]
godaneSketchCow: we are very close to having tagesschau 20 clock evening news up to 1997-03-31 [22:36]
***tragique has joined #archiveteam-bs [22:36]
godaneits doing 1997-03-30 right now
*uploading
i really hate the way the newer xbox one works
its like you always need to download something in order for the game to work
[22:36]
SketchCowgodane: Fantastic [22:41]
godanei'm trying to get up to november of 1997 [22:41]
ola_norskgodane: that's the way to circumvent the complaining about the 'always online' requirement :)
godane: "ok, your xbox doesn't have to stay online all the time.. but no one said anything about having to download"
[22:41]
DrasticAcTurns out that the Azure Postgres preview cant handle transferring 300 millions rows at once with pg_restore
Every time I try, the server bombs out. That’s what I get for dogfooding.
Trying to get this Miiverse web archive site up by MAGfest, since by then I’m on vacation and I’m gonna do my best not to touch any code.
[22:56]
schbiridjrwr: any idea if there is a nice and safe way to share huge amounts of files between gdrive accounts?
eg i want to let my friend sync my iso collection
[23:09]
***Bond__ has joined #archiveteam-bs [23:12]
Bond__hello everyone [23:13]
Kazhello [23:15]
Bond__how is everyone [23:16]
SketchCowGetting my hip hop torrents collection working again
[Throttle off/off KB] [Rate 36.6/14265.3 KB] [Port: 6951]
Working
[Throttle off/off KB] [Rate 113.2/45712.1 KB] [Port: 6951]
Really working
[Throttle off/off KB] [Rate 156.5/64651.7 KB] [Port: 6951]
[23:18]
Bond__How much hip hop we talking? [23:23]
SketchCowHair is standing up on end for 1/2 mile around
Not much, frankly.
Probably 40-50 albums.
The mixtapes that have come out since I got the FOS machine to the new hardware
[23:23]
Bond__sketch, have you ever thought about maybe downloading a bunch of newspapers?
i feel like its a category thats mostly regected by people
[23:23]
SketchCow1. Yes. 2. We have
3. No it's not
[23:24]
Bond__Where is the best place to get them if i might ask? [23:25]
SketchCownewspapers.com
But we have them on the archive in archive.org/details/newspapers
With more coming every day
[23:25]
Bond__would you know of a free account for newspapers.com, to download the whole issue? [23:26]
***drumstick has joined #archiveteam-bs [23:27]
SketchCowNot offhand [23:28]
Bond__i just singed up for a trial account, what is the best way to download from there? [23:31]
jacketchais there any good way to archive instagram yet? even when archiving it by hand it's a nightmare for me [23:42]
Bond__yall seen this? https://www.youtube.com/watch?v=U-_-BO99woI [23:45]
JAAjacketcha: Not really. I'm usually clicking the button, put something on the "page down" key to let it scroll to the bottom, extract the posts of the individual URLs, and throw those into ArchiveBot.
I usually click*
There's definitely a better way than this, but at least it works.
[23:46]
jacketchayeah
is there anyway to simulate cookies in http requests? because there are many pages that I would love to archive without asking them to go public (including mine)
[23:47]
JAAWhat do you mean by "simulate"?
wget/wpull can handle cookies just fine.
[23:48]
jacketchanevermind then
i would use the api, but last time I used the api of a site I got kicked off of pastebin
kinda
[23:48]
Bond__love watching this kinda stuff: https://www.youtube.com/watch?v=fyKsNOTIwJk [23:50]
JAAjacketcha: https://github.com/rarcega/instagram-scraper might be a good basis for writing something to archive Instagram users. [23:50]
jacketchaBond__: I usually just watch stuff like https://www.youtube.com/watch?v=VoWRSM2_DF0&t=8s
JAA: That looks promising, i'll check it out
[23:51]
Bond__I think im using youtube wrong [23:52]
***jiphex has joined #archiveteam-bs [23:54]
JAADidn't see this mentioned in here yet: https://www.theverge.com/2017/12/26/16819748/library-of-congress-twitter-archive-project-stalled [23:55]
***octarine has joined #archiveteam-bs
floogulin has joined #archiveteam-bs
tklk has joined #archiveteam-bs
[23:56]
Bond__anyone have copies of past archived instagram crap on archive.org? [23:56]
***Ctrl-S___ has joined #archiveteam-bs
c0mpass has joined #archiveteam-bs
[23:57]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)