#archiveteam-bs 2013-05-28,Tue

↑back Search

Time Nickname Message
02:32 🔗 S[h]O[r]T BlueMax, he didnt get arrested
02:32 🔗 S[h]O[r]T someone go get a group of people and pretend to raid him
02:43 🔗 godane SketchCow: You can always embarassing them later anyway
02:48 🔗 godane ADD MOMENT: looks like notaconmedia.com redirect mp3 and videos to http://www.nerdsnook.com/
02:58 🔗 godane so i got the square enix 2007 tgs presscon
02:59 🔗 godane so i may get more press conferices from tokyo game show 2007
03:01 🔗 godane looks like a good chuck of 31xxx, all of 32xxx, and most of 33xxx was what was not embeded on g4tv.com
03:16 🔗 BlueMax damn
03:29 🔗 godane so looks like 2/3 of 29xxx was not embeded
03:30 🔗 godane only 47 ids in 31xxx are embeded
03:34 🔗 instence has anyone ever run into problems with Amazon EC2 micro instances killing wget processes prematurely?
03:36 🔗 instence i login to check my process and it says "Killed"
03:37 🔗 Coderjoe you may have run out of memory
03:37 🔗 Coderjoe recursive wget eats a lot of memory
03:38 🔗 instence hmm that would explain it. dang. I have to re-adjust my strategy then *scratches head*
03:40 🔗 Coderjoe i had one grab that I was desparate to not lose. I wound up spinning up a high-memory instance, creating a ramdisk, sharing that over to the micro via NBD, and using that as swap.
03:40 🔗 Coderjoe really fragile
03:41 🔗 Coderjoe >_<
03:41 🔗 Coderjoe because the first instance was a micro
03:42 🔗 instence I am asking something for the hell of it, since I already know the answer
03:42 🔗 instence there is no way to resume a recursive process that needed link correction right
03:42 🔗 * instence is looking at 3 days of archiving he has to probobly redo
03:43 🔗 Coderjoe of course, that was after a previous failed attempt which oom-killed a bunch of stuff, including my sshd, before it finally took out the wget
03:43 🔗 instence oh man
03:44 🔗 instence you were archiving to a sshd?
03:44 🔗 Coderjoe uh
03:44 🔗 Coderjoe when you ssh in, sshd is what answers
03:44 🔗 instence oh lol
03:44 🔗 Coderjoe meaning I could no longer log into the system to do anything
03:44 🔗 instence i thought you meant solid state hard drive, sorry
03:44 🔗 instence lol
03:45 🔗 instence yea
03:49 🔗 instence yea i don't know how else to get around this
03:49 🔗 instence I guess I will have to scrape together link lists and download in batches non-recursively
03:52 🔗 godane i need help with a old ipod
03:52 🔗 godane i'm getting black&white with a check mark
03:56 🔗 godane i reboot it
03:56 🔗 godane everything is fine
03:56 🔗 instence i ran dmesg, and yep, out of memory errors
03:56 🔗 instence crapola
04:01 🔗 instence thanks for the tipoff CoderJoe
04:37 🔗 Coderjoe http://i.imgur.com/cAGk6xK.jpg
04:54 🔗 BlueMax I don't mean to be a pain but can I get some help with this gallery site? I want to download all the photos for a friend but they don't seem to make it easy http://weddingportraitgallerie.smugmug.com/Weddings2013/May4thwedding2013/29234839_FpFXpf
04:59 🔗 S[h]O[r]T well just looking at it, the original resolution pictures are at links like http://weddingportraitgallerie.smugmug.com/photos/i-KsffJGs/0/O/i-KsffJGs.jpg http://weddingportraitgallerie.smugmug.com/photos/i-vzbrLbH/0/O/i-vzbrLbH.jpg
04:59 🔗 S[h]O[r]T and that i-* id comes from the k= in the URL
04:59 🔗 S[h]O[r]T http://weddingportraitgallerie.smugmug.com/Weddings2013/May4thwedding2013/29234839_FpFXpf#!i=2510964123&k=vzbrLbH
05:00 🔗 S[h]O[r]T it doesnt seem to like trying to load them all on 1 page but trying
05:06 🔗 BlueMax thanks S[h]O[r]T
05:18 🔗 godane http://www.youtube.com/watch?feature=player_embedded&v=c5S0v_lrGlg
05:21 🔗 S[h]O[r]T geeze none of the smugmug album fetchers really work cause i guess thats a subdomain with like a pro account
05:21 🔗 BlueMax so I'm boned, S[h]O[r]T?
05:24 🔗 S[h]O[r]T no
05:25 🔗 ersi You wish you're boned
05:25 🔗 ersi zingggg
05:32 🔗 S[h]O[r]T im working on something
05:44 🔗 S[h]O[r]T hmm
05:45 🔗 S[h]O[r]T missing some photos in my list wonder why
05:49 🔗 S[h]O[r]T well these are my ideas that im trying and should work
05:49 🔗 S[h]O[r]T download each page and then grep out the ids
05:49 🔗 S[h]O[r]T all you really need to do is get the ids and then you can easily put those into the url to download
05:50 🔗 BlueMax yeah
05:50 🔗 S[h]O[r]T http://www.privatepaste.com/902bf8050a are urls 1-35
05:50 🔗 S[h]O[r]T i downloaded all of them but only came back with like 300 ids
05:50 🔗 S[h]O[r]T vs the 800 or so pictures
05:51 🔗 BlueMax that's weird, why would that happen
05:51 🔗 BlueMax also I don't know how to use grep
05:56 🔗 S[h]O[r]T wget seems to fail and retry on some of the urls, it may be downloading too fast im slowing it down
05:56 🔗 S[h]O[r]T so right now im doing a wget -i -w 20 urls.txt
05:56 🔗 godane found a video from game developers forum hungary in my g4tv dumps
05:56 🔗 S[h]O[r]T and then ill do grep -o "/0/Ti/i-........" /whatever/dir/29234839_FpFXpf*
05:56 🔗 S[h]O[r]T the . is just shitty regex
05:57 🔗 S[h]O[r]T for any character
05:57 🔗 godane its about the crysis nanosuit
05:57 🔗 S[h]O[r]T and then i can just do a simple find and replace on the ugly output to get the ids
05:57 🔗 S[h]O[r]T if this works out ill give you the final urls :) just figuring maybe u want to know wtf im doing
05:57 🔗 BlueMax awesome
06:06 🔗 S[h]O[r]T ok actually i think it was just because even if you specify 25 pictures per page it does it by your screen resolution and with wget its actually less pictures per page. its 10 instead of 25
06:16 🔗 BlueMax interesting
06:16 🔗 BlueMax sorry if I'm slow to reply
06:17 🔗 * omf_ shoots BlueMax with time dilation ray gun again.
06:17 🔗 BlueMax aaaaaaaaaaaagggggggggggaaaaaaaaaaaaaaaaiiiiiiiiiiiiiiiinnnnnnnnnnnnn?
06:18 🔗 instence oh my
06:18 🔗 S[h]O[r]T well i lied
06:18 🔗 S[h]O[r]T its the ajax
06:20 🔗 BlueMax ajax is the name of laundry detergent here :P
06:26 🔗 S[h]O[r]T ok
06:33 🔗 S[h]O[r]T BlueMax, http://www.privatepaste.com/67d075c9e3
06:34 🔗 BlueMax wow how many lines is that
06:34 🔗 S[h]O[r]T 856 all of the photos
06:35 🔗 S[h]O[r]T if you dont want the originals just do a find and replace on /0/O/ with /0/X3/ or X2, XL, L, M, or S
06:35 🔗 S[h]O[r]T i got help from a friend :P
06:36 🔗 S[h]O[r]T wget -o - -O - --post-data 'tool=ajaxGallery&convertPosition=NaN&getNewPage=false&pageOn=1&pageType=Album&AlbumID=29234839&AlbumKey=FpFXpf&ImageID=2511007622&siteUser=WeddingPortraitGallerie&pageScope=&community=&pageDrawBy=&pageTypeDetails=&galleryStyle=smugmug&photosPerPage=1000&photoSizes=all&thumbSize=Original&mainPhotoSize=Original&lightboxSize=Original' http://weddingportraitgal
06:36 🔗 S[h]O[r]T lerie.smugmug.com/rpc/gallery.mg | grep -o "/0/Ti/i-........"
06:36 🔗 BlueMax dude that is awesome, thanks a lot
06:37 🔗 S[h]O[r]T yup, i like challenges like that despite me having to get help too :P
06:38 🔗 BlueMax I could give you a REAL challenge but you'd probably never pull it off
06:38 🔗 BlueMax that's me being honest I actually asked chronomex about the same thing and he couldn't find anything about it
06:40 🔗 omf_ BlueMax, lets hear your real challenge
06:40 🔗 BlueMax One minute
06:41 🔗 BlueMax Let me see if I have the file still on Mediafire
06:41 🔗 BlueMax Yes, I do
06:41 🔗 BlueMax http://www.mediafire.com/download/cr681ih63gf249r/EDF2.DAT
06:41 🔗 S[h]O[r]T $20 for a 8x10 print is wtf. $18k to get each one of those
06:41 🔗 BlueMax Tell me what type of file that is and what's inside it
06:41 🔗 BlueMax S[h]O[r]T, that's what I said :P
06:41 🔗 BlueMax $21 for a picture of a shoe
06:42 🔗 S[h]O[r]T its still ridiculous. even if you pick out say 50 or 100 for an album
06:43 🔗 S[h]O[r]T if i dont figure out that file in like 5min im going to bed lol, already up too late
06:43 🔗 S[h]O[r]T whats the backstory on it
06:43 🔗 Sue i know i'm a week late but did anyone contact the omploader guy?
06:43 🔗 S[h]O[r]T its from some game
06:45 🔗 ivan` Sue: are you referring the Reader grab?
06:45 🔗 ivan` Sue: I've contacted syndic8, opmlmanager, rss2lj, no response
06:46 🔗 ivan` oh heh I thought you typo'd that
06:46 🔗 ivan` apparently omploader is a thing
06:46 🔗 S[h]O[r]T i want to know what the deal is with that pricing.
06:46 🔗 Sue ivan`: yeah, it is/was a file upload site
06:47 🔗 godane so i got the this is living ps3 ad
06:47 🔗 godane looks like every one was on LSD
06:47 🔗 Sue i know the admin through another guy on another network
06:47 🔗 BlueMax sorry S[h]O[r]T
06:47 🔗 BlueMax yes it's from a PSP game
06:47 🔗 Sue if the files are still there i want to yank them
06:48 🔗 BlueMax I wanted to know what was inside it because of a rumor I have
06:51 🔗 S[h]O[r]T surely someone has a way to open it by now?
06:52 🔗 BlueMax nnope
06:53 🔗 BlueMax there was one post on the internet about this file and it got to the exact point I did
06:55 🔗 BlueMax if you want more backstory I can give it to you
07:02 🔗 S[h]O[r]T what game is it from, a newer one?
07:02 🔗 godane so i finding comic con 2007 clips
07:02 🔗 godane :-D
07:11 🔗 BlueMax S[h]O[r]T, it's quite old
07:11 🔗 BlueMax actually it's newer than I thought
07:11 🔗 BlueMax came out in August 2011
07:11 🔗 BlueMax *April
07:13 🔗 BlueMax it's from Earth Defense Forces 2 Portable, a Japanese game
07:33 🔗 omf_ You have a problem, your data is in latin1 so you think: "I'll convert to UTF8!" Now you have � problems.
07:34 🔗 SmileyG :D
07:38 🔗 omf_ Yeah that is another problem we can lay at Microsofts feet.
07:39 🔗 omf_ Unicode was invented in 1987 and when did windows first start really supporting unicode...
07:39 🔗 omf_ from my memory it was somewhere in XP
07:41 🔗 omf_ 26 years later and we still have to put up with non-unicode data
07:42 🔗 BlueMax lol
07:42 🔗 omf_ then again people still use PHP
07:43 🔗 ersi Hmmm, havn't seen wget just hang before
07:43 🔗 omf_ you are full of good luck then ersi :)
07:44 🔗 ersi Well, I'm not too hard on the use - but just doing a small grab with minimal parameter.. I've seen wget eat up a machines memory in plenty of cases
07:44 🔗 ersi but not doing anything at all? nope, never seen. it's in S state and the CPU TIME isn't flinching
07:45 🔗 ersi It's only using 21M RES
07:45 🔗 Coderjoe win2k supports unicode just fine
07:46 🔗 Coderjoe it is when you have programs that don't use the unicode apis that things get hairy
07:58 🔗 Coderjoe mmm
07:59 🔗 Coderjoe in that dat file, I am seeing a compression algorthm. I haven't worked it all out yet, but I see something that looks like a bitflag byte followed by the data it flags. a 1 bit means copy a character, a 0 means decompress somehow. not sure which bit to start at, however
07:59 🔗 Coderjoe possibly a simple form of an LZ77 algo
08:09 🔗 Coderjoe bah. I need to go to bed
08:20 🔗 norbert79 Morning
08:20 🔗 norbert79 Anyone following the news on the found backup of the first webpage from the 1991 conference?
08:20 🔗 norbert79 looks like they might have found a backup encrypted
08:42 🔗 BlueMax S[h]O[r]T, for when you wake up, thanks again you're awesome
09:11 🔗 ersi http://i.imgur.com/9wSoPUs.jpg
10:01 🔗 omf_ ersi++
10:24 🔗 SmileyG ttp://i.imgur.com/F1vgPlt.jpg
10:24 🔗 SmileyG http://i.imgur.com/F1vgPlt.jpg
10:24 🔗 SmileyG even
11:04 🔗 omf_ Somewhat in the vein of a conversation we had earlier. What is an example of excellent documentation for a JSON api?
11:04 🔗 omf_ I just read an interesting piece on it and wanted to see what others think. http://theon.github.io/documenting-the-json-schema-of-your-rest-apis.html
16:10 🔗 omf_ Beuller?
16:15 🔗 * antomatic examines the dog, then says: "Beasley!"
18:18 🔗 Smiley \o\ nick is back
18:30 🔗 Smiley anopther one to have on the list, might be instagram :/
18:46 🔗 SketchCow WOO HOOOOOO
18:56 🔗 Smiley GLaDOS: wtf is this challenge pap you send me?
19:07 🔗 Coderjoe Smiley: in response to your last imgur: http://www.youtube.com/watch?v=7ItF0CcJBN4
20:07 🔗 sep332 hey guys, don't you want to learn how to SaaSify your apps in the cloud?
20:07 🔗 sep332 https://event.on24.com/eventRegistration/EventLobbyServlet?target=registration.jsp&eventid=621851&sessionid=1&key=249DF126ECFCEF9F1CEF7F9CBA869DA5&sourcepage=register
20:07 🔗 sep332 for infinite market reach and performance! haha
20:23 🔗 joepie91 sep332: I'm afraid I don't have enough XP in my buzzword skill to attend that as of yet...
20:23 🔗 joepie91 Buzzword skill *
20:26 🔗 sep332 you could win buzzword bingo before they finish saying the name of the seminar!
20:30 🔗 Coderjoe hmm
20:31 🔗 Coderjoe it appears National Geographic has at least one tumblr (until Yahoo kills it)
20:31 🔗 Coderjoe http://natgeofound.tumblr.com/post/51566044813/women-use-compact-mirrors-in-packed-crowd-to-catch
22:47 🔗 godane homemade lightsaber: http://www.youtube.com/watch?feature=player_embedded&v=96E0RfyL2Gc
23:24 🔗 GLaDOS Smiley: derp, screwed your autoop config up
23:25 🔗 Smiley DERRRP

irclogger-viewer