[00:02] *** Honno has quit IRC (Read error: Operation timed out) [00:05] but yeah, thanks for help, vantec :) [00:05] *** aschmitz has joined #archiveteam [00:07] *** Vix has quit IRC (Quit: Page closed) [00:08] Good luck, but pretty sure they purged 99% of the VOD storage they had. [00:31] *** kristian_ has quit IRC (Quit: Leaving) [00:37] *** Zialus has quit IRC (Ping timeout: 633 seconds) [00:46] *** ravetcofx has quit IRC (Read error: Operation timed out) [00:56] *** Start has joined #archiveteam [01:04] *** Somebody1 has joined #archiveteam [01:07] *** ravetcofx has joined #archiveteam [01:19] godane, SketchCow: nlmpubs.nlm.nih.gov/nlmdata/pir/dc.zip is now heading up to FOS, in a obviously named subdirectory of /0/CDROMS [01:32] *** pizzaiolo has joined #archiveteam [01:56] What is it [01:56] Describe it please, in a dc.zip.txt [01:56] SketchCow: certainly, coming right up [01:56] dr.zip (which is much smaller, only 800MB) is now also on FOS. [02:03] OK, dc.zip.txt up on FOS. It describes both dc.zip and dr.zip [02:33] *** jrwr has joined #archiveteam [03:06] *** krazedkat has quit IRC (Quit: Leaving) [03:11] *** dashcloud has quit IRC (Read error: Operation timed out) [03:15] *** dashcloud has joined #archiveteam [03:17] *** superkuh has quit IRC (Read error: Operation timed out) [03:20] *** superkuh has joined #archiveteam [04:21] *** godane has quit IRC (Ping timeout: 244 seconds) [04:44] *** dashcloud has quit IRC (Read error: Operation timed out) [04:47] *** pizzaiolo has quit IRC (Remote host closed the connection) [04:48] *** dashcloud has joined #archiveteam [04:56] *** godane has joined #archiveteam [05:22] *** maelstrom has quit IRC (Quit: Leaving) [05:32] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:39] *** Sk1d has joined #archiveteam [05:45] *** Start has quit IRC (Read error: Connection reset by peer) [05:47] *** Start has joined #archiveteam [06:56] *** Somebody1 has quit IRC (Ping timeout: 370 seconds) [07:22] is anyone aware of any efforts to archive pixiv? [07:57] *** Aft3r has joined #archiveteam [08:17] *** fie has quit IRC (Ping timeout: 506 seconds) [08:33] *** TC02 has quit IRC (Read error: Operation timed out) [08:33] *** TC02 has joined #archiveteam [08:46] *** DiscantX has joined #archiveteam [09:05] ploop: None, that I am aware of. Can you give more details? Is it shutting down? When? [09:20] *** Aft3r has quit IRC (Ping timeout: 268 seconds) [09:23] *** atomotic has joined #archiveteam [09:41] *** ravetcofx has quit IRC (Read error: Operation timed out) [09:45] *** jrwr has quit IRC (Remote host closed the connection) [09:47] *** dashcloud has quit IRC (Ping timeout: 250 seconds) [09:50] *** dashcloud has joined #archiveteam [09:52] *** ravetcofx has joined #archiveteam [09:53] *** Honno has joined #archiveteam [10:08] *** krazedkat has joined #archiveteam [10:08] *** Honno has quit IRC (Read error: Operation timed out) [10:29] hm forums.nin.com died yesterday or thereabouts; I wonder if it was spidered [10:58] *** icedice has joined #archiveteam [10:59] Hi guys, is there any way to archive a Facebook profile that is behind a login with ArchiveBot? [11:02] A local politician said that an a language minority group of 291 000+ people were uncivilized due to the actions of 200 people and it's blowing up in her face big time [11:03] I want to archive this shitstorm in case she tries to delete it and pretend like nothing happened [11:03] Here's the politician's Facebook page: https://www.facebook.com/susanna.koski.10 [11:07] *** i336_ has quit IRC (Read error: Operation timed out) [11:08] *** ravetcofx has quit IRC (Read error: Operation timed out) [11:10] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:18] *** vOYtEC has joined #archiveteam [11:21] *** BlueMaxim has quit IRC (Read error: Operation timed out) [11:38] *** dashcloud has quit IRC (Read error: Operation timed out) [11:41] *** dashcloud has joined #archiveteam [11:55] *** atomotic has joined #archiveteam [12:01] *** DiscantX has quit IRC (Ping timeout: 244 seconds) [12:26] *** icedice2 has joined #archiveteam [12:29] *** icedice has quit IRC (Ping timeout: 245 seconds) [12:41] theeuropeanlibrary.org will be shut down in 2017 http://www.cenl.org/wp-content/uploads/20161213-TEL-closure-press-release-final.pdf [13:02] *** zenguy has quit IRC (Ping timeout: 370 seconds) [13:18] *** icedice2 has quit IRC (Ping timeout: 633 seconds) [13:23] *** dashcloud has quit IRC (Read error: Operation timed out) [13:27] *** dashcloud has joined #archiveteam [14:40] anyone looking into this Dropbox public folder fiasco? [15:07] *** sep332 has joined #archiveteam [15:08] *** kniffy has quit IRC (Ping timeout: 240 seconds) [15:11] *** kniffy has joined #archiveteam [15:14] *** robink has quit IRC (Read error: Connection reset by peer) [15:18] *** robink has joined #archiveteam [15:21] *** khaoohs has quit IRC (Read error: Connection reset by peer) [15:25] (https://news.ycombinator.com/item?id=13188848 ) [15:29] *** VADemon has quit IRC (Read error: Connection reset by peer) [15:30] *** VADemon has joined #archiveteam [15:34] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:55] *** REiN^ has quit IRC (Max SendQ exceeded) [15:56] *** REiN^ has joined #archiveteam [16:30] *** robink has quit IRC (Quit: No Ping reply in 210 seconds.) [16:37] *** robink has joined #archiveteam [16:47] *** VADemon has quit IRC (Read error: Connection reset by peer) [16:48] *** Somebody1 has joined #archiveteam [16:57] Medowar: I don't think it's in any danger, but a local copy would be fun :] [16:58] I think they're fairly hostile to even small amounts of scraping though [16:58] icedice: Archivebot can't do it, but archive.is will save Facebook pages logged-in as a user [16:58] iirc you need not only a login cookie but also a "valid" referer to even look at an image [17:02] *** Somebody1 has quit IRC (Ping timeout: 370 seconds) [17:26] Really? I've always noticed the opposite, i.e. how surprisingly public the deep URLs to Facebook media are [17:28] Nemo_bis: I was talking about pixiv [17:30] Ah sorry, I mixed up with icedice's comment [17:36] *** nicu has joined #archiveteam [17:37] hi [17:55] *** gibigian1 has joined #archiveteam [17:55] *** PepsiMax has quit IRC (hub.se hub.dk) [17:55] *** kanzure_ has quit IRC (hub.se hub.dk) [17:55] *** SketchCow has quit IRC (hub.se hub.dk) [17:55] *** dx has quit IRC (hub.se hub.dk) [17:55] *** cadbury_ has quit IRC (hub.se hub.dk) [17:55] *** edsu has quit IRC (hub.se hub.dk) [17:55] *** Smiley has quit IRC (hub.se hub.dk) [17:55] *** db48x has quit IRC (hub.se hub.dk) [17:55] *** aschmitz has quit IRC (hub.se hub.dk) [17:55] *** tpw_rules has quit IRC (hub.se hub.dk) [17:55] *** superkuh has quit IRC (hub.se hub.dk) [17:55] *** compu has quit IRC (hub.se hub.dk) [17:55] *** Whopper has quit IRC (hub.se hub.dk) [17:55] *** oli has quit IRC (hub.se hub.dk) [17:55] *** HCross has quit IRC (hub.se hub.dk) [17:55] *** zino has quit IRC (hub.se hub.dk) [17:55] *** swebb has quit IRC (hub.se hub.dk) [17:55] *** bsmith093 has quit IRC (hub.se hub.dk) [17:55] *** antomatic has quit IRC (hub.se hub.dk) [17:55] *** MrRadar has quit IRC (hub.se hub.dk) [17:55] *** dserodio has quit IRC (hub.se hub.dk) [17:55] *** Cameron_D has quit IRC (hub.se hub.dk) [17:55] *** atlogbot has quit IRC (hub.se hub.dk) [17:55] *** Frogging has quit IRC (hub.se hub.dk) [17:55] *** SadDM has quit IRC (hub.se hub.dk) [17:55] *** jspiros has quit IRC (hub.se hub.dk) [17:55] *** yakfish has quit IRC (hub.se hub.dk) [17:55] *** remsen has quit IRC (hub.se hub.dk) [17:55] *** ranma has quit IRC (hub.se hub.dk) [17:55] *** rduser has quit IRC (hub.se hub.dk) [17:55] *** trs80 has quit IRC (hub.se hub.dk) [17:55] *** robink has quit IRC (hub.se hub.dk) [17:55] *** sep332 has quit IRC (hub.se hub.dk) [17:55] *** Start has quit IRC (hub.se hub.dk) [17:55] *** Stiletto has quit IRC (hub.se hub.dk) [17:55] *** Famicoma1 has quit IRC (hub.se hub.dk) [17:55] *** K4k has quit IRC (hub.se hub.dk) [17:55] *** patricko- has quit IRC (hub.se hub.dk) [17:55] *** Morbus has quit IRC (hub.se hub.dk) [17:55] *** luckcolor has quit IRC (hub.se hub.dk) [17:55] *** no2pencil has quit IRC (hub.se hub.dk) [17:55] *** Jogie has quit IRC (hub.se hub.dk) [17:55] *** computerf has quit IRC (hub.se hub.dk) [17:55] *** macker has quit IRC (hub.se hub.dk) [17:55] *** Darkstar has quit IRC (hub.se hub.dk) [17:55] *** randomdes has quit IRC (hub.se hub.dk) [17:55] *** Jordan has quit IRC (hub.se hub.dk) [17:55] *** tapedrive has quit IRC (hub.se hub.dk) [17:55] *** saper has quit IRC (hub.se hub.dk) [17:55] *** REiN^ has quit IRC (hub.se hub.dk) [17:55] *** TC02 has quit IRC (hub.se hub.dk) [17:55] *** godane has quit IRC (hub.se hub.dk) [17:55] *** wp494 has quit IRC (hub.se hub.dk) [17:55] *** nwf has quit IRC (hub.se hub.dk) [17:55] *** lukeman_ has quit IRC (hub.se hub.dk) [17:55] *** MMovie has quit IRC (hub.se hub.dk) [17:55] *** Mayonaise has quit IRC (hub.se hub.dk) [17:55] *** will has quit IRC (hub.se hub.dk) [17:55] *** edadx0 has quit IRC (hub.se hub.dk) [17:55] *** squires has quit IRC (hub.se hub.dk) [17:55] *** marvinw_ has quit IRC (hub.se hub.dk) [17:55] *** joepie91 has quit IRC (hub.se hub.dk) [17:55] *** kremlin has quit IRC (hub.se hub.dk) [17:55] *** tfgbd_znc has quit IRC (hub.se hub.dk) [17:55] *** phuzion has quit IRC (hub.se hub.dk) [17:55] *** Petri152 has quit IRC (hub.se hub.dk) [17:55] *** Baljem_ has quit IRC (hub.se hub.dk) [17:55] *** w0rp has quit IRC (hub.se hub.dk) [17:55] *** whydomain has quit IRC (hub.se hub.dk) [17:55] *** mhazinsk has quit IRC (hub.se hub.dk) [17:55] *** eprillios has quit IRC (hub.se hub.dk) [17:55] *** acridAxid has quit IRC (hub.se hub.dk) [17:55] *** dxrt has quit IRC (hub.se hub.dk) [17:55] *** Midas has quit IRC (hub.se hub.dk) [17:55] *** arkiver has quit IRC (hub.se hub.dk) [17:55] *** SirCmpwn has quit IRC (hub.se hub.dk) [17:55] *** Gfy has quit IRC (hub.se hub.dk) [17:55] *** Selavi has quit IRC (hub.se hub.dk) [17:55] *** aMunster has quit IRC (hub.se hub.dk) [17:55] *** Ymgve has quit IRC (hub.se hub.dk) [17:55] *** alfie has quit IRC (hub.se hub.dk) [17:55] *** kcaj has quit IRC (hub.se hub.dk) [17:55] *** PurpleSym has quit IRC (hub.se hub.dk) [17:55] *** Meeh has quit IRC (hub.se hub.dk) [17:55] *** toddf has quit IRC (hub.se hub.dk) [17:55] *** altlabel has quit IRC (hub.se hub.dk) [17:55] *** PotcFdk has quit IRC (hub.se hub.dk) [17:55] *** dashcloud has quit IRC (hub.se hub.dk) [17:55] *** vOYtEC has quit IRC (hub.se hub.dk) [17:55] *** RichardG has quit IRC (hub.se hub.dk) [17:55] *** Fletcher has quit IRC (hub.se hub.dk) [17:55] *** brayden has quit IRC (hub.se hub.dk) [17:55] *** Feld0 has quit IRC (hub.se hub.dk) [17:55] *** Lord_Nigh has quit IRC (hub.se hub.dk) [17:55] *** glass3 has quit IRC (hub.se hub.dk) [17:55] *** C4K3_ has quit IRC (hub.se hub.dk) [17:55] *** yipdw has quit IRC (hub.se hub.dk) [17:55] *** w0pr has quit IRC (hub.se hub.dk) [17:55] *** pikhq has quit IRC (hub.se hub.dk) [17:55] *** ploop has quit IRC (hub.se hub.dk) [17:55] *** gibigiana has quit IRC (hub.se hub.dk) [17:55] *** sivoais has quit IRC (hub.se hub.dk) [17:55] *** chazchaz has quit IRC (hub.se hub.dk) [17:55] *** Jonimus has quit IRC (hub.se hub.dk) [17:55] *** dcmorton has quit IRC (hub.se hub.dk) [17:55] *** xmc has quit IRC (hub.se hub.dk) [17:55] *** alterego has quit IRC (hub.se hub.dk) [17:55] *** chfoo has quit IRC (hub.se hub.dk) [17:56] *** C4K3 has joined #archiveteam [18:00] *** VADemon has joined #archiveteam [18:18] *** Lord_Nigh has joined #archiveteam [18:18] *** xmc has joined #archiveteam [18:18] *** vOYtEC has joined #archiveteam [18:18] *** brayden has joined #archiveteam [18:18] *** yipdw has joined #archiveteam [18:18] *** glass3 has joined #archiveteam [18:18] *** RichardG has joined #archiveteam [18:18] *** zenguy has joined #archiveteam [18:18] *** robink has joined #archiveteam [18:18] *** REiN^ has joined #archiveteam [18:18] *** sep332 has joined #archiveteam [18:18] *** dashcloud has joined #archiveteam [18:18] *** TC02 has joined #archiveteam [18:18] *** Start has joined #archiveteam [18:18] *** godane has joined #archiveteam [18:18] *** superkuh has joined #archiveteam [18:18] *** aschmitz has joined #archiveteam [18:18] *** Stiletto has joined #archiveteam [18:18] *** wp494 has joined #archiveteam [18:18] *** Smiley has joined #archiveteam [18:18] *** Famicoma1 has joined #archiveteam [18:18] *** PepsiMax has joined #archiveteam [18:18] *** tpw_rules has joined #archiveteam [18:18] *** nwf has joined #archiveteam [18:18] *** Fletcher has joined #archiveteam [18:18] *** db48x has joined #archiveteam [18:18] *** K4k has joined #archiveteam [18:18] *** patricko- has joined #archiveteam [18:18] *** kanzure_ has joined #archiveteam [18:18] *** Frogging has joined #archiveteam [18:18] *** lukeman_ has joined #archiveteam [18:18] *** compu has joined #archiveteam [18:18] *** MMovie has joined #archiveteam [18:18] *** Feld0 has joined #archiveteam [18:18] *** Morbus has joined #archiveteam [18:18] *** saper has joined #archiveteam [18:18] *** edadx0 has joined #archiveteam [18:18] *** Whopper has joined #archiveteam [18:18] *** luckcolor has joined #archiveteam [18:18] *** oli has joined #archiveteam [18:18] *** w0pr has joined #archiveteam [18:18] *** HCross has joined #archiveteam [18:18] *** SadDM has joined #archiveteam [18:18] *** jspiros has joined #archiveteam [18:18] *** zino has joined #archiveteam [18:18] *** swebb has joined #archiveteam [18:18] *** hub.dk sets mode: +oooo xmc brayden SadDM swebb [18:18] *** Mayonaise has joined #archiveteam [18:18] *** SketchCow has joined #archiveteam [18:18] *** bsmith093 has joined #archiveteam [18:18] *** pikhq has joined #archiveteam [18:18] *** Ymgve has joined #archiveteam [18:18] *** ploop has joined #archiveteam [18:18] *** will has joined #archiveteam [18:18] *** alfie has joined #archiveteam [18:18] *** antomatic has joined #archiveteam [18:18] *** edsu has joined #archiveteam [18:18] *** cadbury_ has joined #archiveteam [18:18] *** dx has joined #archiveteam [18:18] *** aMunster has joined #archiveteam [18:18] *** Selavi has joined #archiveteam [18:18] *** Gfy has joined #archiveteam [18:18] *** SirCmpwn has joined #archiveteam [18:18] *** arkiver has joined #archiveteam [18:18] *** Midas has joined #archiveteam [18:18] *** dxrt has joined #archiveteam [18:18] *** trs80 has joined #archiveteam [18:18] *** acridAxid has joined #archiveteam [18:18] *** eprillios has joined #archiveteam [18:18] *** mhazinsk has joined #archiveteam [18:18] *** whydomain has joined #archiveteam [18:18] *** Jordan has joined #archiveteam [18:18] *** tapedrive has joined #archiveteam [18:18] *** randomdes has joined #archiveteam [18:18] *** Darkstar has joined #archiveteam [18:18] *** w0rp has joined #archiveteam [18:18] *** macker has joined #archiveteam [18:18] *** computerf has joined #archiveteam [18:18] *** Jogie has joined #archiveteam [18:18] *** Baljem_ has joined #archiveteam [18:18] *** Petri152 has joined #archiveteam [18:18] *** no2pencil has joined #archiveteam [18:18] *** phuzion has joined #archiveteam [18:18] *** tfgbd_znc has joined #archiveteam [18:18] *** kremlin has joined #archiveteam [18:18] *** joepie91 has joined #archiveteam [18:18] *** marvinw_ has joined #archiveteam [18:18] *** rduser has joined #archiveteam [18:18] *** ranma has joined #archiveteam [18:18] *** remsen has joined #archiveteam [18:18] *** squires has joined #archiveteam [18:18] *** yakfish has joined #archiveteam [18:18] *** atlogbot has joined #archiveteam [18:18] *** hub.dk sets mode: +ooo SketchCow arkiver Midas [18:18] *** Cameron_D has joined #archiveteam [18:18] *** dserodio has joined #archiveteam [18:18] *** MrRadar has joined #archiveteam [18:18] *** sivoais has joined #archiveteam [18:18] *** chazchaz has joined #archiveteam [18:18] *** Jonimus has joined #archiveteam [18:18] *** kcaj has joined #archiveteam [18:18] *** dcmorton has joined #archiveteam [18:18] *** alterego has joined #archiveteam [18:18] *** PurpleSym has joined #archiveteam [18:18] *** Meeh has joined #archiveteam [18:18] *** chfoo has joined #archiveteam [18:18] *** toddf has joined #archiveteam [18:18] *** altlabel has joined #archiveteam [18:18] *** PotcFdk has joined #archiveteam [18:18] *** hub.dk sets mode: +oo chfoo altlabel [18:18] *** swebb sets mode: +o balrog [18:18] *** swebb sets mode: +o midas1 [18:33] *** nicu has quit IRC (Quit: Leaving) [18:59] *** RichardG has quit IRC (Read error: Operation timed out) [19:16] *** nwf_ has joined #archiveteam [19:23] *** powerKitt has joined #archiveteam [19:24] *** nwf has quit IRC (Read error: Operation timed out) [19:35] Hey, does anyone know where I'd find a mirror of ftp.nvidia.com? I tried archive.org but they don't have what I was after preserved. [19:35] I checked ftp://download.nvidia.com/, it didn't have what I was looking for either. [19:39] *** ravetcofx has joined #archiveteam [19:43] *** fie has joined #archiveteam [19:46] *** powerKitt has quit IRC (Quit: Page closed) [19:52] *** za3k has joined #archiveteam [19:59] Hey ya'll. In addition to being part of archive team, I also work at Dropbox, which is ending support for Public folders. I looked into any support we can offer in archiving, but I didn't come up with anything helpful. Sorry! [19:59] well, thanks for the confirmation, i guess [20:00] (I've missed any discussion) [20:03] Is there a current archiving plan? I might be able to suggest something a little more targeted once I know what the blocking factor is [20:03] i think the archiving plan is "we're fucked" [20:03] (e.g. link enumeration, bandwidth, etc) [20:03] because the first part of archiving is finding a ton of url seeds [20:03] Yeah, that's the bit I definitely can't help with, sorry [20:03] link enumeration is usually the first bottleneck [20:04] If it becomes bandwidth, get in touch and I'll bug people more [20:04] the second bottleneck is then normally service-side ratelimits, or storage [20:04] xmc: by that you mean we can't actually find the URLs to archive? [20:04] correct [20:04] that is my understanding [20:04] yeah, thought so [20:05] Yeah, unfortunately since not all public folder content is actually linked out we consider it private info [20:05] public folders are private info, got it [20:05] (Oh also: private opinion, not the opinion of Dropbox as a company, etc etc) [20:05] Yup sorry [20:12] *** za3k has quit IRC (Ping timeout: 268 seconds) [20:19] *** ravetcofx has quit IRC (Read error: Operation timed out) [20:28] *** ravetcofx has joined #archiveteam [20:31] *** maelstrom has joined #archiveteam [20:32] *** jrwr has joined #archiveteam [20:47] *** pizzaiolo has joined #archiveteam [20:53] *** hive-mind has quit IRC (Remote host closed the connection) [20:54] *** hive-mind has joined #archiveteam [20:54] *** za3k has joined #archiveteam [20:54] *** za3k has quit IRC (Client Quit) [21:18] *** C4K3 has quit IRC (Ping timeout: 250 seconds) [21:19] *** RichardG has joined #archiveteam [21:24] *** C4K3 has joined #archiveteam [22:03] *** kristian_ has joined #archiveteam [22:05] *** Zialus has joined #archiveteam [22:10] *** Zialus has quit IRC (Read error: Operation timed out) [22:12] *** Zialus has joined #archiveteam [22:15] *** DiscantX has joined #archiveteam [22:29] *** Smiley has quit IRC (Read error: Connection reset by peer) [22:31] *** ndiddy has joined #archiveteam [22:42] *** Smiley has joined #archiveteam [22:51] *** DiscantX has quit IRC (Read error: Operation timed out) [23:06] *** pizzaiolo has quit IRC (Ping timeout: 245 seconds) [23:11] *** dashcloud has quit IRC (Read error: Operation timed out) [23:14] *** dashcloud has joined #archiveteam [23:17] *** edadx0 has quit IRC (Read error: Operation timed out) [23:42] *** BlueMaxim has joined #archiveteam [23:46] *** WinterFox has joined #archiveteam [23:59] *** Somebody1 has joined #archiveteam