[00:29] *** mistym has joined #archiveteam [01:09] *** Coderjoe has quit IRC (Read error: Connection reset by peer) [01:25] *** schbirid2 has joined #archiveteam [01:25] *** primus104 has quit IRC (Leaving.) [01:27] *** schbirid has quit IRC (Read error: Operation timed out) [01:41] *** xk_id has quit IRC (Remote host closed the connection) [01:45] *** Coderjoe has joined #archiveteam [02:31] *** dashcloud has quit IRC (Read error: Connection reset by peer) [02:33] *** dashcloud has joined #archiveteam [02:38] *** pokeball9 has joined #archiveteam [02:39] idk how i found this....but,LOFL http://archiveteam.org/index.php?title=User:Jscott/Sorry_That_I_am_All_Up_In_Your_Shit [02:47] *** Coderjoe has quit IRC (Read error: Connection reset by peer) [02:53] *** koo5 has quit IRC (Ping timeout: 512 seconds) [02:53] *** Coderjoe has joined #archiveteam [03:17] *** JesseW has quit IRC (Quit: Leaving.) [03:26] *** maz_ has joined #archiveteam [03:27] *** pokeball9 has quit IRC (Quit: Page closed) [03:28] can anyone help me get this source code? http://svn.projectpokemon.org/ppse/ [03:29] it's 404ed there and archive.org is missing quite a few files [03:30] BTW, PPSE-DS is not the same thing [03:30] PPSE-DS is a NDS program, this is a QT program for PC's [03:45] someone in #n64dev might have it [03:45] never know [04:08] *** aaaaaaaaa has quit IRC (Leaving) [04:13] *** JesseW has joined #archiveteam [04:14] *** Infreq has quit IRC (Read error: Operation timed out) [04:17] *** Infreq has joined #archiveteam [04:40] *** Ungstein1 has joined #archiveteam [04:41] *** Ungstein has quit IRC (Ping timeout: 265 seconds) [04:52] *** mistym has quit IRC (Remote host closed the connection) [05:00] *** bzc6p_ has joined #archiveteam [05:00] *** swebb sets mode: +o bzc6p_ [05:00] *** Organized has joined #archiveteam [05:00] *** Aranje has quit IRC (Read error: Connection reset by peer) [05:01] *** Aranje has joined #archiveteam [05:03] *** bzc6p has quit IRC (Read error: Operation timed out) [05:07] *** Organized has quit IRC () [05:13] *** Ungstein1 is now known as Ungstein [05:16] *** Ungstein has quit IRC (Read error: Connection reset by peer) [05:20] *** Ungstein has joined #archiveteam [05:20] *** mistym has joined #archiveteam [05:21] *** ripvanwin has quit IRC (Read error: Operation timed out) [05:29] *** Ungstein1 has joined #archiveteam [05:29] *** Ungstein has quit IRC (Ping timeout: 265 seconds) [05:33] *** ripvanwin has joined #archiveteam [05:59] *** trill_ has joined #archiveteam [06:10] *** ripvanwin has quit IRC (Read error: Operation timed out) [06:18] *** ripvanwin has joined #archiveteam [06:59] *** landshark has quit IRC (Read error: Operation timed out) [07:07] *** landshark has joined #archiveteam [07:07] *** bzc6p_ is now known as bzc6p [07:12] *** mistym has quit IRC (Remote host closed the connection) [07:16] *** trill_ has quit IRC (Ping timeout: 240 seconds) [07:48] *** xk_id has joined #archiveteam [07:48] *** xk_id has quit IRC (Remote host closed the connection) [07:48] *** xk_id has joined #archiveteam [07:54] *** xk_id has quit IRC (Read error: Operation timed out) [07:56] *** JesseW has quit IRC (Quit: Leaving.) [08:02] *** xk_id has joined #archiveteam [08:04] *** bisko has joined #archiveteam [08:08] *** xk_id has quit IRC (Remote host closed the connection) [08:09] *** xk_id has joined #archiveteam [08:09] *** xk_id has quit IRC (Remote host closed the connection) [08:10] *** xk_id has joined #archiveteam [08:13] *** mistym has joined #archiveteam [08:22] *** mistym has quit IRC (Read error: Operation timed out) [08:29] *** landshark has quit IRC (Ping timeout: 512 seconds) [08:34] *** primus104 has joined #archiveteam [08:45] *** landshark has joined #archiveteam [08:54] *** arkiver sets mode: +o SketchCow [08:54] *** arkiver sets mode: +o chfoo [09:15] *** xk_id has quit IRC (Remote host closed the connection) [09:17] *** landshark has quit IRC (Ping timeout: 240 seconds) [10:13] *** Ungstein1 is now known as Ungstein [10:22] *** xk_id has joined #archiveteam [10:37] *** _bryan has quit IRC (Quit: WeeChat 1.0.1) [10:40] *** RichardG has quit IRC (Ping timeout: 252 seconds) [10:43] *** xk_id has quit IRC (Remote host closed the connection) [10:51] *** koo5 has joined #archiveteam [11:21] *** Boltsie has joined #archiveteam [11:27] *** RichardG has joined #archiveteam [11:28] *** dashcloud has quit IRC (Read error: Operation timed out) [11:29] *** xk_id has joined #archiveteam [11:41] *** dashcloud has joined #archiveteam [11:45] *** xk_id has quit IRC (Remote host closed the connection) [11:53] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [12:44] *** sankin has joined #archiveteam [13:13] *** xk_id has joined #archiveteam [13:14] *** dashcloud has quit IRC (Read error: Operation timed out) [13:17] *** dashcloud has joined #archiveteam [13:23] *** K4k has joined #archiveteam [13:27] *** koo5 has quit IRC (Quit: Ragequit) [13:28] *** koo5 has joined #archiveteam [13:43] *** scyther has joined #archiveteam [14:32] *** mistym has joined #archiveteam [14:39] *** bisko_ has joined #archiveteam [14:40] *** bisko has quit IRC (Read error: Operation timed out) [14:41] *** mistym has quit IRC (Remote host closed the connection) [14:43] *** bisko_ has quit IRC (Read error: Operation timed out) [14:44] *** primus104 has quit IRC (Leaving.) [14:58] *** wacky has joined #archiveteam [15:02] *** mistym has joined #archiveteam [15:02] *** VADemon has joined #archiveteam [15:12] *** goekesmi has quit IRC (Remote host closed the connection) [15:22] *** vitzli has joined #archiveteam [15:36] *** goekesmi has joined #archiveteam [15:45] *** bisko has joined #archiveteam [15:47] *** ohhdemgir has quit IRC (Read error: Operation timed out) [15:49] *** mistym has quit IRC (Remote host closed the connection) [15:49] *** ohhdemgir has joined #archiveteam [16:00] *** JesseW has joined #archiveteam [16:06] *** mistym has joined #archiveteam [16:08] Start:Continue at 300/minute [16:08] ok [16:08] Also, I see we're living it at xfire [16:17] *** JesseW has quit IRC (Quit: Leaving.) [16:19] *** Elegance has quit IRC (Ping timeout: 512 seconds) [16:30] Xfire uploading has begun, just to get it out there. [16:32] SketchCow: ok, for now all files will go to Kenshin [16:33] Would you like to have a part of xfire grab synced over to FOS? [16:33] Also, in case you didn't see it: http://prntscr.com/7jgluy [16:33] That was yesterday. [16:33] I did see that [16:34] Xfire must have noticed we are saving them. I hope they're keeping their service alive while we grab [16:34] ok [16:39] *** godane has quit IRC (Ping timeout: 493 seconds) [16:40] *** lytv has quit IRC (Read error: Operation timed out) [16:41] *** lytv has joined #archiveteam [16:46] *** Emcy_ has joined #archiveteam [16:46] https://archive.org/details/archiveteam_xfire_20150622041210 [16:46] *** Emcy has quit IRC (Ping timeout: 306 seconds) [16:47] Looks good! [16:47] I do have a question about the pomf collection. [16:47] Shouldn't the collection be webtype and in the archiveteam collection? https://archive.org/details/archiveteam_pomf [16:48] Not sure though if that's of any importance to have the warc files in the wayback machine [16:51] I [16:51] I'll check. [16:53] Pomf is now under archiveteam but the stuff should be in line to be integrated regardless. [16:54] *** primus104 has joined #archiveteam [16:58] Ok, thank you for checking [16:59] *** K4k has quit IRC (Quit: WeeChat 1.2) [17:02] *** K4k has joined #archiveteam [17:02] I'll check with our guys to see if stuff is making it in. [17:03] Awesome, so if we can start syncing some Xfire files from Kenshin over to FOS, please let me know. [17:03] *** K4k has quit IRC (Client Quit) [17:06] *** K4k has joined #archiveteam [17:12] *** RichardG_ has joined #archiveteam [17:14] *** RichardG has quit IRC (Ping timeout: 255 seconds) [17:14] *** nox2 has quit IRC () [17:16] *** godane has joined #archiveteam [17:20] *** aaaaaaaaa has joined #archiveteam [17:20] *** swebb sets mode: +o aaaaaaaaa [17:22] *** Emcy_ has quit IRC (Ping timeout: 512 seconds) [17:25] *** bzc6p_ has joined #archiveteam [17:25] *** swebb sets mode: +o bzc6p_ [17:28] *** bzc6p has quit IRC (Read error: Operation timed out) [17:30] *** Emcy has joined #archiveteam [17:30] *** RichardG_ has quit IRC (Read error: Connection reset by peer) [17:31] *** RichardG has joined #archiveteam [17:40] I just found telehack.com via SketchCows 2011 defcon talk [17:40] this might take a while [17:48] *** Aranje has quit IRC (Read error: Connection reset by peer) [17:49] *** Aranje has joined #archiveteam [17:52] It's a goodie [17:55] *** vitzli has quit IRC (Quit: Leaving) [18:14] *** K4k has quit IRC (Ping timeout: 370 seconds) [18:19] *** mistym has quit IRC (Remote host closed the connection) [18:19] *** mistym has joined #archiveteam [18:20] *** K4k has joined #archiveteam [18:22] *** bisko has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [18:41] *** bzc6p_ is now known as bzc6p [18:46] *** Aranje has quit IRC (Read error: Connection reset by peer) [18:46] *** Aranje has joined #archiveteam [18:52] *** Aranje has quit IRC (Read error: Connection reset by peer) [18:53] *** Aranje has joined #archiveteam [19:08] *** habi has joined #archiveteam [19:10] *** habi has left [19:10] *** aaaaaaaaa has quit IRC (Leaving) [19:11] *** Stiletto has quit IRC (Ping timeout: 252 seconds) [19:11] *** mistym has quit IRC (Remote host closed the connection) [19:17] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:18] *** Aranje has joined #archiveteam [19:20] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:21] *** Aranje has joined #archiveteam [19:25] *** RichardG has quit IRC (Remote host closed the connection) [19:29] *** RichardG has joined #archiveteam [19:38] libgen has gone down... https://torrentfreak.com/libgen-goes-down-as-legal-pressure-mounts-150622/ [19:40] wf [19:40] t [19:41] oh you [19:41] article says libgen.biz is online, offline now too [19:41] just the domain [19:41] Gen.lib.rus.ec is fine [19:41] yes [19:41] that's not entirely unpredictable [19:51] SketchCow: shall we do a project on bookfi.org? [19:54] *** Aranje has quit IRC (Read error: Connection reset by peer) [19:55] *** Aranje has joined #archiveteam [19:58] *** mistym has joined #archiveteam [20:10] *** Aranje has quit IRC (Read error: Connection reset by peer) [20:11] *** Aranje has joined #archiveteam [20:11] gitorious has finished copying over [20:11] i'm running fsck on the image to make sure everything is lined up properly [20:12] *** Aranje has quit IRC (Read error: Connection reset by peer) [20:12] *** Aranje has joined #archiveteam [20:13] Thank youuuuuu [20:13] Pros and cons to Bookfi.org. [20:13] What are all the big torrent sites now, by the way? [20:14] *** aaaaaaaaa has joined #archiveteam [20:14] *** swebb sets mode: +o aaaaaaaaa [20:14] I know it's what.cd for CDs, Pass the Popcorn for movies... Library Genesis and Bookfi for Books. [20:14] Any other obsessiely metadata'd sites? [20:15] *** VADemon_ has joined #archiveteam [20:15] iptorrents has a fair amount of content, although not 'specialised' in any way [20:15] broadcasthe.net for TV [20:15] it pulls most of it from tvdb though [20:15] *** VADemon has quit IRC (Ping timeout: 306 seconds) [20:15] SketchCow: nyaa and tokyotosho for anime (we've crawled them in the past) [20:15] 586142 torrents on iptorrents [20:25] are you trying to just scrape basic info from these torrent places? or download all the torrents [20:30] *** K4k has quit IRC (Ping timeout: 370 seconds) [20:42] *** caber has quit IRC (Quit: Kids: talk with your parents about ad-blockers, and, at some point; social media. But fundamentals first!) [20:46] I'm just trying to understand what's out there. [20:47] I'm uploading 27 2-sided PC-Gamer DVD-ROMs. [20:48] https://archive.org/details/pcgamer-cdroms?sort=-publicdate [20:49] *** caber has joined #archiveteam [20:55] *** K4k has joined #archiveteam [20:56] *** sankin has quit IRC (Leaving.) [20:58] Do we have an outcome on the Sourceforge talks? [21:01] *** K4k has quit IRC (Read error: Operation timed out) [21:10] *** schbirid2 has quit IRC (Quit: Leaving) [21:11] *** landshark has joined #archiveteam [21:16] *** c_b has joined #archiveteam [21:30] *** scyther has quit IRC (Read error: Connection reset by peer) [21:39] *** Boltsie has quit IRC (Read error: Connection reset by peer) [21:40] *** Boltsie has joined #archiveteam [21:44] *** SimpBrain has quit IRC (Quit: Leaving) [22:00] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:01] *** Aranje has joined #archiveteam [22:06] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:07] *** Aranje has joined #archiveteam [22:07] *** Aranje has quit IRC (Read error: Connection reset by peer) [22:08] *** Aranje has joined #archiveteam [22:12] *** tephra_ has quit IRC (Read error: Operation timed out) [22:13] *** Command-S has quit IRC (Read error: Connection reset by peer) [22:13] *** Control-S has joined #archiveteam [22:16] *** tephra has joined #archiveteam [22:29] *** raylee has quit IRC (Ping timeout: 240 seconds) [22:29] *** raylee has joined #archiveteam [23:05] SketchCow: What I'd like to do is a project to slowly grab every torrent website (mostly text, so shouldn't be too big) and update the grabs as more torrent are added. [23:05] We should of course start with the site that are the most at risk. (piratebay, anything with a big lawsuit, boofi) [23:14] arkiver: for many private torrent sites there are what they call tracers, to announce when things are added to them [23:14] those announcements are public even if the site is closed off [23:15] i can link a few if you want to take a look [23:16] if the torrent has the private bit set, you can't download it without being registered on the tracker. unless you break specs. [23:16] *** Froggypwn has joined #archiveteam [23:16] kniffy: thanks, we might need that [23:17] *** c_b2 has joined #archiveteam [23:18] http://tracers.zenet.org/ | this one doesnt have searching, but it gives you an idea [23:18] *** c_b has quit IRC (Ping timeout: 252 seconds) [23:18] Also, we now have 10+ TB of Xfire! [23:19] we're running good [23:20] https://trace.corrupt-net.org/ | here is a searchable tracer db [23:21] arkiver: what are you proposing? grabbing the .torrent files or scraping the sites for torrent descriptions? [23:21] one last one here https://layer13.net/ [23:21] thanks [23:22] i've actually tried asking the guy who runs layer13 about downloading the entire db but he wouldnt go for it [23:23] kniffy: those tracers don't have any torrent files or magnes/hashes, so what good is it? [23:23] proves their existance [23:24] if you cant get on the trackers in question [23:24] oldcad: for torrent sites, we're more after the metadata then after the torrents [23:26] again, if the premise is to download the .torrent files (not the actual content of .torrent files, but the .torrent metadata files themselves and descriptions), i don't see the point of scraping a private tracker if the only way to get said torrents is to register to the tracker, which might be invite only or worse [23:27] yeah, not sure how open they would feel about cataloging everything thats available on them.. [23:28] kniffy: that's not my point. what good is scraping a private tracker if the data you get can't be reused in any way? [23:28] I tend to get from private trackers and upload it to public trackers and seed it both privately and publicly [23:28] ¯\(°_o)/¯ [23:30] scraping public trackers would keep you busy for a long time, and the .torrent files can be reused forever. what happens if the private tracker you are scraping shuts down? everything off it won't be usable anymore [23:32] a record would exist of it having existed at the very least [23:32] its actually something i've thought about doing before [23:33] kniffy: well ok, but imho, you would only be helping the RIAA [23:34] other records of releases having existed exist [23:34] there are many many public predbs [23:34] ¯\(°_o)/¯ wasnt my idea, man [23:34] i just knew about the tracers, might be a help to someone, i duno [23:35] kniffy: sorry, didn't mean to assume it was your idea. im only making a point [23:37] i mean, saving internet history is good and all that, but torrents are a gray area [23:37] yeah, true [23:38] dont [23:38] that's my opinion. torrents dont need to be archived. lets allow the normal cycle of data for those [23:40] *** VADemon_ has quit IRC (Quit: left4dead) [23:54] You are all adorable. [23:54] Who are you people? [23:59] *** Aranje has quit IRC (Read error: Connection reset by peer) [23:59] *** Aranje has joined #archiveteam