[00:13] *** melas has quit IRC (Quit: Page closed) [00:39] *** dashcloud has quit IRC (Ping timeout: 492 seconds) [00:53] *** robink has quit IRC (Ping timeout: 246 seconds) [00:56] *** robink has joined #archiveteam [01:16] *** JesseW has joined #archiveteam [01:18] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [01:27] *** z00nx has quit IRC (Quit: WeeChat 1.5) [01:28] *** z00nx has joined #archiveteam [01:31] *** ravetcofx has joined #archiveteam [01:55] *** khaoohs has quit IRC (Read error: Operation timed out) [01:56] *** ndiddy has quit IRC (Read error: Connection reset by peer) [02:18] *** dashcloud has joined #archiveteam [02:21] *** kristian_ has quit IRC (Leaving) [02:24] *** winr5r has quit IRC (Read error: Operation timed out) [02:27] *** winr4r has joined #archiveteam [02:57] *** maelstrom has quit IRC (Quit: Leaving) [02:57] *** maelstrom has joined #archiveteam [03:01] *** AlexLehm has quit IRC (Read error: Connection reset by peer) [03:04] *** Fake-Name has left [03:11] there's the pastebin pastes collection on IA that seems to be long not-updated, is this something I should take on? [03:12] there's API access to real time pastes for a small fee, it's not much work to wire that up to wget and upload all the results daily. [03:13] joepie91: looks like this was yours project? [03:18] *** khaoohs has joined #archiveteam [04:06] *** ravetcofx has quit IRC (Ping timeout: 501 seconds) [04:08] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:15] *** Sk1d has joined #archiveteam [04:39] *** redlob has quit IRC (Read error: Operation timed out) [04:41] *** redlob has joined #archiveteam [04:44] *** dashcloud has quit IRC (Read error: Operation timed out) [04:56] *** maelstrom has quit IRC (Quit: Leaving) [05:03] *** ky0ko has quit IRC (Ping timeout: 250 seconds) [05:11] *** WinterFox has quit IRC (Quit: Leaving) [05:19] *** Start has quit IRC (Read error: Operation timed out) [05:22] *** Start has joined #archiveteam [05:31] *** Stilett0 has joined #archiveteam [05:31] *** Stiletto has quit IRC (Ping timeout: 190 seconds) [05:38] Something we should probably keep an eye on, as it is a user-contributed project of scientific import, that may die in the future: Internet Bird Collection: http://www.hbw.com/ibc [05:39] It's been around since 2002, so it's pretty stable, but still... [05:45] I've now made a page; if somoene wants to grab a screenshot as an image, that'd be appreciated: http://archiveteam.org/index.php?title=Internet_Bird_Collection [05:49] *** nwf_ has quit IRC (Read error: Operation timed out) [05:50] *** nwf_ has joined #archiveteam [05:52] *** JesseW has quit IRC (Ping timeout: 370 seconds) [05:57] *** Honno has joined #archiveteam [06:08] *** JesseW has joined #archiveteam [06:21] *** bwn has quit IRC (Read error: Operation timed out) [06:25] *** bwn has joined #archiveteam [06:33] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:18] *** brayden has quit IRC (Read error: Connection reset by peer) [07:18] *** yipdw has quit IRC (Read error: Operation timed out) [07:18] *** brayden has joined #archiveteam [07:18] *** swebb sets mode: +o brayden [07:18] *** acridAxid has quit IRC (Read error: Operation timed out) [07:19] *** Cameron_D has quit IRC (Read error: Operation timed out) [07:19] *** brayden has quit IRC (Read error: Connection reset by peer) [07:20] *** Infreq has quit IRC (Read error: Operation timed out) [07:22] *** Jonimus has quit IRC (Ping timeout: 260 seconds) [07:22] *** Cameron_D has joined #archiveteam [07:23] *** Jonimus has joined #archiveteam [07:23] *** swebb sets mode: +o Jonimus [07:25] *** brayden has joined #archiveteam [07:25] *** swebb sets mode: +o brayden [07:25] *** Infreq has joined #archiveteam [07:25] *** yipdw has joined #archiveteam [07:25] *** Frogging sets mode: +o yipdw [07:28] *** acridAxid has joined #archiveteam [07:46] *** atomotic has joined #archiveteam [09:27] *** atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [09:38] *** gibigiana has quit IRC (Ping timeout: 250 seconds) [09:45] *** gibigiana has joined #archiveteam [10:08] *** atomotic has joined #archiveteam [10:09] *** redlob_ has joined #archiveteam [10:10] *** redlob has quit IRC (Read error: Operation timed out) [10:26] *** polm has joined #archiveteam [10:27] Hey, did anyone see Japanese ISP Nifty is closing unclaimed homepages at the end of this month? Apparently that's ~140,000 [10:27] I haven't seen any English coverage of it but the official announcement (Japanese) is here http://homepage.nifty.com/information/ [10:28] ohhh crap [10:28] there's a lot of stuff on nifty [10:29] one month [10:29] They actually gave notice in January, but I only heard about it recently [10:31] Several people told me shortly [10:31] We should get on it. [10:31] I'm making a wiki article. [10:32] We'll start planning. [10:41] http://www.archiveteam.org/index.php?title=Nifty It's a start [10:41] Next step is probably scraping search engines? [10:42] Traditionally, we try and determine the URL structure [10:43] We have that already. There are usernames [10:44] One thing I would recommend is searching Hatena Bookmarks, which is like a Japanese free Pinboard [10:44] Like so: http://b.hatena.ne.jp/entrylist?url=homepage2.nifty.com [10:45] the "of" query parameter paginates like so: http://b.hatena.ne.jp/entrylist?url=homepage2.nifty.com&of=20 [10:47] there's some here. https://archive.is/homepage2.nifty.com [10:53] *** Morbus has joined #archiveteam [10:58] *** AlexLehm has joined #archiveteam [11:21] *** atrocity has joined #archiveteam [11:28] *** RichardG has joined #archiveteam [11:49] *** atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [11:50] *** atomotic has joined #archiveteam [12:07] *** closure has quit IRC (Ping timeout: 260 seconds) [12:12] *** hive-mind has quit IRC (Ping timeout: 260 seconds) [12:24] *** hive-mind has joined #archiveteam [12:29] *** nertzy has joined #archiveteam [12:42] *** dashcloud has joined #archiveteam [12:49] zout: yes, but I'm waiting for Pastebin to finally get back to me about their API [12:49] zout: we already have API access but the API is incomplete [12:56] *** BlueMaxim has quit IRC (Quit: Leaving) [12:59] joepie91: damn. [12:59] I'll shelve that, I assumed it might be low hanging fruit. [13:04] *** arkiver2 has joined #archiveteam [13:16] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [13:22] *** ky0ko has joined #archiveteam [13:27] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [13:51] *** redlob_ has quit IRC (Read error: Operation timed out) [13:55] *** redlob has joined #archiveteam [14:06] *** Start has quit IRC (Quit: Disconnected.) [14:17] *** atomotic has joined #archiveteam [14:20] *** dashcloud has quit IRC (Read error: Operation timed out) [14:35] dropbox is discontinuing the ability to host HTML pages: https://pbs.twimg.com/media/CrQZ-MJUIAAAm-w.jpg:large [14:41] *** ravetcofx has joined #archiveteam [14:50] zout: I'll bother them again soon... [15:02] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:07] *** Aranje has joined #archiveteam [15:11] *** ravetcofx has quit IRC (Read error: Operation timed out) [15:11] *** ravetcofx has joined #archiveteam [15:14] *** JesseW has joined #archiveteam [15:33] *** JesseW has quit IRC (Ping timeout: 370 seconds) [15:44] *** midas1 has quit IRC (Ping timeout: 260 seconds) [15:48] *** midas1 has joined #archiveteam [15:48] *** swebb sets mode: +o midas1 [16:11] *** atomotic has joined #archiveteam [16:16] *** VADemon has joined #archiveteam [16:26] *** metalcamp has joined #archiveteam [16:40] *** maelstrom has joined #archiveteam [17:00] *** schbirid has joined #archiveteam [17:03] *** Zialus has quit IRC (Read error: Operation timed out) [17:05] *** Zialus has joined #archiveteam [17:25] *** marvinw has quit IRC (Read error: Operation timed out) [17:52] *** marvinw has joined #archiveteam [18:15] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [18:16] *** metalcamp has joined #archiveteam [18:17] *** bRick5772 has joined #archiveteam [18:18] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [18:55] *** odie5533 has quit IRC (Read error: Operation timed out) [19:28] *** dashcloud has joined #archiveteam [19:43] *** dashcloud has quit IRC (Read error: Operation timed out) [20:16] *** RedType has joined #archiveteam [20:16] *** JW_work1 has joined #archiveteam [20:23] *** ndiddy has joined #archiveteam [21:03] http://academictorrents.com/ [21:03] "Making 15.49TB of research data available." [21:03] cc SketchCow [21:09] *** ky0ko has quit IRC (Read error: Operation timed out) [21:17] *** Rickster has quit IRC (Quit: ZNC 1.6.1 - http://znc.in) [21:19] *** Rickster has joined #archiveteam [21:23] *** schbirid has quit IRC (Quit: Leaving) [21:38] that puts libgen to shame [21:42] *** ky0ko has joined #archiveteam [21:49] *** VADemon_ has joined #archiveteam [21:49] *** Zebranky has quit IRC (Read error: Operation timed out) [21:49] *** ranma has quit IRC (Read error: Operation timed out) [21:49] *** luckcolor has quit IRC (Read error: Operation timed out) [21:49] *** aschmitz has quit IRC (Read error: Operation timed out) [21:49] *** luckcolor has joined #archiveteam [21:49] *** SketchCow has quit IRC (Read error: Connection reset by peer) [21:49] *** SketchCow has joined #archiveteam [21:49] *** swebb sets mode: +o SketchCow [21:49] *** aschmitz has joined #archiveteam [21:49] *** nertzy2 has joined #archiveteam [21:50] *** Zebranky has joined #archiveteam [21:50] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [21:51] *** nertzy has quit IRC (Read error: Operation timed out) [21:52] *** ranma has joined #archiveteam [22:01] *** VADemon has quit IRC (Read error: Operation timed out) [22:15] *** JW_work1 has quit IRC (Ping timeout: 633 seconds) [22:15] *** JW_work has joined #archiveteam [22:25] *** ravetcofx has quit IRC (Read error: Operation timed out) [22:31] *** VADemon_ has quit IRC (Read error: Connection reset by peer) [22:38] *** bRick5772 has quit IRC (Quit: Leaving.) [22:44] *** Stilett0 has quit IRC (Ping timeout: 244 seconds) [22:46] *** AlexLehm_ has joined #archiveteam [22:46] *** AlexLehm has quit IRC (Ping timeout: 260 seconds) [22:59] *** midas1 has quit IRC (Ping timeout: 633 seconds) [23:03] *** JW_work1 has joined #archiveteam [23:05] *** JW_work has quit IRC (Read error: Operation timed out) [23:11] *** BlueMaxim has joined #archiveteam [23:18] *** midas1 has joined #archiveteam [23:18] *** swebb sets mode: +o midas1 [23:30] *** Honno has quit IRC (Read error: Operation timed out) [23:32] *** maelstrom has quit IRC (Read error: Operation timed out) [23:40] *** maelstrom has joined #archiveteam