[00:03] <ivan> I think all hard drives are sold under the base 10 size [00:06] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [00:06] *** BartoCH has joined #archiveteam-bs [00:10] *** rduser has quit IRC (Read error: Operation timed out) [00:18] <ndizzle> that's not true ivan [00:19] <ndizzle> ibm's 305 ramac was 5 mb [00:20] *** kristian_ has quit IRC (Quit: Leaving) [00:20] *** ndizzle is now known as ndiddy [00:21] <ndiddy> hell, my ibook g4 has a 30 gb hdd and my thinkpad t41 has an 80 gb hdd [00:34] *** BlueMaxim has joined #archiveteam-bs [00:41] *** rduser has joined #archiveteam-bs [00:51] *** BlueMaxim has quit IRC (Read error: Operation timed out) [00:51] *** BlueMaxim has joined #archiveteam-bs [01:43] *** brayden has joined #archiveteam-bs [01:43] *** swebb sets mode: +o brayden [01:57] *** JesseW has joined #archiveteam-bs [02:01] *** Honno_ has joined #archiveteam-bs [02:40] *** Honno_ has quit IRC (Read error: Operation timed out) [02:56] *** Aranje has quit IRC (Quit: Three sheets to the wind) [03:21] <atrocity> http://egberts.tumblr.com/post/46655026612 [03:21] <atrocity> this is amazing! [03:25] <Frogging> that is rather neat [03:29] *** tomwsmf_ has quit IRC (Read error: Operation timed out) [03:55] *** acridAxid has quit IRC (marauder) [03:57] *** acridAxid has joined #archiveteam-bs [04:31] *** dashcloud has quit IRC (Read error: Operation timed out) [04:34] *** dashcloud has joined #archiveteam-bs [04:51] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:58] *** Sk1d has joined #archiveteam-bs [05:10] *** Frogging has quit IRC (Quit: El Psy Kongroo!) [05:16] *** Frogging has joined #archiveteam-bs [05:37] *** is- has quit IRC (Ping timeout: 362 seconds) [05:40] *** is- has joined #archiveteam-bs [05:53] *** GE has joined #archiveteam-bs [06:46] *** GE has quit IRC (Ping timeout: 255 seconds) [07:10] *** Honno has joined #archiveteam-bs [07:17] *** ndiddy has quit IRC (Read error: Connection reset by peer) [07:19] *** dashcloud has quit IRC (Read error: Operation timed out) [07:22] *** dashcloud has joined #archiveteam-bs [07:25] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:31] *** schbirid has joined #archiveteam-bs [07:43] *** swebb has quit IRC (Excess Flood) [07:45] *** swebb has joined #archiveteam-bs [08:25] <godane> i'm starting to upload twilgiht 92 dvds now [09:03] *** GE has joined #archiveteam-bs [10:28] *** godane has quit IRC (Read error: Operation timed out) [10:29] *** GE has quit IRC (Remote host closed the connection) [10:32] *** godane has joined #archiveteam-bs [10:41] *** BlueMaxim has quit IRC (Leaving) [10:45] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [10:50] *** BartoCH has joined #archiveteam-bs [11:43] *** SmileyG has joined #archiveteam-bs [11:45] *** Smiley has quit IRC (Read error: Operation timed out) [12:01] *** GE has joined #archiveteam-bs [12:05] *** vitzli has joined #archiveteam-bs [12:09] *** VADemon has joined #archiveteam-bs [12:56] *** dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.) [12:58] *** dashcloud has joined #archiveteam-bs [13:00] *** VADemon has quit IRC (Quit: left4dead) [14:17] *** Start has quit IRC (Quit: Disconnected.) [14:30] *** atrocity has quit IRC () [14:36] <Sanqui> Currently scraping http://b.hatena.ne.jp/ for nifty.com homepages [14:55] *** tomwsmf_ has joined #archiveteam-bs [15:04] *** atrocity has joined #archiveteam-bs [15:19] *** kristian_ has joined #archiveteam-bs [15:23] <balrog> Sanqui: are they shutting down? [15:24] <Sanqui> balrog: yes. http://archiveteam.org/index.php?title=Nifty [15:25] <balrog> and GoogleScraper no longer works? [15:26] *** balrog sets mode: +oo Lord_Nigh Sanqui [15:29] <Sanqui> yeah, it does grab the first page of results, but crashes in weird ways [15:33] *** PurpleSym sets mode: +o swebb [15:43] *** ItsYoda has quit IRC (Quit: rippppp to the yoda you used to know!) [15:52] *** ItsYoda has joined #archiveteam-bs [16:05] <Sanqui> who can create ArchiveTeam Github projects? [16:07] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [16:07] <Kaz> Sanqui: these people, as far as I'm aware: https://github.com/orgs/ArchiveTeam/people [16:07] *** BartoCH has joined #archiveteam-bs [16:07] <Kaz> though there might be permissions within those, never used GitHub organisations [16:08] <Sanqui> well, thanks, I know as much haha [16:08] <Sanqui> if somebody made a nifty project and gave me push rights, that'd be cool. or if I could move this idk https://github.com/Sanqui/archiveteam-nifty [16:22] *** vitzli has quit IRC (Quit: Leaving) [16:23] <Sanqui> am I reading this right and private.coocan.jp/ belongs to nifty too.. christ... [16:23] <Sanqui> coocan might actually be paid though so [16:23] <Sanqui> that should stay [16:27] <Sanqui> http://homepage2.nifty.com/snowwolf/ anyway in case anybody was doubting the value, I'm preserving beautiful homepages like this [16:28] <Sanqui> http://homepage2.nifty.com/sonority/ [16:28] <Sanqui> http://homepage2.nifty.com/sophia0/ [16:28] <Sanqui> literally geocities [16:32] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [16:37] *** BartoCH has joined #archiveteam-bs [16:39] *** Aranje has joined #archiveteam-bs [16:41] <arkiver> Sanqui: can you please rename the repo to nifty-discovery? [16:41] <arkiver> will create a group on github for this [16:41] <Sanqui> sure [16:41] <arkiver> and thanks :) [16:41] <Sanqui> renamed [16:41] <arkiver> Do you have any idea of how many websites this might be? [16:42] <Sanqui> somebody claimed 140,000 homepages but I don't know where they got their number from [16:42] <Sanqui> about 20k were already inserted into ArchiveBot [16:42] <arkiver> you're added [16:43] <arkiver> I see [16:43] <arkiver> do you think we'll need a warrior project for this? [16:43] <Sanqui> I'm not sure. We did internetcentrum solely through ArchiveBot, and that's my only frame of reference [16:44] <Sanqui> I could use help with discovery, and maybe additional pipelines would help [16:44] <Kaz> if you want somewhere to run some scripts, let me know [16:45] <arkiver> Sanqui: ok [16:45] <Sanqui> " You don’t have admin rights to ArchiveTeam " [16:45] <Sanqui> guess I can't move the repo [16:45] <Sanqui> so if you make it i'll just push there [16:46] <arkiver> I think you should be able to add it to the team [16:47] <Sanqui> I can only attempt to transfer ownership to ArchiveTeam, and I can't do that [16:47] <Sanqui> I can't make a new repo even under the team either [16:47] <arkiver> ok [16:47] <arkiver> added a repo to the team [16:48] <Sanqui> cheers [16:48] *** godane has quit IRC (Quit: Leaving.) [16:48] <arkiver> :) [16:49] *** godane has joined #archiveteam-bs [16:50] <Sanqui> yipdw: the wiki still states new ArchiveBot nodes are not being accepted, is that still true? [16:51] <Sanqui> after the pipeline upgrade [16:51] <yipdw> if you have an existing key registered in the node then I can't stop you from managing it, but I don't want to take on new keys [16:51] <yipdw> er, from adding new nodes [16:52] <Sanqui> well. okay. I won't be setting up a pipeline myself since my setup isn't stable [16:52] <Sanqui> will the situation change in the near future? I think our pipelines could get starved [16:55] <yipdw> I expect only for situations in which it is somehow very clear that the person running the pipeline can provide exceptional stability [16:56] <Sanqui> understood [17:00] *** tomwsmf_ has quit IRC (Read error: Operation timed out) [17:00] *** achip has quit IRC (Ping timeout: 255 seconds) [17:02] *** logchfoo1 starts logging #archiveteam-bs at Thu Sep 15 17:02:09 2016 [17:02] *** logchfoo1 has joined #archiveteam-bs [17:02] <xmc> i've been meaning to bring up a node or two under FalconK's supervision/tutelage [17:03] <xmc> hi my name is xmc and i have computers that don't reboot [17:04] <HCross2> Hi. I'm Harry. Happy to run a pipeline if help is needed. Stability can be proven via newsbuddy [17:05] <xmc> hey yipdw how tricky would it be to list the number of unoccupied pipeline slots in !status, alongside the count of running jobs [17:05] <Kaz> https://static.kurtmclester.com/s/342h1071.png [17:05] <yipdw> I don't know how to get that information under seesaw [17:05] <yipdw> I guess one could parse --concurrent=N [17:06] <yipdw> all that said, pipeline starvation just doesn't seem like a common occurrence [17:06] <yipdw> I know people like talking about it [17:08] <HCross2> Kaz: that's just irc pinging out. Not it crashing. It's still working on my server [17:08] <Kaz> I know :> [17:08] <xmc> hm ok [17:09] <yipdw> I guess you could do something like: [17:09] <yipdw> - get the total number of concurrent workers [17:09] <yipdw> - around each job, put tasks to bump the count [17:09] <yipdw> there may very well be an API to get this and I just haven't seen it [17:11] <yipdw> Sanqui: to more constructively answer your question, though, to really re-open up archivebot nodes I think I'd want something like (a) better restart resilence, (b) self-service registration [17:11] *** metalcamp has joined #archiveteam-bs [17:13] <Sanqui> got it. suspending jobs would probably be the solution (and would also enable transferring jobs, or resuming crashed ones?) [17:14] <yipdw> suspend/resume yes [17:14] <yipdw> and some way to do that from the pipeline operator console [17:15] <Sanqui> nod [17:16] * luckcolor approves [17:30] *** achip has joined #archiveteam-bs [17:36] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [17:38] *** RichardG has joined #archiveteam-bs [17:44] *** tomwsmf_ has joined #archiveteam-bs [18:08] *** kristian_ has quit IRC (Quit: Leaving) [18:09] *** GE has joined #archiveteam-bs [19:15] *** dashcloud has quit IRC (Read error: Operation timed out) [19:19] *** dashcloud has joined #archiveteam-bs [19:31] *** ndiddy has joined #archiveteam-bs [19:59] *** RichardG_ has joined #archiveteam-bs [19:59] *** RichardG has quit IRC (Read error: Connection reset by peer) [20:03] *** RichardG_ is now known as RichardG [20:26] <godane> does anyone know how to rip videos like this: http://akc.hlslive.video.theblaze.com/ls01/gbtv/2016/09/14/THEBLAZE_GHOST_VIDEO_1700_Glenn_20160914/master_mobile.m3u8 [20:30] <FalconK> this job for static.spore.com is really demonstrating a case where being slightly more clever about the queue would be helpful [20:34] *** fusl has quit IRC (Max SendQ exceeded) [20:35] *** fusl has joined #archiveteam-bs [20:37] <xmc> godane: the .m3u8 should be a text file containing video urls [20:38] * xmc checks [20:38] <xmc> yeah they are relative urls [20:39] <xmc> so for 800K/800_complete-trimmed.m3u8 you want to put that in the same directory as the .m3u8 [20:39] <xmc> which gives: http://akc.hlslive.video.theblaze.com/ls01/gbtv/2016/09/14/THEBLAZE_GHOST_VIDEO_1700_Glenn_20160914/800K/800_complete-trimmed.m3u8 [20:41] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [20:47] <SketchCow> I got forwarded some mail [20:47] <SketchCow> RAD Videogame Tools [20:47] <SketchCow> You know that name [20:47] <SketchCow> "Hey, all our games we had for testing on... we're throwing them out... want them?" [20:47] <SketchCow> .......... [20:47] <SketchCow> .............yes [20:53] <godane> there give a AES 128 error [20:58] <Sanqui> I can't parse that sentence. Are they giving out builds of games they were given for testing? [21:01] <xmc> godane: ? [21:01] <godane> the files are encrypt [21:02] <godane> even when use my cookies with login there encrypt [21:02] <xmc> huh [21:03] <xmc> that's a weird thing [21:03] <godane> i can't even view the ondemand in browser [21:03] <godane> older videos are fine [21:04] <godane> but newer videos don't work [21:05] <godane> all videos i got was cause of AKAMAI_FLASH_STREAM ONDEMAND : http://web.gbtv.com/gen/multimedia/detail/6/8/3/1077120683.xml [21:05] <godane> cause i could run rtmpsrv and click on a video and get it [22:05] *** RichardG has quit IRC (Read error: Operation timed out) [22:06] *** RichardG has joined #archiveteam-bs [22:23] *** Honno has quit IRC (Read error: Operation timed out) [22:28] *** Start has joined #archiveteam-bs [22:36] *** dashcloud has quit IRC (Read error: Operation timed out) [22:41] *** dashcloud has joined #archiveteam-bs [23:04] *** schbirid has quit IRC (Quit: Leaving) [23:07] *** RichardG has quit IRC (Read error: Operation timed out) [23:08] *** RichardG has joined #archiveteam-bs [23:12] *** dashcloud has quit IRC (Read error: Operation timed out) [23:16] *** dashcloud has joined #archiveteam-bs [23:20] *** ravetcofx has quit IRC (Remote host closed the connection) [23:24] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [23:26] *** BartoCH has joined #archiveteam-bs [23:35] *** ravetcofx has joined #archiveteam-bs [23:35] *** GE has quit IRC (Quit: zzz) [23:59] *** superkuh has quit IRC (Read error: Operation timed out)