#archiveteam-bs 2016-09-15,Thu

↑back Search

Time Nickname Message
00:03 πŸ”— ivan I think all hard drives are sold under the base 10 size
00:06 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
00:06 πŸ”— BartoCH has joined #archiveteam-bs
00:10 πŸ”— rduser has quit IRC (Read error: Operation timed out)
00:18 πŸ”— ndizzle that's not true ivan
00:19 πŸ”— ndizzle ibm's 305 ramac was 5 mb
00:20 πŸ”— kristian_ has quit IRC (Quit: Leaving)
00:20 πŸ”— ndizzle is now known as ndiddy
00:21 πŸ”— ndiddy hell, my ibook g4 has a 30 gb hdd and my thinkpad t41 has an 80 gb hdd
00:34 πŸ”— BlueMaxim has joined #archiveteam-bs
00:41 πŸ”— rduser has joined #archiveteam-bs
00:51 πŸ”— BlueMaxim has quit IRC (Read error: Operation timed out)
00:51 πŸ”— BlueMaxim has joined #archiveteam-bs
01:43 πŸ”— brayden has joined #archiveteam-bs
01:43 πŸ”— swebb sets mode: +o brayden
01:57 πŸ”— JesseW has joined #archiveteam-bs
02:01 πŸ”— Honno_ has joined #archiveteam-bs
02:40 πŸ”— Honno_ has quit IRC (Read error: Operation timed out)
02:56 πŸ”— Aranje has quit IRC (Quit: Three sheets to the wind)
03:21 πŸ”— atrocity http://egberts.tumblr.com/post/46655026612
03:21 πŸ”— atrocity this is amazing!
03:25 πŸ”— Frogging that is rather neat
03:29 πŸ”— tomwsmf_ has quit IRC (Read error: Operation timed out)
03:55 πŸ”— acridAxid has quit IRC (marauder)
03:57 πŸ”— acridAxid has joined #archiveteam-bs
04:31 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
04:34 πŸ”— dashcloud has joined #archiveteam-bs
04:51 πŸ”— Sk1d has quit IRC (Ping timeout: 250 seconds)
04:58 πŸ”— Sk1d has joined #archiveteam-bs
05:10 πŸ”— Frogging has quit IRC (Quit: El Psy Kongroo!)
05:16 πŸ”— Frogging has joined #archiveteam-bs
05:37 πŸ”— is- has quit IRC (Ping timeout: 362 seconds)
05:40 πŸ”— is- has joined #archiveteam-bs
05:53 πŸ”— GE has joined #archiveteam-bs
06:46 πŸ”— GE has quit IRC (Ping timeout: 255 seconds)
07:10 πŸ”— Honno has joined #archiveteam-bs
07:17 πŸ”— ndiddy has quit IRC (Read error: Connection reset by peer)
07:19 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
07:22 πŸ”— dashcloud has joined #archiveteam-bs
07:25 πŸ”— JesseW has quit IRC (Ping timeout: 370 seconds)
07:31 πŸ”— schbirid has joined #archiveteam-bs
07:43 πŸ”— swebb has quit IRC (Excess Flood)
07:45 πŸ”— swebb has joined #archiveteam-bs
08:25 πŸ”— godane i'm starting to upload twilgiht 92 dvds now
09:03 πŸ”— GE has joined #archiveteam-bs
10:28 πŸ”— godane has quit IRC (Read error: Operation timed out)
10:29 πŸ”— GE has quit IRC (Remote host closed the connection)
10:32 πŸ”— godane has joined #archiveteam-bs
10:41 πŸ”— BlueMaxim has quit IRC (Leaving)
10:45 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
10:50 πŸ”— BartoCH has joined #archiveteam-bs
11:43 πŸ”— SmileyG has joined #archiveteam-bs
11:45 πŸ”— Smiley has quit IRC (Read error: Operation timed out)
12:01 πŸ”— GE has joined #archiveteam-bs
12:05 πŸ”— vitzli has joined #archiveteam-bs
12:09 πŸ”— VADemon has joined #archiveteam-bs
12:56 πŸ”— dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.)
12:58 πŸ”— dashcloud has joined #archiveteam-bs
13:00 πŸ”— VADemon has quit IRC (Quit: left4dead)
14:17 πŸ”— Start has quit IRC (Quit: Disconnected.)
14:30 πŸ”— atrocity has quit IRC ()
14:36 πŸ”— Sanqui Currently scraping http://b.hatena.ne.jp/ for nifty.com homepages
14:55 πŸ”— tomwsmf_ has joined #archiveteam-bs
15:04 πŸ”— atrocity has joined #archiveteam-bs
15:19 πŸ”— kristian_ has joined #archiveteam-bs
15:23 πŸ”— balrog Sanqui: are they shutting down?
15:24 πŸ”— Sanqui balrog: yes. http://archiveteam.org/index.php?title=Nifty
15:25 πŸ”— balrog and GoogleScraper no longer works?
15:26 πŸ”— balrog sets mode: +oo Lord_Nigh Sanqui
15:29 πŸ”— Sanqui yeah, it does grab the first page of results, but crashes in weird ways
15:33 πŸ”— PurpleSym sets mode: +o swebb
15:43 πŸ”— ItsYoda has quit IRC (Quit: rippppp to the yoda you used to know!)
15:52 πŸ”— ItsYoda has joined #archiveteam-bs
16:05 πŸ”— Sanqui who can create ArchiveTeam Github projects?
16:07 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
16:07 πŸ”— Kaz Sanqui: these people, as far as I'm aware: https://github.com/orgs/ArchiveTeam/people
16:07 πŸ”— BartoCH has joined #archiveteam-bs
16:07 πŸ”— Kaz though there might be permissions within those, never used GitHub organisations
16:08 πŸ”— Sanqui well, thanks, I know as much haha
16:08 πŸ”— Sanqui if somebody made a nifty project and gave me push rights, that'd be cool. or if I could move this idk https://github.com/Sanqui/archiveteam-nifty
16:22 πŸ”— vitzli has quit IRC (Quit: Leaving)
16:23 πŸ”— Sanqui am I reading this right and private.coocan.jp/ belongs to nifty too.. christ...
16:23 πŸ”— Sanqui coocan might actually be paid though so
16:23 πŸ”— Sanqui that should stay
16:27 πŸ”— Sanqui http://homepage2.nifty.com/snowwolf/ anyway in case anybody was doubting the value, I'm preserving beautiful homepages like this
16:28 πŸ”— Sanqui http://homepage2.nifty.com/sonority/
16:28 πŸ”— Sanqui http://homepage2.nifty.com/sophia0/
16:28 πŸ”— Sanqui literally geocities
16:32 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
16:37 πŸ”— BartoCH has joined #archiveteam-bs
16:39 πŸ”— Aranje has joined #archiveteam-bs
16:41 πŸ”— arkiver Sanqui: can you please rename the repo to nifty-discovery?
16:41 πŸ”— arkiver will create a group on github for this
16:41 πŸ”— Sanqui sure
16:41 πŸ”— arkiver and thanks :)
16:41 πŸ”— Sanqui renamed
16:41 πŸ”— arkiver Do you have any idea of how many websites this might be?
16:42 πŸ”— Sanqui somebody claimed 140,000 homepages but I don't know where they got their number from
16:42 πŸ”— Sanqui about 20k were already inserted into ArchiveBot
16:42 πŸ”— arkiver you're added
16:43 πŸ”— arkiver I see
16:43 πŸ”— arkiver do you think we'll need a warrior project for this?
16:43 πŸ”— Sanqui I'm not sure. We did internetcentrum solely through ArchiveBot, and that's my only frame of reference
16:44 πŸ”— Sanqui I could use help with discovery, and maybe additional pipelines would help
16:44 πŸ”— Kaz if you want somewhere to run some scripts, let me know
16:45 πŸ”— arkiver Sanqui: ok
16:45 πŸ”— Sanqui " You don’t have admin rights to ArchiveTeam "
16:45 πŸ”— Sanqui guess I can't move the repo
16:45 πŸ”— Sanqui so if you make it i'll just push there
16:46 πŸ”— arkiver I think you should be able to add it to the team
16:47 πŸ”— Sanqui I can only attempt to transfer ownership to ArchiveTeam, and I can't do that
16:47 πŸ”— Sanqui I can't make a new repo even under the team either
16:47 πŸ”— arkiver ok
16:47 πŸ”— arkiver added a repo to the team
16:48 πŸ”— Sanqui cheers
16:48 πŸ”— godane has quit IRC (Quit: Leaving.)
16:48 πŸ”— arkiver :)
16:49 πŸ”— godane has joined #archiveteam-bs
16:50 πŸ”— Sanqui yipdw: the wiki still states new ArchiveBot nodes are not being accepted, is that still true?
16:51 πŸ”— Sanqui after the pipeline upgrade
16:51 πŸ”— yipdw if you have an existing key registered in the node then I can't stop you from managing it, but I don't want to take on new keys
16:51 πŸ”— yipdw er, from adding new nodes
16:52 πŸ”— Sanqui well. okay. I won't be setting up a pipeline myself since my setup isn't stable
16:52 πŸ”— Sanqui will the situation change in the near future? I think our pipelines could get starved
16:55 πŸ”— yipdw I expect only for situations in which it is somehow very clear that the person running the pipeline can provide exceptional stability
16:56 πŸ”— Sanqui understood
17:00 πŸ”— tomwsmf_ has quit IRC (Read error: Operation timed out)
17:00 πŸ”— achip has quit IRC (Ping timeout: 255 seconds)
17:02 πŸ”— logchfoo1 starts logging #archiveteam-bs at Thu Sep 15 17:02:09 2016
17:02 πŸ”— logchfoo1 has joined #archiveteam-bs
17:02 πŸ”— xmc i've been meaning to bring up a node or two under FalconK's supervision/tutelage
17:03 πŸ”— xmc hi my name is xmc and i have computers that don't reboot
17:04 πŸ”— HCross2 Hi. I'm Harry. Happy to run a pipeline if help is needed. Stability can be proven via newsbuddy
17:05 πŸ”— xmc hey yipdw how tricky would it be to list the number of unoccupied pipeline slots in !status, alongside the count of running jobs
17:05 πŸ”— Kaz https://static.kurtmclester.com/s/342h1071.png
17:05 πŸ”— yipdw I don't know how to get that information under seesaw
17:05 πŸ”— yipdw I guess one could parse --concurrent=N
17:06 πŸ”— yipdw all that said, pipeline starvation just doesn't seem like a common occurrence
17:06 πŸ”— yipdw I know people like talking about it
17:08 πŸ”— HCross2 Kaz: that's just irc pinging out. Not it crashing. It's still working on my server
17:08 πŸ”— Kaz I know :>
17:08 πŸ”— xmc hm ok
17:09 πŸ”— yipdw I guess you could do something like:
17:09 πŸ”— yipdw - get the total number of concurrent workers
17:09 πŸ”— yipdw - around each job, put tasks to bump the count
17:09 πŸ”— yipdw there may very well be an API to get this and I just haven't seen it
17:11 πŸ”— yipdw Sanqui: to more constructively answer your question, though, to really re-open up archivebot nodes I think I'd want something like (a) better restart resilence, (b) self-service registration
17:11 πŸ”— metalcamp has joined #archiveteam-bs
17:13 πŸ”— Sanqui got it. suspending jobs would probably be the solution (and would also enable transferring jobs, or resuming crashed ones?)
17:14 πŸ”— yipdw suspend/resume yes
17:14 πŸ”— yipdw and some way to do that from the pipeline operator console
17:15 πŸ”— Sanqui nod
17:16 πŸ”— * luckcolor approves
17:30 πŸ”— achip has joined #archiveteam-bs
17:36 πŸ”— RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue)
17:38 πŸ”— RichardG has joined #archiveteam-bs
17:44 πŸ”— tomwsmf_ has joined #archiveteam-bs
18:08 πŸ”— kristian_ has quit IRC (Quit: Leaving)
18:09 πŸ”— GE has joined #archiveteam-bs
19:15 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
19:19 πŸ”— dashcloud has joined #archiveteam-bs
19:31 πŸ”— ndiddy has joined #archiveteam-bs
19:59 πŸ”— RichardG_ has joined #archiveteam-bs
19:59 πŸ”— RichardG has quit IRC (Read error: Connection reset by peer)
20:03 πŸ”— RichardG_ is now known as RichardG
20:26 πŸ”— godane does anyone know how to rip videos like this: http://akc.hlslive.video.theblaze.com/ls01/gbtv/2016/09/14/THEBLAZE_GHOST_VIDEO_1700_Glenn_20160914/master_mobile.m3u8
20:30 πŸ”— FalconK this job for static.spore.com is really demonstrating a case where being slightly more clever about the queue would be helpful
20:34 πŸ”— fusl has quit IRC (Max SendQ exceeded)
20:35 πŸ”— fusl has joined #archiveteam-bs
20:37 πŸ”— xmc godane: the .m3u8 should be a text file containing video urls
20:38 πŸ”— * xmc checks
20:38 πŸ”— xmc yeah they are relative urls
20:39 πŸ”— xmc so for 800K/800_complete-trimmed.m3u8 you want to put that in the same directory as the .m3u8
20:39 πŸ”— xmc which gives: http://akc.hlslive.video.theblaze.com/ls01/gbtv/2016/09/14/THEBLAZE_GHOST_VIDEO_1700_Glenn_20160914/800K/800_complete-trimmed.m3u8
20:41 πŸ”— metalcamp has quit IRC (Ping timeout: 244 seconds)
20:47 πŸ”— SketchCow I got forwarded some mail
20:47 πŸ”— SketchCow RAD Videogame Tools
20:47 πŸ”— SketchCow You know that name
20:47 πŸ”— SketchCow "Hey, all our games we had for testing on... we're throwing them out... want them?"
20:47 πŸ”— SketchCow ..........
20:47 πŸ”— SketchCow .............yes
20:53 πŸ”— godane there give a AES 128 error
20:58 πŸ”— Sanqui I can't parse that sentence. Are they giving out builds of games they were given for testing?
21:01 πŸ”— xmc godane: ?
21:01 πŸ”— godane the files are encrypt
21:02 πŸ”— godane even when use my cookies with login there encrypt
21:02 πŸ”— xmc huh
21:03 πŸ”— xmc that's a weird thing
21:03 πŸ”— godane i can't even view the ondemand in browser
21:03 πŸ”— godane older videos are fine
21:04 πŸ”— godane but newer videos don't work
21:05 πŸ”— godane all videos i got was cause of AKAMAI_FLASH_STREAM ONDEMAND : http://web.gbtv.com/gen/multimedia/detail/6/8/3/1077120683.xml
21:05 πŸ”— godane cause i could run rtmpsrv and click on a video and get it
22:05 πŸ”— RichardG has quit IRC (Read error: Operation timed out)
22:06 πŸ”— RichardG has joined #archiveteam-bs
22:23 πŸ”— Honno has quit IRC (Read error: Operation timed out)
22:28 πŸ”— Start has joined #archiveteam-bs
22:36 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
22:41 πŸ”— dashcloud has joined #archiveteam-bs
23:04 πŸ”— schbirid has quit IRC (Quit: Leaving)
23:07 πŸ”— RichardG has quit IRC (Read error: Operation timed out)
23:08 πŸ”— RichardG has joined #archiveteam-bs
23:12 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
23:16 πŸ”— dashcloud has joined #archiveteam-bs
23:20 πŸ”— ravetcofx has quit IRC (Remote host closed the connection)
23:24 πŸ”— BartoCH has quit IRC (Ping timeout: 260 seconds)
23:26 πŸ”— BartoCH has joined #archiveteam-bs
23:35 πŸ”— ravetcofx has joined #archiveteam-bs
23:35 πŸ”— GE has quit IRC (Quit: zzz)
23:59 πŸ”— superkuh has quit IRC (Read error: Operation timed out)

irclogger-viewer