[00:26] *** mismatch has quit IRC (Ping timeout: 244 seconds) [00:27] *** dashcloud has quit IRC (Read error: Operation timed out) [00:28] *** mismatch_ has joined #archiveteam-bs [00:31] *** dashcloud has joined #archiveteam-bs [00:59] *** bwn has quit IRC (Read error: Operation timed out) [01:00] *** slpeeds has quit IRC (Remote host closed the connection) [01:00] *** fdo54ss has joined #archiveteam-bs [01:14] *** bwn has joined #archiveteam-bs [01:25] *** bsmith094 has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [02:27] *** robink_ has quit IRC (Ping timeout: 633 seconds) [02:35] *** bwn has quit IRC (Quit: Quit) [02:36] *** dashcloud has quit IRC (Read error: Operation timed out) [02:37] *** bwn has joined #archiveteam-bs [02:37] *** robink has joined #archiveteam-bs [02:39] *** dashcloud has joined #archiveteam-bs [02:50] *** VADemon has quit IRC (Quit: left4dead) [04:00] http://imgur.com/gallery/sEhz0/ unwittingly got a PC blu-ray drive at a garage sale for $5 [04:11] *** dashcloud has quit IRC (Read error: Operation timed out) [04:14] *** dashcloud has joined #archiveteam-bs [04:16] *** bsmith093 has quit IRC (Ping timeout: 370 seconds) [04:19] *** bsmith093 has joined #archiveteam-bs [04:56] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:00] *** brayden has quit IRC (Quit: Leaving) [05:03] *** Sk1d has joined #archiveteam-bs [05:04] *** brayden has joined #archiveteam-bs [05:04] *** swebb sets mode: +o brayden [05:41] *** mismatch_ has quit IRC (Remote host closed the connection) [05:41] *** mismatch_ has joined #archiveteam-bs [05:45] *** JesseW has joined #archiveteam-bs [05:55] I see Yoshimura has graduated from weighing in on every single detail in the archive team tech chain to "informing" newbies on the main channel. [05:55] Guess my feelings. [05:56] Also, I have 6 windows uploading FLACs from that bootleg archive I was told to check out. [06:03] cool [06:05] Yeah, there was a UTF-8 problem holding up the works. [06:16] SketchCow: we are up to 2008-06-15 with funny or die archive [06:17] that archive is going to take very long time [06:42] *** dashcloud has quit IRC (Read error: Operation timed out) [06:43] *** dashcloud has joined #archiveteam-bs [07:21] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:22] Judging by lack of work, I conclude warrior being a success at least on weekends. Or maybe the servers are throttled more? Do not know, does anyone? [07:24] Also I did start IFPS node, but does not seem to take any space, BW about 5MB/s avg. [07:37] IPFS does not download anything unless you request/pin it. [07:47] *** Honno has joined #archiveteam-bs [07:47] *** Honno_ has joined #archiveteam-bs [07:48] PurpleSym: Oh, how does it help running a node itself then? Should I pin stuff to help, or? [07:49] By running a node you keep the DHT healthy. [07:50] But yeah, you’d need to pin items to be more useful. [07:52] Thanks. [07:53] * Yoshimura has no idea what to pin. Likely the stuff used in examples at least. [07:54] *** Honno has quit IRC (Read error: Operation timed out) [07:54] The daemon logs quite a bit of data, including incoming requests for hashes. You could parse that and just pin every hash you see. [07:57] Here’s an example I wrote: http://paste.nerds.io/kinuyarija.py [07:58] Excellent! Thank you :D [07:58] (Incomplete, but you get the idea) [07:58] Yeah, examples and ideas or references are fine, I could clob it together in something. [08:25] *** godane has quit IRC (Quit: Leaving.) [08:40] *** Honno__ has joined #archiveteam-bs [08:53] *** Honno_ has quit IRC (Read error: Operation timed out) [08:54] *** dashcloud has quit IRC (Read error: Operation timed out) [08:58] *** godane has joined #archiveteam-bs [08:58] *** dashcloud has joined #archiveteam-bs [09:08] *** arkiver2 has joined #archiveteam-bs [09:10] *** robink has quit IRC (Ping timeout: 260 seconds) [09:12] *** bwn has quit IRC (Read error: Operation timed out) [09:12] *** robink has joined #archiveteam-bs [09:20] o [09:20] i'm starting to upload more RT Going underground epsiodes [09:20] *** bwn has joined #archiveteam-bs [09:36] *** Medowar has joined #archiveteam-bs [09:47] *** Honno has joined #archiveteam-bs [09:57] *** Honno__ has quit IRC (Read error: Operation timed out) [10:10] *** dashcloud has quit IRC (Read error: Operation timed out) [10:14] *** dashcloud has joined #archiveteam-bs [10:26] *** arkiver3 has joined #archiveteam-bs [10:26] *** dashcloud has quit IRC (Read error: Operation timed out) [10:29] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [10:29] *** dashcloud has joined #archiveteam-bs [10:30] *** arkiver3 has quit IRC (Client Quit) [11:12] *** Honno_ has joined #archiveteam-bs [11:17] *** BlueMaxim has quit IRC (Quit: Leaving) [12:24] * Yoshimura wonders if the geoip lookup is excellent or terrible example. [13:02] *** VADemon has joined #archiveteam-bs [14:57] Can I – somehow – extend emularity_win31’s PATH variable or do I need to copy runapp.bat and add it there? [14:59] pass [15:09] *** Honno has quit IRC (Quit: Leaving) [15:09] Come to #jsmess and discuss it. [15:10] #-bs isn't a good place for it [15:12] *** Honno_ has quit IRC (Quit: Leaving) [15:13] Sure. [15:25] *** Honno has joined #archiveteam-bs [15:28] *** Medowar has quit IRC (Quit: Connection closed for inactivity) [16:12] hey archiveteam, how hard is it to grab "Google Drive Documents" embeds, such as on this page: https://www.weasyl.com/submission/1110298/lifeline-dancing [16:16] *** RichardG has quit IRC (Read error: Operation timed out) [16:49] haha: https://www.reddit.com/r/DataHoarder/comments/4ezlpv/help_save_17_years_of_pc_game_modding_history/ [16:50] getting some praise there [16:54] success story [16:54] yep, haha [16:57] is there a way to quickly look in the warrior what project has tons of work available? [16:57] or a website or anything? [16:58] http://tracker.archiveteam.org/ [16:58] ok, so just look at them individually [16:59] pretty much, though the star is next to the the 'warrior default' project, which usually has lots of work available [17:02] *** Medowar has joined #archiveteam-bs [17:25] i keep wanting to design utilities for data hoarders to make life easier [17:42] *** goekesmi has quit IRC (Read error: Connection reset by peer) [17:48] *** Stiletto has quit IRC (Read error: Operation timed out) [17:54] *** JesseW has joined #archiveteam-bs [18:02] *** brayden_ has joined #archiveteam-bs [18:02] *** swebb sets mode: +o brayden_ [18:08] *** brayden has quit IRC (Read error: Operation timed out) [18:10] *** goekesmi has joined #archiveteam-bs [18:28] atrocity: Google code has a lot if the servers are not already loaded [18:55] *** bwn has quit IRC (Read error: Operation timed out) [19:05] *** JesseW has left [19:15] *** bwn has joined #archiveteam-bs [19:16] *** JesseW has joined #archiveteam-bs [19:43] *** Yoshimura has quit IRC (http://www.kiwiirc.com/ - A hand crafted IRC client) [19:44] *** Yoshimura has joined #archiveteam-bs [20:01] *** JesseW has quit IRC (Ping timeout: 370 seconds) [20:07] *** anjacks0n has joined #archiveteam-bs [20:14] *** RichardG has joined #archiveteam-bs [20:18] Item file:1697117 - FAILED [20:18] grr [20:20] switched to 1 connection, see what happens [20:20] gamefront? Yeah a lot fail. Feeling like 80% fail. [20:21] Had the same thing with 1 connection and with 6. [20:25] well, the other 2 instances are getting rate-limiting messages from the tracker, so no point anyway, lol [20:25] *** anjacks0n has quit IRC (anjacks0n) [20:27] Atluxity just eats up every project he/she is on, lol [20:28] hehe, yeah, I had a nice hose a while [20:29] thats down now. I have another one on the way, just havent had time to set it up yet [20:30] just out of curiosity, how many servers are you using, how many instances and where do you get those servers from? [20:31] if this gamefront one is returning error code -6 as a failed result, is that reporting back and messed up to the tracker? or does it upload all the stuff it downloaded minus the actual file it's dying on? [20:38] Medowar: I work at the second largest hosting company in Norway. We are experienced with VMware and HyperV, but now we were testing Openstack. The guy in charge of that wanted someone to generate traffic, specificly tcp sessions. [20:38] So I got 50 IPs, 1 ip go to gateway, then I had 49 hosts with public ips [20:39] 15GB hdd only, but it got most of the work done [20:39] the FTP was too big, I gave up on that [20:40] at one point I was our (the hosting company) seconds largest consumer of bandwidth :P [20:40] made the network dep go "wtf?" [20:41] good times [20:41] I tried to keep around 1Gbps, but hard to judge [20:42] on standard grabs I ran 10 concurrent on each 49 hosts [20:42] on urlteam I could do 30 concurrent, I think the tracker was the bottleneck [20:43] atrocity: afaik it just does not report back that the item finished, so someone else might try the same item later [20:45] wow nice. I have worked at one of the largest german Supercomputer in Germany, but wasnt involved back then in archiving.. [20:46] 46k New servers, waiting to be burned in. With everything 100G networked. [20:46] And Outbound Connection of infinite(dunno, sth like 400GB/s+) [20:47] That would have been a fast job.. :D [20:51] nice :D [20:53] oh, wow, after 3 years, they managed to put it on the website: http://www.mpcdf.mpg.de/services/computing/hydra/about-the-system [20:55] *** RichardG has quit IRC (Ping timeout: 250 seconds) [21:00] *** anjacks0n has joined #archiveteam-bs [21:01] lol, 280TB of RAM [21:01] could run my game on that :P [21:03] *** metalcamp has quit IRC (Ping timeout: 244 seconds) [21:03] and it could run chrome without having RAM issues [21:04] *** Honno has quit IRC (Read error: Operation timed out) [21:06] lol, to this day i don't trust chrome [21:13] *** anjacks0n has quit IRC (anjacks0n) [21:15] *** Coderjoe has quit IRC (Read error: Operation timed out) [21:18] *** RichardG has joined #archiveteam-bs [21:29] *** hook54321 has joined #archiveteam-bs [21:31] Is their a way to save all data (posts, comments, likes, etc) from a Facebook group? [21:36] *** Coderjoe has joined #archiveteam-bs [21:38] *** JesseW has joined #archiveteam-bs [21:58] *** zino has quit IRC (Read error: Connection reset by peer) [22:07] *** JesseW has quit IRC (Ping timeout: 370 seconds) [22:12] *** DopefishJ has joined #archiveteam-bs [22:12] *** swebb sets mode: +o DopefishJ [22:17] *** DFJustin has quit IRC (Read error: Operation timed out) [22:17] *** anjacks0n has joined #archiveteam-bs [22:19] *** zino has joined #archiveteam-bs [22:24] *** anjacks0n has quit IRC (anjacks0n) [22:51] looks like i'm at 675k items now [22:58] *** JesseW has joined #archiveteam-bs [23:03] *** BlueMaxim has joined #archiveteam-bs [23:08] *** Medowar has quit IRC (Quit: Connection closed for inactivity) [23:24] *** mismatch_ has quit IRC (Ping timeout: 250 seconds) [23:24] *** mismatch has joined #archiveteam-bs [23:40] *** hook54321 has quit IRC (Quit: Connection closed for inactivity)