#archiveteam-bs 2017-12-14,Thu

↑back Search

Time Nickname Message
00:00 🔗 ez (same for ipfs-js)
00:01 🔗 ez companies naively thinking users will seed. thats not how bt works.
00:01 🔗 ola_norsk i found this player on some url that supported srt
00:01 🔗 ez (public) bt stands and falls on 1% out of peers being very altruistic
00:01 🔗 ola_norsk aye, it would need a back-bone source, as last resorts
00:02 🔗 ez ola_norsk: its been tried before
00:02 🔗 ola_norsk e.g: "there's no peers, have some from the source" kind of thing
00:02 🔗 ez by much bigger guys than this, notably akamai
00:02 🔗 ez p2p, for video flashcrowds, doesnt help that much. it just increases technical complexity.
00:03 🔗 ez the limitation is mostly browser. a website cant start a background seeding task after you view a video.
00:03 🔗 ez the flashcrowd needs to be viewing at the exact same moment, and this starts showing only results with very long (2h) videos
00:03 🔗 BlueMaxim has quit IRC (Quit: Leaving)
00:03 🔗 ez anything shorter than that and the variance in churn is too big
00:04 🔗 icedice has quit IRC (Ping timeout: 260 seconds)
00:05 🔗 ola_norsk so, if every peer closes browser, the video stops for the last remaining one ?
00:05 🔗 ez the nice thing is that it does help to scale really big flashcrowd, if bitchute had some super popular video now, they could host it even with measly infrastructure they have, as they're just seeds
00:05 🔗 ez however this is simply not regular usage pattern
00:05 🔗 ez regular usage is mostly people watching random video each, which is basically worst case
00:06 🔗 ola_norsk what if it was at least an option though? like choosing between flash and html5 player=
00:06 🔗 ez ola_norsk: its a bit more involved than that. the first thing is that most peers dont have the kind of bandwidth to match their upload rate with download rate
00:07 🔗 ola_norsk could that be detected?
00:07 🔗 ez everyone needs to seed back at 1:1 or the swarm collapses (this is if we ignore altruists)
00:07 🔗 ez no, its just a general rule of shitty US "broadband"
00:07 🔗 ez you can download a 1080p video at 5-10Mbits, but will have a lot of trouble uploading it back at same rate
00:08 🔗 ola_norsk ah
00:08 🔗 ola_norsk i have only one option :/ either mobile broadband, or fiber :/
00:09 🔗 ez the assymetry itself is not a problem, it just makes the system all that more unstable
00:09 🔗 ez swarming in general only works when the swarms are largely asynchronous. ie you view a view, and then seed it for 2 days
00:09 🔗 ez doesnt really matter what your up bw is
00:09 🔗 ola_norsk could up rate be detected by player though=
00:09 🔗 ola_norsk ?
00:09 🔗 ez what do you mean detected?
00:10 🔗 ola_norsk like when setting uprate in e.g qbittorrent
00:10 🔗 ez sure, anyone can set upload speed to anything they want
00:10 🔗 ola_norsk aye, but setting it too high is not good
00:10 🔗 ez public swarms rely on sort of averaged out altruism. the trouble is the necessary level of altruism doesnt happen even if people *dont* throttle their up bw
00:11 🔗 ez even i the browser uploads full throttle, its not enough, coz the user overwhelmingly closes the tab and stop seeding once they're done watching
00:11 🔗 ola_norsk that's what i mean by 'last resort' source
00:12 🔗 ez yes, theres always a seed. which in case of bitchute, would be overwhelmed by long trail effect of there being many non-functional swarms
00:12 🔗 ola_norsk e.g torrents have 'web sources' ability
00:12 🔗 ez click random videos on bitchute
00:12 🔗 ez you rarely find a swarm
00:13 🔗 ez most are just streamed from a seed
00:13 🔗 ola_norsk aye, i've experienced some bitchute videos does not play
00:13 🔗 ez thats because of the long trail. now for live streaming, p2p works much better, but it aint all sunshine either (with live video you have another problem - latency)
00:15 🔗 ola_norsk what if the player just fell back to the timecode of html5 player, should it drop off?
00:16 🔗 ez huh?
00:16 🔗 ez if theres not enough bw to support video bitrate, doesnt matter if single source or swarm, instant streaming is not possible
00:17 🔗 ez the site becomes just lotsa of 'loading...' animations
00:18 🔗 ola_norsk e.g, when the webtorrent player lost all peers, it dropped to 'regular' html5/flash player, sending the timecode to begin at in the video as e.g url?
00:18 🔗 ez its possible, but silly
00:18 🔗 ez its semantically same as just talking to the seed
00:18 🔗 ola_norsk i blame beer for that :D
00:19 🔗 ez so its simpler just stay connected to the seed
00:19 🔗 ola_norsk weeb seed?
00:19 🔗 ez no, the webrtc one. unfortunately browsers are severely crippled in what they do
00:20 🔗 ola_norsk it does not support http sources?
00:20 🔗 ez theres even no reliable way to take random url and seed it into webrtc.
00:20 🔗 ez in a web browser
00:20 🔗 ez webtorrent is kind of misnomer, its a separate protocol, only for webrtc
00:20 🔗 ez and everything in there must talk webrtc for it to work at all
00:21 🔗 ola_norsk aye, but regular torrent files support 'web/http sources' to be included, do they not=
00:21 🔗 ola_norsk ?
00:21 🔗 ez yes, they support webseeds. again, its semantically same thing
00:22 🔗 ez iirc IA actually actualyl provides both - seed and http source (via same server), so that clients who dont support webseeding (rtorrent) can still see the seeded data
00:22 🔗 ola_norsk there's no way to have that as backfall/last-resort source, in a p2p player?
00:22 🔗 ez why last resort?
00:23 🔗 ola_norsk fallback source i mean
00:23 🔗 ez its used to as much resort as the webseed has bandwidth
00:23 🔗 ola_norsk if there's no peers
00:23 🔗 ez theres always the seed
00:23 🔗 ez the issue is that its not fast enough, thats the whole point of swarming
00:24 🔗 ez ola_norsk: the non-playing videos you see on bitchute
00:24 🔗 ez are those which got dmcad or something to that effect
00:24 🔗 ez for one reason or another, bitchute seedbox dropped it
00:25 🔗 ez and if theres no volunteer to seed it, its dead now
00:26 🔗 ola_norsk i think i'm struggling to explain what i mean. As it is today, all outgoing data from IA videos goes from IA i think. But, barring there's no peers currently watching or listerning that web source; could webtorrent player be employed to negate SOME of that output?
00:26 🔗 ez sure
00:26 🔗 ez but it would cut through only very little of overall traffic
00:27 🔗 ez its not worth the complexity
00:27 🔗 ez again, there are now flashcrowds most of the time
00:27 🔗 ez no flashcrowds, no swarm, no seeds
00:27 🔗 ez s/now/no
00:28 🔗 ola_norsk if there's just one 'viewer' it could fall back to normal viewing of the file. I think that is what i mean
00:28 🔗 ez ola_norsk: it would be even more naive than what bitchute is doing, as IA viewership is very long trail (thers no promotion of popular videos and what not)
00:28 🔗 ez ola_norsk: it *always* "falls back"
00:28 🔗 ola_norsk aye
00:29 🔗 ez generally, the seed just uploads to 8 peers or so in the swarm, at whatever rate it can afford
00:29 🔗 ola_norsk but some items might have simultaneous viewers though
00:29 🔗 ez as long the swarm gets big enough, it becomes self-sustaining
00:29 🔗 ez but theres no reason for the seed to *stop* talking to the swarm
00:29 🔗 ez its really bad idea actually
00:30 🔗 ez ola_norsk: yes, the issue here is that the 'simultaneous viewers' items are too brief
00:31 🔗 ez in overall see of singleton viewers, the rate coincidence is too small for swarms to emerge
00:31 🔗 ez s/see/sea/
00:32 🔗 ez ola_norsk: it should be noted that we dont have bittorrent support in browser, simply because its been lobbied away
00:32 🔗 ez opera tried to do this in 2008 or so, but google stomped it
00:32 🔗 ola_norsk I think that is what i mean by it falling back to 'normal play' ..i'm getting to beered man :D cya tomorrow
00:32 🔗 ez rightly so, because having true swarming in browser would be very dangerous to youtube hegemony
00:33 🔗 ola_norsk i need fucking Freemind to explain what i mean i think, ATM :D
00:33 🔗 ola_norsk skål!
00:33 🔗 ola_norsk has quit IRC (leaving)
00:40 🔗 BlueMaxim has joined #archiveteam-bs
01:31 🔗 godane so i have uploaded 13k items this month so far
01:31 🔗 godane 11k of that is just dtic archive files
01:33 🔗 bithippo has joined #archiveteam-bs
01:47 🔗 RichardG has joined #archiveteam-bs
01:51 🔗 bithippo has quit IRC (My MacBook Air has gone to sleep. ZZZzzz…)
01:51 🔗 RichardG has quit IRC (Remote host closed the connection)
01:52 🔗 RichardG has joined #archiveteam-bs
01:58 🔗 godane SketchCow: https://archive.org/details/@girls_gone_wow
01:58 🔗 godane i figure you will want to make a collection from that
02:09 🔗 tuluu has quit IRC (Quit: No Ping reply in 180 seconds.)
02:12 🔗 tuluu has joined #archiveteam-bs
02:12 🔗 RichardG has quit IRC (Remote host closed the connection)
02:16 🔗 RichardG has joined #archiveteam-bs
02:27 🔗 balrog has quit IRC (Read error: Operation timed out)
02:30 🔗 BlueMaxim has quit IRC (Quit: Leaving)
02:35 🔗 balrog has joined #archiveteam-bs
02:35 🔗 swebb sets mode: +o balrog
02:37 🔗 godane SketchCow: http://webapp1.dlib.indiana.edu/virtual_disk_library/index.cgi/
02:37 🔗 mundus https://www.engadget.com/2017/12/13/tidal-jay-z-financial-trouble/
02:38 🔗 mundus I have 30TB of tidal archived already, but probably not to the standard of AT
02:38 🔗 mundus and it's all stuff that can be found elsewhere
02:58 🔗 kristian_ has quit IRC (Quit: Leaving)
03:12 🔗 sep332 has quit IRC (konversation out)
03:13 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
03:13 🔗 Mateon1 has joined #archiveteam-bs
03:15 🔗 BlueMaxim has joined #archiveteam-bs
04:05 🔗 qw3rty118 has joined #archiveteam-bs
04:12 🔗 qw3rty117 has quit IRC (Read error: Operation timed out)
04:17 🔗 dashcloud has quit IRC (Read error: Operation timed out)
04:21 🔗 dashcloud has joined #archiveteam-bs
04:36 🔗 Pixi has quit IRC (Ping timeout: 255 seconds)
04:39 🔗 Pixi has joined #archiveteam-bs
04:41 🔗 ThisAsYou Could you even release that to IA?
04:50 🔗 du_ has quit IRC (Quit: Page closed)
04:51 🔗 ndiddy has quit IRC ()
05:24 🔗 CoolCanuk has joined #archiveteam-bs
05:35 🔗 Pixi has quit IRC (Ping timeout: 255 seconds)
05:45 🔗 Pixi has joined #archiveteam-bs
05:46 🔗 video_ has joined #archiveteam-bs
05:46 🔗 video_ hi
05:46 🔗 CoolCanuk hi!
05:46 🔗 CoolCanuk You could also try www.archiveteam.org
05:46 🔗 CoolCanuk which should work
05:47 🔗 video_ OK NOW archiveteam.org WORKS WTF
05:47 🔗 CoolCanuk yep
05:47 🔗 CoolCanuk and I wouldnt be surprised if you experience the problem, randomly, again
05:47 🔗 CoolCanuk such an annoying problem.
06:04 🔗 dashcloud has quit IRC (Read error: Connection reset by peer)
06:05 🔗 dashcloud has joined #archiveteam-bs
06:10 🔗 video_ also archiveteam warrior 3 won't start downloading vidme for some reason
06:10 🔗 video_ and when i do it on archiveteam warrior 2 it gives me a deduplicatewarc error
06:12 🔗 video_ wait wrong chat shit
06:26 🔗 ranav has joined #archiveteam-bs
06:27 🔗 ranavalon has quit IRC (Read error: Operation timed out)
06:41 🔗 Ing3b0rg has quit IRC (Read error: Operation timed out)
06:44 🔗 Ing3b0rg has joined #archiveteam-bs
07:09 🔗 SketchCow has quit IRC (Ping timeout: 1212 seconds)
07:28 🔗 Odd0002 has quit IRC (Ping timeout: 260 seconds)
07:34 🔗 Odd0002 has joined #archiveteam-bs
07:41 🔗 Odd0002 has quit IRC (Ping timeout: 260 seconds)
07:45 🔗 Odd0002 has joined #archiveteam-bs
07:53 🔗 CoolCanuk has quit IRC (Quit: Connection closed for inactivity)
08:04 🔗 SketchCow has joined #archiveteam-bs
08:04 🔗 swebb sets mode: +o SketchCow
08:08 🔗 pikhq has quit IRC (Read error: Operation timed out)
08:13 🔗 schbirid has joined #archiveteam-bs
08:37 🔗 video_ has quit IRC (Quit: Page closed)
08:52 🔗 Frogging has quit IRC (Read error: Operation timed out)
08:52 🔗 JAA has quit IRC (Read error: Operation timed out)
08:52 🔗 LastNinja has quit IRC (Read error: Connection reset by peer)
08:53 🔗 Frogging has joined #archiveteam-bs
08:53 🔗 JAA has joined #archiveteam-bs
08:53 🔗 swebb sets mode: +o JAA
08:53 🔗 svchfoo1 sets mode: +o Frogging
09:04 🔗 pikhq has joined #archiveteam-bs
09:48 🔗 zino has quit IRC (Read error: Operation timed out)
10:05 🔗 Sk1d has quit IRC (Ping timeout: 250 seconds)
10:08 🔗 Sk1d has joined #archiveteam-bs
11:10 🔗 kimmer13 has quit IRC (Remote host closed the connection)
11:13 🔗 BlueMaxim has quit IRC (Quit: Leaving)
11:15 🔗 kimmer1 has joined #archiveteam-bs
12:29 🔗 pizzaiolo has joined #archiveteam-bs
13:03 🔗 Soni has quit IRC (Read error: Operation timed out)
13:05 🔗 Soni has joined #archiveteam-bs
13:45 🔗 kimmer1 how much does it cost to maintain AIM service? I would recon that it's like maintaining a service like IRC servers... no ongoing development for AIM is taking place anymore, soon.. hardware and electricity? apparently that is also to expensive thise days
13:46 🔗 kimmer1 phone auto correct..
15:04 🔗 PoorHomie ThisAsYou: technically you can put anything you want on IA. If it gets DMCA'd or anything they just "dark" it, they never delete anything
15:05 🔗 ThisAsYou Oh really? Interesting.
15:05 🔗 ThisAsYou "never delete anything", I like that
15:06 🔗 ThisAsYou kimmer1: I'm guessing a lot of legacy servers that needed upgrading, and they didn't want to put in the work to move to cheap VM's or something
15:07 🔗 PoorHomie The idea being that in 100 years when copyrights, etc are expired, they still have all that stuff and can re-release it
16:31 🔗 godane so i'm at 1121k items
16:31 🔗 godane thats 1,121,884 items right now
16:41 🔗 zino has joined #archiveteam-bs
16:53 🔗 sep332 has joined #archiveteam-bs
17:15 🔗 SketchCow Ops please
17:27 🔗 zino has quit IRC (Read error: Operation timed out)
17:31 🔗 zino has joined #archiveteam-bs
17:50 🔗 jschwart has joined #archiveteam-bs
17:56 🔗 icedice has joined #archiveteam-bs
18:04 🔗 CoolCanuk has joined #archiveteam-bs
18:23 🔗 icedice has quit IRC (Quit: Leaving)
18:26 🔗 icedice has joined #archiveteam-bs
19:02 🔗 astrid has joined #archiveteam-bs
19:02 🔗 swebb sets mode: +o astrid
19:24 🔗 Atom has quit IRC (Read error: Operation timed out)
19:42 🔗 LastNinja has joined #archiveteam-bs
20:02 🔗 cloudfunn has left Leaving
20:24 🔗 ranav has quit IRC (Leaving)
20:30 🔗 dashcloud has quit IRC (Read error: Operation timed out)
20:34 🔗 Pixi has quit IRC (Quit: Pixi)
20:53 🔗 godane Prairie Home Companion : magnet:?xt=urn:btih:12e016aca1e397779b7ddaa00e6669e8c269358a&dn=Prairie%20Home%20Companion
20:53 🔗 godane i don't have the space for it
20:54 🔗 godane its about 45gb
21:02 🔗 godane https://www.theverge.com/2017/12/14/16776154/fcc-net-neutrality-vote-results-rules-repealed
21:04 🔗 godane with that happening we need to doing the librarybox+kiwix+rachel-project+portable wayback machine boxes
21:04 🔗 godane also throw the full debian repo + ted talks into there some how
21:13 🔗 ez or maybe just #archiveteam-politics? :)
21:30 🔗 godane http://www.westernelectric.com/library/historic-news.html
21:30 🔗 godane thats for SketchCow to check if we have all of the WE magazine issues from there
21:40 🔗 Pixi has joined #archiveteam-bs
21:42 🔗 ola_norsk has joined #archiveteam-bs
21:44 🔗 SketchCow JAA: All those "a" files fixed.
21:44 🔗 SketchCow Although of course they represent the remaining items of a pile of overwrites
21:58 🔗 JAA SketchCow: Thank you!
22:10 🔗 icedice2 has joined #archiveteam-bs
22:12 🔗 MRX3 has joined #archiveteam-bs
22:13 🔗 ndiddy has joined #archiveteam-bs
22:13 🔗 icedice has quit IRC (Ping timeout: 250 seconds)
22:15 🔗 icedice has joined #archiveteam-bs
22:17 🔗 MRX3 has quit IRC (Ping timeout: 260 seconds)
22:22 🔗 icedice2 has quit IRC (Ping timeout: 506 seconds)
22:22 🔗 schbirid has quit IRC (Quit: Leaving)
22:22 🔗 SketchCow What's the non-profit thing archive team joined?
22:22 🔗 SketchCow asparagirl put us in it
22:24 🔗 vantec https://opencollective.com/archiveteam/
22:25 🔗 ola_norsk if it official enough that i can tout it on minds.com ?
22:25 🔗 ola_norsk is*
22:27 🔗 * ola_norsk lies to rather pay a small amount amount, to try to make a large number of people donate to shit :)
22:27 🔗 ola_norsk likes*
22:28 🔗 ola_norsk damn spelling is not easy
22:29 🔗 ola_norsk if that is good and legit project, i'd pay to spam it to minds users :)
22:31 🔗 BlueMaxim has joined #archiveteam-bs
22:39 🔗 ola_norsk how are the funds distributed though? "Sponsor an Archive Team coder"
22:40 🔗 ola_norsk and what is meant by "Sponsor an ArchiveBot pipeline" ?
22:40 🔗 CoolCanuk accurate cover photo. lmao. (sucking up all the data) https://usercontent.irccloud-cdn.com/file/ZJuQpUPJ/image.png
22:44 🔗 ola_norsk if there's $40 bucks to be made a month, running an archivebot, sign me up :)
22:44 🔗 * ola_norsk got some scrap pc's collecting dust..
22:44 🔗 SketchCow I'm not aggressively fundraising until after the IA drive
22:45 🔗 ola_norsk aye https://www.minds.com/newsfeed/785667436115402761
22:50 🔗 ola_norsk how about instead there was composed an advertised tweet for the archive.org/donate/ ?
22:50 🔗 ola_norsk (by some more eliquant than myself)
22:57 🔗 jschwart has quit IRC (Quit: Konversation terminated!)
23:01 🔗 ola_norsk though, based on that opencollective page, "Your donation of $40/month will sponsor an entire pipeline server." .. 40USD could do well against my electric bill :)
23:02 🔗 ola_norsk or even 80 or 120..
23:02 🔗 CoolCanuk lol. here's what we have in Ontario for power :P https://usercontent.irccloud-cdn.com/file/q5P3jVUv/image.png
23:03 🔗 CoolCanuk (this is just someone's bill, not an average) but you almost always pay a ton for delivery
23:03 🔗 JAA $40 per month for one pipeline? Whoa, that's expensive.
23:04 🔗 JAA (I pay significantly less than that for all three of mine.)
23:04 🔗 ola_norsk shit, i have a homemade 19" i could refill if it's 40 USD/month per 60GB machine :D
23:05 🔗 ola_norsk rack
23:05 🔗 astrid i think the idea is to pay the cost of hosting it, not a make-money-at-home-just-by-sending-email opportunity
23:06 🔗 ola_norsk so offsite virtual machines then?
23:06 🔗 ola_norsk im just jousting the idea. It's actually pretty cool though
23:07 🔗 Stiletto has quit IRC (Read error: Operation timed out)
23:09 🔗 ola_norsk i'm not sure what the rental of a 60gb shared (vm) machine is even at these days
23:16 🔗 ola_norsk what if instead those were modified to use e.g more than 60gb ? I'm thinking storage would be more priority than system
23:17 🔗 ola_norsk though i'm not sure what datacenters charge the most for
23:19 🔗 ola_norsk e.g instead of two machines at 60gb, there's instead one at 120gb ?
23:28 🔗 ola_norsk anyway, i think 40USD is a bit steep price for a 60GB vps :/
23:28 🔗 astrid yea
23:28 🔗 astrid it's a bit cheaper than that these days
23:29 🔗 ola_norsk it's cool idea though :D
23:33 🔗 ola_norsk for 48 usd even i could rent 4 GB RAM
23:33 🔗 ola_norsk 100 GB SSD-LAGRING
23:33 🔗 ola_norsk 1 TB trafikk
23:34 🔗 ola_norsk and that's just 8 dollars shy of 40 :/
23:36 🔗 ola_norsk (at webhuset.no)..in expensive-as-fuck-Norway :/
23:50 🔗 Atom has joined #archiveteam-bs
23:54 🔗 ola_norsk i'm thinking asking for a qutoe on specified needs would be cheaper. Simply going for any package that delivers 60+ of storage is waste. I doub't archivebots require 4gb of ram, for example.
23:55 🔗 ola_norsk and neither do they reqire 2 cpu's i guess
23:56 🔗 astrid you'd be surprised
23:57 🔗 ola_norsk not if i could see minimal requirements somewhere :D
23:57 🔗 astrid it really depends on the job tbh
23:58 🔗 ola_norsk video encoding etc?
23:59 🔗 astrid christ i remember why i left this channel
23:59 🔗 astrid it's you
23:59 🔗 astrid has left ][
23:59 🔗 ola_norsk :D

irclogger-viewer