[00:19] *** aschmitz has joined #archiveteam-bs [01:07] *** Stilett0 has joined #archiveteam-bs [01:11] *** Mateon1 has quit IRC (Read error: Operation timed out) [01:20] *** robink has joined #archiveteam-bs [01:58] *** Stilett0 has quit IRC (Read error: Operation timed out) [02:12] *** pizzaiolo has quit IRC (Remote host closed the connection) [02:18] *** robink has quit IRC (Read error: Connection reset by peer) [02:20] *** robink has joined #archiveteam-bs [02:25] *** tuluu_ has quit IRC (Read error: Operation timed out) [02:30] *** SilSte has quit IRC (Ping timeout: 492 seconds) [02:31] *** SilSte has joined #archiveteam-bs [02:31] *** tuluu has joined #archiveteam-bs [02:45] *** Stilett0 has joined #archiveteam-bs [02:46] *** drumstick has quit IRC (Ping timeout: 255 seconds) [02:59] *** Pixi has quit IRC (Ping timeout: 255 seconds) [03:04] *** Pixi has joined #archiveteam-bs [03:17] *** qw3rty11 has joined #archiveteam-bs [03:22] *** qw3rty10 has quit IRC (Read error: Operation timed out) [03:25] *** Aoede has quit IRC (Ping timeout: 250 seconds) [03:31] *** Aoede has joined #archiveteam-bs [03:31] *** Aoede has quit IRC (Connection closed) [03:31] *** Aoede has joined #archiveteam-bs [03:32] *** Stilett0 is now known as Stiletto [04:09] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:16] *** Sk1d has joined #archiveteam-bs [04:16] *** Sk1d has quit IRC (Connection Closed) [04:17] *** Sk1d has joined #archiveteam-bs [04:23] *** porky has joined #archiveteam-bs [04:42] Hm, http://archiveteam.org/index.php?title=Textfiles is a blank page -- it probbbably shouldn't be [04:46] I want to save myself to the harddisk for reading later [04:46] mirrors are cool, but I need the files for my personal library [04:46] try this: https://archive.org/details/textfiles-dot-com-2011 [04:47] specifically, this torrent: https://archive.org/download/textfiles-dot-com-2011/textfiles-dot-com-2011_archive.torrent [04:47] o I downloaded this already [04:47] Ah, what was missing? [04:48] but is it old already, in 2011, a lot of files have been added since that time? [04:49] I would have fresh ways) [04:49] but if there is not one, I'll download the archives from the site [04:51] Hm, dig around on archive.org, and please report what you find. [04:51] I'm not sure how much has been added since 2011, frankly. [04:52] *** Asparagir has joined #archiveteam-bs [04:52] Well, that's the problem, it seems, there was a lot added from that time [04:53] Hm. [04:53] in any case, thanks, buddy, I'll download from the main site, it's good that there is not much work [04:54] Sure. [04:54] I have one more question [04:54] on another issue [04:56] about Mozilla Addons [04:56] http://www.archiveteam.org/index.php?title=Mozilla_Addons [04:57] What about? [04:57] Does the status of the project mean that the archiving was canceled? [04:58] I think we tried grabbing it with ArchiveBot, but it didn't finish. So further effort would be welcomed! [04:59] with Mozilla such a difficult situation, that around the summer of 2018 old addons will be removed from Amo [04:59] *** drumstick has joined #archiveteam-bs [05:01] So before the b-day is there a chance that you will have time to save Amo? [05:02] We includes *you* -- will *you* have time? [05:02] A good first step would be making a list of them, probalby through the API. [05:03] understand [05:03] i'm trying to save now using offline explorer enterprise [05:04] but this is not very productive [05:04] What makes it ineffective? [05:06] Well, there are about a million files on the site, it seems that only light themes are almost 500,000 [05:06] *** Asparagir has quit IRC (Asparagir) [05:08] AFAIK, themes aren't scheduled to be removed, though. [05:08] firstly slowly save, and has a limit on the number of downloaded files [05:08] Ah, I see. [05:08] I know, I gave an example that there are a lot of files [05:09] Are you able to write code yourself? [05:11] no, nfortunately [05:13] Ah, that does make it more difficult. [05:13] *** Mateon1 has joined #archiveteam-bs [05:14] archiveteam has more productive tools [05:16] Few that don't require at least some programming to get going, though. :-/ [05:16] Tell me how I can use this archiveteam tools or how I can help to save addons [05:17] I just at the moment have completely saved almost 900 firefox add-ons, I used scrapbook and unmht add-ons [05:18] Well, the start would be generating a list of the old-style addons that are supposed to get removed. [05:18] but in terms of time, this is hellish work [05:18] porky: I'm delighted to hear you've got 900 of them -- please upload them to archive.org! [05:19] You can create an account at archive.org with any email address, and upload them that way. [05:20] so to join the team you need to be able to write code? [05:20] No, but to start a new project, it greatly helps. [05:21] The team is ... rather informal. You can participate by as little as mentioning sites that are in danger of going away in the IRC channel. [05:21] Or helping to investigate url shortening services so urlteam can scrape them. [05:22] Or running the ArchiveTeam Warrior, a virtual machine that helps us with bigger projects. [05:23] Or processing suggestions over in the #archivebot channel, and making sure jobs being worked on there have proper ignore sets applied. [05:23] Well, I understood, Ie for current projects [05:23] So there are a lot of ways to help that don't require writing code -- but starting new projects is kinda tricky without it. [05:24] For AMO, it looks like this is the API query to start with: https://addons-server.readthedocs.io/en/latest/topics/api/addons.html#search [05:27] understood [05:33] mozilla thankless cattle) [05:33] hm [05:35] *** porky has quit IRC (Quit: ChatZilla 0.9.92 [Firefox 28.0/20140314220517]) [05:47] hmm, i wrote a mozilla addon scraper for quixey, which is now out of business--I doubt they'll send me the code but I can ask [05:47] kisspunch: might as well ask! [05:47] I'm about to start grabbing all 839 25-item pages of API results for firefox extensions; so that'll at least get us a list to work from. [05:48] that's most of what you'd get from me anyway, but i asked [05:48] don't expect an answer in any relevant timespan [05:48] nods [05:49] does anyone have hard data on cold storage bit rot or mechanical lifetimes [05:49] well it seems to be going rather fast, so that's nice at aleast [05:49] i'm wondering what the lifetime of cold storage hard drives is [05:55] ok, that finished [05:59] Here's how I did it, for reference: for n in {1..839}; do curl -L 'https://addons.mozilla.org/api/v3/addons/search?app=firefox&type=extension&sort=created&page='$n | tee results_$n; date; done [06:00] It's 92MB of results; I'll send them to anyone who asks. [06:05] And it looks like there are 17,293 (out of the 20,962 total) that are not WebExtensions (and so will be trashed, in theory). [06:05] which I generated with: jq -r '.results[] | select(.current_version.files[].is_webextension != true)| .url' results_* | wc -l [06:06] We should probably make a separate channel for this; name suggestions? [06:12] It looks like the total size is only 4GB. [06:22] OK, now dowloading them; about 800 downloaded so far; should be done in a day or less. [06:41] *** fie has quit IRC (Read error: Operation timed out) [06:52] *** fie has joined #archiveteam-bs [06:58] *** porky has joined #archiveteam-bs [07:03] *** schbirid has joined #archiveteam-bs [07:13] Somebody2 hi, sorry for disappear [07:14] *** icedice has joined #archiveteam-bs [07:14] about my addons, I because of the lack of time will not be able to put them on the archive.org [07:15] But I can specifically send them to you via torrent [07:15] for example [07:17] although [07:17] maybe i need to figure it out [07:20] *** icedice has quit IRC (Ping timeout: 260 seconds) [07:22] just you can find this application better than me [07:28] *** schbirid has quit IRC (Quit: Leaving) [09:04] *** porky has quit IRC (Quit: ChatZilla 0.9.92 [Firefox 28.0/20140314220517]) [09:55] *** swebb has quit IRC (Read error: Operation timed out) [09:55] *** swebb has joined #archiveteam-bs [09:56] *** svchfoo1 sets mode: +o swebb [09:58] *** icedice has joined #archiveteam-bs [10:13] *** kepler45 has quit IRC (Quit: Leaving) [10:41] *** icedice has quit IRC (Quit: Leaving) [10:42] *** pizzaiolo has joined #archiveteam-bs [10:44] *** drumstick has quit IRC (Read error: Operation timed out) [10:44] *** drumstick has joined #archiveteam-bs [10:52] *** icedice has joined #archiveteam-bs [11:10] *** Ravenloft has quit IRC (Read error: Operation timed out) [11:30] *** icedice has quit IRC (Quit: Leaving) [11:32] *** drumstick has quit IRC (Read error: Operation timed out) [12:25] *** marvinw is now known as ivan [12:37] *** BlueMaxim has quit IRC (Quit: Leaving) [13:08] *** schbirid has joined #archiveteam-bs [13:19] *** luckcolor has quit IRC (Remote host closed the connection) [13:24] *** luckcolor has joined #archiveteam-bs [13:53] *** wabu has quit IRC (Read error: Operation timed out) [14:12] *** wabu has joined #archiveteam-bs [15:06] porky: I'd be glad for you to send them to me via a torrent, yes please. [15:08] I've now downloaded 15,776 mozilla addons; I'll need to figure out why the other ~2,000 didn't come through, and verify the ones that did against their hashes. [15:08] (and upload the results) [15:30] *** pizzaiolo has quit IRC (Read error: Operation timed out) [15:31] *** pizzaiolo has joined #archiveteam-bs [15:44] *** pizzaiolo has quit IRC (Read error: Operation timed out) [15:45] *** pizzaiolo has joined #archiveteam-bs [15:46] *** pizzaiolo has quit IRC (Client Quit) [15:46] *** pizzaiolo has joined #archiveteam-bs [16:02] Somebody2: please save the metadata page for each plugins too, they're almost useless without metadata [16:02] The search results probably have 80% of the benefit in terms of including the name and short description [16:02] If you kept those [16:05] SketchCow: i'm uploading super bowl 23 to FOS [16:06] it will take awhile so don't touch the Godand VHS Capture for the next day [16:19] *** dd0a13f37 has joined #archiveteam-bs [16:19] odemg: the upper limit is 100gb, it will accept larger than that but abort while downloading [16:20] per torrent file i think [16:22] dd0a13f37, where are you reading that? I just finished a 1.3TB torrent that completed and is now syncing to storage [16:31] Somebody2: Are you grabbing the previous versions, too? [16:58] shit, pastie.com shut down [16:59] oh, it was pastie.org all alone (which is also down) [17:04] *** RichardG has quit IRC (Read error: Connection reset by peer) [17:12] *** RichardG has joined #archiveteam-bs [17:56] *** pizzaiolo has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Mateon1 has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** SilSte has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** robink has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** atrocity has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** postwix has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** nepeat has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** robogoat has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Odd0002 has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** jspiros has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** ivan has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Yurume has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Frogging has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** trs80 has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Petri152 has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** acridAxid has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** spacegirl has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** mistym has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Igloo has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** JAA has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** SadDM has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** ranma_ has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** ranma has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** Coderjo has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** SynMonger has quit IRC (ny.us.hub irc.colosolutions.net) [17:56] *** chfoo has quit IRC (ny.us.hub irc.colosolutions.net) [17:57] *** pizzaiolo has joined #archiveteam-bs [17:57] *** Mateon1 has joined #archiveteam-bs [17:57] *** SilSte has joined #archiveteam-bs [17:57] *** robink has joined #archiveteam-bs [17:57] *** atrocity has joined #archiveteam-bs [17:57] *** postwix has joined #archiveteam-bs [17:57] *** nepeat has joined #archiveteam-bs [17:57] *** robogoat has joined #archiveteam-bs [17:57] *** Odd0002 has joined #archiveteam-bs [17:57] *** jspiros has joined #archiveteam-bs [17:57] *** ivan has joined #archiveteam-bs [17:57] *** Yurume has joined #archiveteam-bs [17:57] *** Frogging has joined #archiveteam-bs [17:57] *** trs80 has joined #archiveteam-bs [17:57] *** Petri152 has joined #archiveteam-bs [17:57] *** acridAxid has joined #archiveteam-bs [17:57] *** spacegirl has joined #archiveteam-bs [17:57] *** mistym has joined #archiveteam-bs [17:57] *** Igloo has joined #archiveteam-bs [17:57] *** JAA has joined #archiveteam-bs [17:57] *** SadDM has joined #archiveteam-bs [17:57] *** ranma_ has joined #archiveteam-bs [17:57] *** ranma has joined #archiveteam-bs [17:57] *** SynMonger has joined #archiveteam-bs [17:57] *** chfoo has joined #archiveteam-bs [17:57] *** irc.colosolutions.net sets mode: +ooo JAA SadDM chfoo [17:57] *** swebb sets mode: +o JAA [17:57] *** swebb sets mode: +o SadDM [18:27] *** Coderjo has joined #archiveteam-bs [18:28] *** dd0a13f37 has quit IRC (Quit: Connection closed for inactivity) [18:37] *** icedice has joined #archiveteam-bs [18:50] *** Pixi has quit IRC (Quit: Pixi) [18:57] *** Pixi has joined #archiveteam-bs [19:26] *** pizzaiolo has quit IRC (Ping timeout: 246 seconds) [19:54] *** Stiletto has quit IRC (Ping timeout: 250 seconds) [20:03] *** icedice has quit IRC (Quit: Leaving) [20:11] *** Famicoman has quit IRC (Ping timeout: 260 seconds) [20:38] *** Stilett0 has joined #archiveteam-bs [21:03] *** Stilett0 has quit IRC (Read error: Operation timed out) [22:11] *** BlueMaxim has joined #archiveteam-bs [22:19] *** ZexaronS has joined #archiveteam-bs [22:32] *** drumstick has joined #archiveteam-bs [23:04] *** ZexaronS has quit IRC (se.hub efnet.port80.se) [23:04] *** DFJustin has quit IRC (se.hub efnet.port80.se) [23:04] *** jsa has quit IRC (se.hub efnet.port80.se) [23:04] *** ld1 has quit IRC (se.hub efnet.port80.se) [23:04] *** zhongfu has quit IRC (se.hub efnet.port80.se) [23:04] *** BartoCH has quit IRC (se.hub efnet.port80.se) [23:04] *** c0mpass has quit IRC (se.hub efnet.port80.se) [23:04] *** jrwr has quit IRC (se.hub efnet.port80.se) [23:04] *** r3c0d3x has quit IRC (se.hub efnet.port80.se) [23:04] *** Kaz has quit IRC (se.hub efnet.port80.se) [23:04] *** wm_ has quit IRC (se.hub efnet.port80.se) [23:04] *** zerkalo has quit IRC (se.hub efnet.port80.se) [23:04] *** riking has quit IRC (se.hub efnet.port80.se) [23:04] *** kevinr has quit IRC (se.hub efnet.port80.se) [23:04] *** trvz has quit IRC (se.hub efnet.port80.se) [23:04] *** Kenshin has quit IRC (se.hub efnet.port80.se) [23:04] *** HCross2 has quit IRC (se.hub efnet.port80.se) [23:04] *** DrasticAc has quit IRC (se.hub efnet.port80.se) [23:04] *** Hecatz has quit IRC (se.hub efnet.port80.se) [23:04] *** wacky has quit IRC (se.hub efnet.port80.se) [23:04] *** tklk has quit IRC (se.hub efnet.port80.se) [23:04] *** alfie has quit IRC (se.hub efnet.port80.se) [23:04] *** Ctrl-S___ has quit IRC (se.hub efnet.port80.se) [23:04] *** Meroje has quit IRC (se.hub efnet.port80.se) [23:04] *** ItsYoda has quit IRC (se.hub efnet.port80.se) [23:04] *** DedSec has quit IRC (se.hub efnet.port80.se) [23:04] *** fallenoak has quit IRC (se.hub efnet.port80.se) [23:04] *** johtso has quit IRC (se.hub efnet.port80.se) [23:04] *** Muad-Dib has quit IRC (se.hub efnet.port80.se) [23:04] *** xarph has quit IRC (se.hub efnet.port80.se) [23:04] *** victorbje has quit IRC (se.hub efnet.port80.se) [23:04] *** bitspill has quit IRC (se.hub efnet.port80.se) [23:04] *** jiphex has quit IRC (se.hub efnet.port80.se) [23:04] *** voltagex has quit IRC (se.hub efnet.port80.se) [23:04] *** ThisAsYou has quit IRC (se.hub efnet.port80.se) [23:04] *** deathy has quit IRC (se.hub efnet.port80.se) [23:04] *** alembic has quit IRC (se.hub efnet.port80.se) [23:04] *** hook54321 has quit IRC (se.hub efnet.port80.se) [23:04] *** JSharp has quit IRC (se.hub efnet.port80.se) [23:04] *** floogulin has quit IRC (se.hub efnet.port80.se) [23:04] *** octarine has quit IRC (se.hub efnet.port80.se) [23:04] *** mattl has quit IRC (se.hub efnet.port80.se) [23:04] *** raphidae has quit IRC (se.hub efnet.port80.se) [23:16] seems we're a bit splitty today [23:16] *** pizzaiolo has joined #archiveteam-bs [23:29] *** Kaz has joined #archiveteam-bs