#archiveteam-bs 2017-10-19,Thu

↑back Search

Time Nickname Message
00:19 🔗 aschmitz has joined #archiveteam-bs
01:07 🔗 Stilett0 has joined #archiveteam-bs
01:11 🔗 Mateon1 has quit IRC (Read error: Operation timed out)
01:20 🔗 robink has joined #archiveteam-bs
01:58 🔗 Stilett0 has quit IRC (Read error: Operation timed out)
02:12 🔗 pizzaiolo has quit IRC (Remote host closed the connection)
02:18 🔗 robink has quit IRC (Read error: Connection reset by peer)
02:20 🔗 robink has joined #archiveteam-bs
02:25 🔗 tuluu_ has quit IRC (Read error: Operation timed out)
02:30 🔗 SilSte has quit IRC (Ping timeout: 492 seconds)
02:31 🔗 SilSte has joined #archiveteam-bs
02:31 🔗 tuluu has joined #archiveteam-bs
02:45 🔗 Stilett0 has joined #archiveteam-bs
02:46 🔗 drumstick has quit IRC (Ping timeout: 255 seconds)
02:59 🔗 Pixi has quit IRC (Ping timeout: 255 seconds)
03:04 🔗 Pixi has joined #archiveteam-bs
03:17 🔗 qw3rty11 has joined #archiveteam-bs
03:22 🔗 qw3rty10 has quit IRC (Read error: Operation timed out)
03:25 🔗 Aoede has quit IRC (Ping timeout: 250 seconds)
03:31 🔗 Aoede has joined #archiveteam-bs
03:31 🔗 Aoede has quit IRC (Connection closed)
03:31 🔗 Aoede has joined #archiveteam-bs
03:32 🔗 Stilett0 is now known as Stiletto
04:09 🔗 Sk1d has quit IRC (Ping timeout: 250 seconds)
04:16 🔗 Sk1d has joined #archiveteam-bs
04:16 🔗 Sk1d has quit IRC (Connection Closed)
04:17 🔗 Sk1d has joined #archiveteam-bs
04:23 🔗 porky has joined #archiveteam-bs
04:42 🔗 Somebody2 Hm, http://archiveteam.org/index.php?title=Textfiles is a blank page -- it probbbably shouldn't be
04:46 🔗 porky I want to save myself to the harddisk for reading later
04:46 🔗 porky mirrors are cool, but I need the files for my personal library
04:46 🔗 Somebody2 try this: https://archive.org/details/textfiles-dot-com-2011
04:47 🔗 Somebody2 specifically, this torrent: https://archive.org/download/textfiles-dot-com-2011/textfiles-dot-com-2011_archive.torrent
04:47 🔗 porky o I downloaded this already
04:47 🔗 Somebody2 Ah, what was missing?
04:48 🔗 porky but is it old already, in 2011, a lot of files have been added since that time?
04:49 🔗 porky I would have fresh ways)
04:49 🔗 porky but if there is not one, I'll download the archives from the site
04:51 🔗 Somebody2 Hm, dig around on archive.org, and please report what you find.
04:51 🔗 Somebody2 I'm not sure how much has been added since 2011, frankly.
04:52 🔗 Asparagir has joined #archiveteam-bs
04:52 🔗 porky Well, that's the problem, it seems, there was a lot added from that time
04:53 🔗 Somebody2 Hm.
04:53 🔗 porky in any case, thanks, buddy, I'll download from the main site, it's good that there is not much work
04:54 🔗 Somebody2 Sure.
04:54 🔗 porky I have one more question
04:54 🔗 porky on another issue
04:56 🔗 porky about Mozilla Addons
04:56 🔗 porky http://www.archiveteam.org/index.php?title=Mozilla_Addons
04:57 🔗 Somebody2 What about?
04:57 🔗 porky Does the status of the project mean that the archiving was canceled?
04:58 🔗 Somebody2 I think we tried grabbing it with ArchiveBot, but it didn't finish. So further effort would be welcomed!
04:59 🔗 porky with Mozilla such a difficult situation, that around the summer of 2018 old addons will be removed from Amo
04:59 🔗 drumstick has joined #archiveteam-bs
05:01 🔗 porky So before the b-day is there a chance that you will have time to save Amo?
05:02 🔗 Somebody2 We includes *you* -- will *you* have time?
05:02 🔗 Somebody2 A good first step would be making a list of them, probalby through the API.
05:03 🔗 porky understand
05:03 🔗 porky i'm trying to save now using offline explorer enterprise
05:04 🔗 porky but this is not very productive
05:04 🔗 Somebody2 What makes it ineffective?
05:06 🔗 porky Well, there are about a million files on the site, it seems that only light themes are almost 500,000
05:06 🔗 Asparagir has quit IRC (Asparagir)
05:08 🔗 Somebody2 AFAIK, themes aren't scheduled to be removed, though.
05:08 🔗 porky firstly slowly save, and has a limit on the number of downloaded files
05:08 🔗 Somebody2 Ah, I see.
05:08 🔗 porky I know, I gave an example that there are a lot of files
05:09 🔗 Somebody2 Are you able to write code yourself?
05:11 🔗 porky no, nfortunately
05:13 🔗 Somebody2 Ah, that does make it more difficult.
05:13 🔗 Mateon1 has joined #archiveteam-bs
05:14 🔗 porky archiveteam has more productive tools
05:16 🔗 Somebody2 Few that don't require at least some programming to get going, though. :-/
05:16 🔗 porky Tell me how I can use this archiveteam tools or how I can help to save addons
05:17 🔗 porky I just at the moment have completely saved almost 900 firefox add-ons, I used scrapbook and unmht add-ons
05:18 🔗 Somebody2 Well, the start would be generating a list of the old-style addons that are supposed to get removed.
05:18 🔗 porky but in terms of time, this is hellish work
05:18 🔗 Somebody2 porky: I'm delighted to hear you've got 900 of them -- please upload them to archive.org!
05:19 🔗 Somebody2 You can create an account at archive.org with any email address, and upload them that way.
05:20 🔗 porky so to join the team you need to be able to write code?
05:20 🔗 Somebody2 No, but to start a new project, it greatly helps.
05:21 🔗 Somebody2 The team is ... rather informal. You can participate by as little as mentioning sites that are in danger of going away in the IRC channel.
05:21 🔗 Somebody2 Or helping to investigate url shortening services so urlteam can scrape them.
05:22 🔗 Somebody2 Or running the ArchiveTeam Warrior, a virtual machine that helps us with bigger projects.
05:23 🔗 Somebody2 Or processing suggestions over in the #archivebot channel, and making sure jobs being worked on there have proper ignore sets applied.
05:23 🔗 porky Well, I understood, Ie for current projects
05:23 🔗 Somebody2 So there are a lot of ways to help that don't require writing code -- but starting new projects is kinda tricky without it.
05:24 🔗 Somebody2 For AMO, it looks like this is the API query to start with: https://addons-server.readthedocs.io/en/latest/topics/api/addons.html#search
05:27 🔗 porky understood
05:33 🔗 porky mozilla thankless cattle)
05:33 🔗 Somebody2 hm
05:35 🔗 porky has quit IRC (Quit: ChatZilla 0.9.92 [Firefox 28.0/20140314220517])
05:47 🔗 kisspunch hmm, i wrote a mozilla addon scraper for quixey, which is now out of business--I doubt they'll send me the code but I can ask
05:47 🔗 Somebody2 kisspunch: might as well ask!
05:47 🔗 Somebody2 I'm about to start grabbing all 839 25-item pages of API results for firefox extensions; so that'll at least get us a list to work from.
05:48 🔗 kisspunch that's most of what you'd get from me anyway, but i asked
05:48 🔗 kisspunch don't expect an answer in any relevant timespan
05:48 🔗 Somebody2 nods
05:49 🔗 kisspunch does anyone have hard data on cold storage bit rot or mechanical lifetimes
05:49 🔗 Somebody2 well it seems to be going rather fast, so that's nice at aleast
05:49 🔗 kisspunch i'm wondering what the lifetime of cold storage hard drives is
05:55 🔗 Somebody2 ok, that finished
05:59 🔗 Somebody2 Here's how I did it, for reference: for n in {1..839}; do curl -L 'https://addons.mozilla.org/api/v3/addons/search?app=firefox&type=extension&sort=created&page='$n | tee results_$n; date; done
06:00 🔗 Somebody2 It's 92MB of results; I'll send them to anyone who asks.
06:05 🔗 Somebody2 And it looks like there are 17,293 (out of the 20,962 total) that are not WebExtensions (and so will be trashed, in theory).
06:05 🔗 Somebody2 which I generated with: jq -r '.results[] | select(.current_version.files[].is_webextension != true)| .url' results_* | wc -l
06:06 🔗 Somebody2 We should probably make a separate channel for this; name suggestions?
06:12 🔗 Somebody2 It looks like the total size is only 4GB.
06:22 🔗 Somebody2 OK, now dowloading them; about 800 downloaded so far; should be done in a day or less.
06:41 🔗 fie has quit IRC (Read error: Operation timed out)
06:52 🔗 fie has joined #archiveteam-bs
06:58 🔗 porky has joined #archiveteam-bs
07:03 🔗 schbirid has joined #archiveteam-bs
07:13 🔗 porky Somebody2 hi, sorry for disappear
07:14 🔗 icedice has joined #archiveteam-bs
07:14 🔗 porky about my addons, I because of the lack of time will not be able to put them on the archive.org
07:15 🔗 porky But I can specifically send them to you via torrent
07:15 🔗 porky for example
07:17 🔗 porky although
07:17 🔗 porky maybe i need to figure it out
07:20 🔗 icedice has quit IRC (Ping timeout: 260 seconds)
07:22 🔗 porky just you can find this application better than me
07:28 🔗 schbirid has quit IRC (Quit: Leaving)
09:04 🔗 porky has quit IRC (Quit: ChatZilla 0.9.92 [Firefox 28.0/20140314220517])
09:55 🔗 swebb has quit IRC (Read error: Operation timed out)
09:55 🔗 swebb has joined #archiveteam-bs
09:56 🔗 svchfoo1 sets mode: +o swebb
09:58 🔗 icedice has joined #archiveteam-bs
10:13 🔗 kepler45 has quit IRC (Quit: Leaving)
10:41 🔗 icedice has quit IRC (Quit: Leaving)
10:42 🔗 pizzaiolo has joined #archiveteam-bs
10:44 🔗 drumstick has quit IRC (Read error: Operation timed out)
10:44 🔗 drumstick has joined #archiveteam-bs
10:52 🔗 icedice has joined #archiveteam-bs
11:10 🔗 Ravenloft has quit IRC (Read error: Operation timed out)
11:30 🔗 icedice has quit IRC (Quit: Leaving)
11:32 🔗 drumstick has quit IRC (Read error: Operation timed out)
12:25 🔗 marvinw is now known as ivan
12:37 🔗 BlueMaxim has quit IRC (Quit: Leaving)
13:08 🔗 schbirid has joined #archiveteam-bs
13:19 🔗 luckcolor has quit IRC (Remote host closed the connection)
13:24 🔗 luckcolor has joined #archiveteam-bs
13:53 🔗 wabu has quit IRC (Read error: Operation timed out)
14:12 🔗 wabu has joined #archiveteam-bs
15:06 🔗 Somebody2 porky: I'd be glad for you to send them to me via a torrent, yes please.
15:08 🔗 Somebody2 I've now downloaded 15,776 mozilla addons; I'll need to figure out why the other ~2,000 didn't come through, and verify the ones that did against their hashes.
15:08 🔗 Somebody2 (and upload the results)
15:30 🔗 pizzaiolo has quit IRC (Read error: Operation timed out)
15:31 🔗 pizzaiolo has joined #archiveteam-bs
15:44 🔗 pizzaiolo has quit IRC (Read error: Operation timed out)
15:45 🔗 pizzaiolo has joined #archiveteam-bs
15:46 🔗 pizzaiolo has quit IRC (Client Quit)
15:46 🔗 pizzaiolo has joined #archiveteam-bs
16:02 🔗 kisspunch Somebody2: please save the metadata page for each plugins too, they're almost useless without metadata
16:02 🔗 kisspunch The search results probably have 80% of the benefit in terms of including the name and short description
16:02 🔗 kisspunch If you kept those
16:05 🔗 godane SketchCow: i'm uploading super bowl 23 to FOS
16:06 🔗 godane it will take awhile so don't touch the Godand VHS Capture for the next day
16:19 🔗 dd0a13f37 has joined #archiveteam-bs
16:19 🔗 dd0a13f37 odemg: the upper limit is 100gb, it will accept larger than that but abort while downloading
16:20 🔗 dd0a13f37 per torrent file i think
16:22 🔗 odemg dd0a13f37, where are you reading that? I just finished a 1.3TB torrent that completed and is now syncing to storage
16:31 🔗 JAA Somebody2: Are you grabbing the previous versions, too?
16:58 🔗 Sanqui shit, pastie.com shut down
16:59 🔗 Sanqui oh, it was pastie.org all alone (which is also down)
17:04 🔗 RichardG has quit IRC (Read error: Connection reset by peer)
17:12 🔗 RichardG has joined #archiveteam-bs
17:56 🔗 pizzaiolo has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Mateon1 has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 SilSte has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 robink has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 atrocity has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 postwix has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 nepeat has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 robogoat has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Odd0002 has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 jspiros has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 ivan has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Yurume has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Frogging has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 trs80 has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Petri152 has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 acridAxid has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 spacegirl has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 mistym has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Igloo has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 JAA has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 SadDM has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 ranma_ has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 ranma has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 Coderjo has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 SynMonger has quit IRC (ny.us.hub irc.colosolutions.net)
17:56 🔗 chfoo has quit IRC (ny.us.hub irc.colosolutions.net)
17:57 🔗 pizzaiolo has joined #archiveteam-bs
17:57 🔗 Mateon1 has joined #archiveteam-bs
17:57 🔗 SilSte has joined #archiveteam-bs
17:57 🔗 robink has joined #archiveteam-bs
17:57 🔗 atrocity has joined #archiveteam-bs
17:57 🔗 postwix has joined #archiveteam-bs
17:57 🔗 nepeat has joined #archiveteam-bs
17:57 🔗 robogoat has joined #archiveteam-bs
17:57 🔗 Odd0002 has joined #archiveteam-bs
17:57 🔗 jspiros has joined #archiveteam-bs
17:57 🔗 ivan has joined #archiveteam-bs
17:57 🔗 Yurume has joined #archiveteam-bs
17:57 🔗 Frogging has joined #archiveteam-bs
17:57 🔗 trs80 has joined #archiveteam-bs
17:57 🔗 Petri152 has joined #archiveteam-bs
17:57 🔗 acridAxid has joined #archiveteam-bs
17:57 🔗 spacegirl has joined #archiveteam-bs
17:57 🔗 mistym has joined #archiveteam-bs
17:57 🔗 Igloo has joined #archiveteam-bs
17:57 🔗 JAA has joined #archiveteam-bs
17:57 🔗 SadDM has joined #archiveteam-bs
17:57 🔗 ranma_ has joined #archiveteam-bs
17:57 🔗 ranma has joined #archiveteam-bs
17:57 🔗 SynMonger has joined #archiveteam-bs
17:57 🔗 chfoo has joined #archiveteam-bs
17:57 🔗 irc.colosolutions.net sets mode: +ooo JAA SadDM chfoo
17:57 🔗 swebb sets mode: +o JAA
17:57 🔗 swebb sets mode: +o SadDM
18:27 🔗 Coderjo has joined #archiveteam-bs
18:28 🔗 dd0a13f37 has quit IRC (Quit: Connection closed for inactivity)
18:37 🔗 icedice has joined #archiveteam-bs
18:50 🔗 Pixi has quit IRC (Quit: Pixi)
18:57 🔗 Pixi has joined #archiveteam-bs
19:26 🔗 pizzaiolo has quit IRC (Ping timeout: 246 seconds)
19:54 🔗 Stiletto has quit IRC (Ping timeout: 250 seconds)
20:03 🔗 icedice has quit IRC (Quit: Leaving)
20:11 🔗 Famicoman has quit IRC (Ping timeout: 260 seconds)
20:38 🔗 Stilett0 has joined #archiveteam-bs
21:03 🔗 Stilett0 has quit IRC (Read error: Operation timed out)
22:11 🔗 BlueMaxim has joined #archiveteam-bs
22:19 🔗 ZexaronS has joined #archiveteam-bs
22:32 🔗 drumstick has joined #archiveteam-bs
23:04 🔗 ZexaronS has quit IRC (se.hub efnet.port80.se)
23:04 🔗 DFJustin has quit IRC (se.hub efnet.port80.se)
23:04 🔗 jsa has quit IRC (se.hub efnet.port80.se)
23:04 🔗 ld1 has quit IRC (se.hub efnet.port80.se)
23:04 🔗 zhongfu has quit IRC (se.hub efnet.port80.se)
23:04 🔗 BartoCH has quit IRC (se.hub efnet.port80.se)
23:04 🔗 c0mpass has quit IRC (se.hub efnet.port80.se)
23:04 🔗 jrwr has quit IRC (se.hub efnet.port80.se)
23:04 🔗 r3c0d3x has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Kaz has quit IRC (se.hub efnet.port80.se)
23:04 🔗 wm_ has quit IRC (se.hub efnet.port80.se)
23:04 🔗 zerkalo has quit IRC (se.hub efnet.port80.se)
23:04 🔗 riking has quit IRC (se.hub efnet.port80.se)
23:04 🔗 kevinr has quit IRC (se.hub efnet.port80.se)
23:04 🔗 trvz has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Kenshin has quit IRC (se.hub efnet.port80.se)
23:04 🔗 HCross2 has quit IRC (se.hub efnet.port80.se)
23:04 🔗 DrasticAc has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Hecatz has quit IRC (se.hub efnet.port80.se)
23:04 🔗 wacky has quit IRC (se.hub efnet.port80.se)
23:04 🔗 tklk has quit IRC (se.hub efnet.port80.se)
23:04 🔗 alfie has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Ctrl-S___ has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Meroje has quit IRC (se.hub efnet.port80.se)
23:04 🔗 ItsYoda has quit IRC (se.hub efnet.port80.se)
23:04 🔗 DedSec has quit IRC (se.hub efnet.port80.se)
23:04 🔗 fallenoak has quit IRC (se.hub efnet.port80.se)
23:04 🔗 johtso has quit IRC (se.hub efnet.port80.se)
23:04 🔗 Muad-Dib has quit IRC (se.hub efnet.port80.se)
23:04 🔗 xarph has quit IRC (se.hub efnet.port80.se)
23:04 🔗 victorbje has quit IRC (se.hub efnet.port80.se)
23:04 🔗 bitspill has quit IRC (se.hub efnet.port80.se)
23:04 🔗 jiphex has quit IRC (se.hub efnet.port80.se)
23:04 🔗 voltagex has quit IRC (se.hub efnet.port80.se)
23:04 🔗 ThisAsYou has quit IRC (se.hub efnet.port80.se)
23:04 🔗 deathy has quit IRC (se.hub efnet.port80.se)
23:04 🔗 alembic has quit IRC (se.hub efnet.port80.se)
23:04 🔗 hook54321 has quit IRC (se.hub efnet.port80.se)
23:04 🔗 JSharp has quit IRC (se.hub efnet.port80.se)
23:04 🔗 floogulin has quit IRC (se.hub efnet.port80.se)
23:04 🔗 octarine has quit IRC (se.hub efnet.port80.se)
23:04 🔗 mattl has quit IRC (se.hub efnet.port80.se)
23:04 🔗 raphidae has quit IRC (se.hub efnet.port80.se)
23:16 🔗 Frogging seems we're a bit splitty today
23:16 🔗 pizzaiolo has joined #archiveteam-bs
23:29 🔗 Kaz has joined #archiveteam-bs

irclogger-viewer