[00:01] "It's typically the kind of thing that's a pain to work with in a terminal" this is entirely wrong, the 'terminal' and tools you leverage and can string together inside a terminal give you a VAST flexibility over a dumb and numb gui based app [00:02] also fuck windows [00:09] yeah it's hard to give a GUI the same flexibility [00:12] I vastly prefer having a preference window with fifteen tabs containing radio buttons, fields, checkboxes [00:12] please [00:13] Yeah, it's superior in ways I care much more about than the flexibility of the linux shell [00:14] I love to design UIs. [00:15] Since the specifics of a single website sweep can vary so much from another, I'd love a GUI for that [00:16] It'd be much faster to change some checkboxes than navigating through a manual building the perfect command, not necessarily knowing at first the options available to me [00:16] I just puked in my mouth a little. [00:16] Figuring the various dependencies/incompatibilities between arguments and options, missings stuff I didn't know I wanted [00:17] Haha [00:17] Classic elitism [00:17] But yeah if you get over yourself you'll learn to love GUIs [00:18] Get a CLI for things it's good at. Navigation. Chat. Logs. Low configuration stuff. Things that actually benefit from a shell. [00:19] *** Soni has quit IRC (Read error: Connection reset by peer) [00:19] No I wont, I've been there and short of building your own there are no gui based tools to do half the things I do on a daily basis, I can't even tell if you're a troll at this point honestly your opinion is so far from reality [00:19] Yeah right, a troll [00:19] 'fcourse [00:20] If there's one thing I've learned having the GUI argument over the internet [00:20] linux people are the damn worse with this one [00:21] I also use linux though. [00:22] 2 options, do it in shell or wait for a gui tool that may never come. No brainer there buddy, shell. I've been a linux user for 12 years, should I ever have to touch a windows machine I still use command prompt and even when I was running windows daily I still found myself writing my own scripts to do things gui based tools just couldn't [00:23] not really a no brainer [00:23] I asked this in a bubble that seems to very much like its CLI tools [00:24] You probably wouldn't know a good GUI tool since you wouldn't actively search for it [00:24] cool your jets, both of you [00:24] no offense with the bubble [00:24] the popularity of console tools is because we have a bunch of one-offs, and with the current state of computing as it is, console is often the path of least resistance. it isn't some religious thing [00:25] i'm going to go out and have a beer, and i encourage you all to do something you find similarly relaxing [00:25] astrid: timezones :I [00:25] TBO: where are you? [00:26] *** astrid sets mode: +o yipdw [00:26] France [00:26] 2:30AM [00:26] ;| [00:26] we;lp [00:26] *** Soni has joined #archiveteam-bs [00:26] maybe it's bedtime :) [00:26] 2:30 has always been the time for bringing up religious topics D: [00:27] haha, good point though [00:27] anyway. i'm in seattle and it's just after 5pm and i really shouldn't still be at the office, but, [00:28] astrid, I'm high as a kite, chill as fook. Also 230am. CLI or Die, I'm out. *Drops mic* [00:37] *** Soni has quit IRC (Ping timeout: 255 seconds) [00:38] *** Soni has joined #archiveteam-bs [00:50] *** TheLovina has joined #archiveteam-bs [01:01] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [01:25] [20:12:37] I vastly prefer having a preference window with fifteen tabs containing radio buttons, fields, checkboxes [01:25] ya [01:25] there's nothing wrong with that but designing those things and keeping them updated takes a lot of time [01:25] I also like the fact that menus are implicitly a tree view [01:26] you could design a graphical frontend for youtube-dl :) [01:26] "i need X option, oh it must be in preferences... video... acceleration... nope, hardware then. There we are" [01:28] Instead of "i need X option, man software, try search, nope, other search, nope, okay. *squint* maybe there *scroll scroll scroll* Ah ! Acceleration ! -venable-vacc ? -no-prompt-vacc ? no...." [01:28] and occasionally missing something, trying google, but the software is a web spider and you end up looking at pictures of spiders. [01:28] I hate spiders [01:29] Ah, graphical front ends [01:30] *** ajshell1 has joined #archiveteam-bs [01:30] well, to be fair, I don't think taking that long list of command line options and putting them into menus would make the process a whole lot easier. you'd still have to go through all of it and find the options you need, and read the documentation to find out what they do [01:30] Yeah, I should. I was thinking about it [01:31] There's a whole lot that can be implicit through a well designed GUI [01:31] And most importantly, hidden until needed [01:32] Description goes in context menus when you hover, for choices you use radio buttons instead or checkboxes conveying if you can use one or more [01:33] It shrinks fast. At the cost of the shell. But with a front end you can even export a .sh file [01:33] I think I did it right? [01:33] Hm ? [01:33] oh wiki edit [01:33] I don't know [01:34] but if you did Git's GUi you did it wrong [01:34] I didn't edit on github [01:34] I use github as pastebin mostly [01:35] Yeah sorry it was a joke but it went over your head :° [01:35] whoosh [01:49] *** Soni has quit IRC (Quit: Leaving) [01:55] *** Soni has joined #archiveteam-bs [02:37] *** BlueMaxim has joined #archiveteam-bs [02:48] git has a GUI? [03:18] What do you guys use to organize things? [03:18] *** pizzaiolo has quit IRC (Remote host closed the connection) [04:02] *** BlueMaxim has quit IRC (Quit: Leaving) [04:31] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:36] *** Stilett0- has joined #archiveteam-bs [04:37] *** Sk1d has joined #archiveteam-bs [04:56] *** BlueMaxim has joined #archiveteam-bs [05:02] second: What kind of things? [05:03] *** Jonimus has quit IRC (Read error: Operation timed out) [05:04] In case anyone wants to archive it, the LDS Church is doing their semi-annual General Conference tomorrow and the day after. I think there are various tools to download live streams while it's going. I'm not sure if there are easy ways to save the video viewer chat though. [05:07] *** Jonimus has joined #archiveteam-bs [05:07] *** swebb sets mode: +o Jonimus [05:43] *** PotcFdk has quit IRC (Read error: Operation timed out) [05:53] *** PotcFdk has joined #archiveteam-bs [06:23] *** kristian_ has joined #archiveteam-bs [06:34] *** Petri152 has quit IRC (Read error: Operation timed out) [06:38] *** Petri152 has joined #archiveteam-bs [06:47] *** Ing3b0rg has quit IRC (Ping timeout: 255 seconds) [06:49] *** Ing3b0rg has joined #archiveteam-bs [07:44] *** brayden_ has joined #archiveteam-bs [07:44] *** swebb sets mode: +o brayden_ [07:44] *** brayden_ has quit IRC (Client Quit) [07:47] *** brayden has quit IRC (Read error: Operation timed out) [07:49] *** brayden has joined #archiveteam-bs [07:49] *** swebb sets mode: +o brayden [08:16] *** Mateon1 has quit IRC (Ping timeout: 255 seconds) [08:16] *** Mateon1 has joined #archiveteam-bs [08:20] *** schbirid has joined #archiveteam-bs [08:33] *** kristian_ has quit IRC (Quit: Leaving) [08:49] *** mls has quit IRC (Quit: leaving) [09:15] Laverne: Yes, electronic program guide data. [09:21] My Dead Format grab seems to be nearly done. 503k URLs retrieved, 14k left. [09:23] My scrapers are almost finished as well. All three-char prefixes have been scraped, four of them are still running because they're very large (and therefore slow). [09:24] They discovered 18 additional users since I started the grab. Now 11550 in total. [11:38] wpullmaintenancekickstarterplz [11:39] *** dan- has quit IRC (Ping timeout: 633 seconds) [11:39] ya [11:42] chfoo: would you be willing to work on it if money came? [11:44] brb [11:44] *** schbirid has quit IRC (Quit: Leaving) [11:45] *** dan- has joined #archiveteam-bs [11:49] *** schbirid has joined #archiveteam-bs [12:01] *** trs80 has joined #archiveteam-bs [12:04] *** ajshell1 has quit IRC (Read error: Connection reset by peer) [12:04] *** ajshell1 has joined #archiveteam-bs [12:11] *** REiN^ has quit IRC (Read error: Operation timed out) [12:13] *** REiN^ has joined #archiveteam-bs [12:23] *** BlueMaxim has quit IRC (Quit: Leaving) [12:29] *** wp494 has quit IRC (Read error: Connection reset by peer) [12:55] *** RichardG has quit IRC (Ping timeout: 250 seconds) [12:57] *** RichardG has joined #archiveteam-bs [13:13] *** Stilett0- has quit IRC () [13:39] *** eprillios has quit IRC (Quit: eprillios) [13:46] *** eprillios has joined #archiveteam-bs [13:56] *** eprillios has quit IRC (Quit: eprillios) [14:11] *** eprillios has joined #archiveteam-bs [14:14] *** odemg has quit IRC (Read error: Operation timed out) [14:35] *** odemg has joined #archiveteam-bs [14:50] *** icedice has joined #archiveteam-bs [15:17] Is there a way to automatically save something onto archive.is every 5 minutes? [15:34] *** TBO has left WeeChat 1.4 [16:05] *** Smiley has quit IRC (Read error: Connection reset by peer) [16:08] *** icedice has quit IRC (Read error: Connection reset by peer) [16:09] *** Smiley has joined #archiveteam-bs [17:01] *** schbirid has quit IRC (Read error: Operation timed out) [17:06] *** astrid has quit IRC (Read error: Operation timed out) [17:06] *** astrid has joined #archiveteam-bs [17:06] *** swebb sets mode: +o astrid [17:25] youtube-dl never ceases to amaze me [17:26] how is it youtube hasn't found a way to block youtube-dl? [17:26] or does it mimic a browser THAT perfectly? [18:00] *** Asparagir has quit IRC (Asparagir) [18:01] *** Asparagir has joined #archiveteam-bs [18:03] *** dd0a13f37 has joined #archiveteam-bs [18:05] *** dd0a13f37 has left [18:05] *** dd0a13f37 has joined #archiveteam-bs [18:06] *** schbirid has joined #archiveteam-bs [18:06] They could, but then youtube-dl would update [18:06] and then they'd block it again [18:06] It's a game of cat and mouse that would drain more resources for google than youtube-dl [18:06] Since youtube-dl would probably get a few new contributors out of spite [18:07] And they can't update all the youtube applications in smart tvs, etc easily [18:08] Anyone here have vpn/live in a country where people don't care about copyright and know how to use firefox js debugger? It's just too unbearably slow in torbrowser [18:09] I've set the breakpoints, but they don't trigger even though the code is executed and everything is painfully slow [18:13] About the private trackers (adinbied godane odemg), would it be possible to archive the torrent files and metadata without the actual files? [18:14] The categorization could be useful, and you can often programatically map the well-sorted private files to the public files with heuristics (file name, extension, size, scene release lists) [18:14] So it's definitely worth saving [18:14] *** Asparagir has quit IRC (Asparagir) [18:16] I asked a website to upload a site archive to archive.org. They said sure, and that they'd upload it and send me a link. Hasn't happened anything for two weeks, what should I do? [18:17] *** Asparagir has joined #archiveteam-bs [18:17] ask them nicely if you can help [18:20] He said that he would ask "his coder" to do it, so I have no idea how I would do that [18:26] The other ones haven't responded at all, but I know gmail blocks all anonymous emails. Anyone with a clean gmail/hotmail/similar address want to try to and resend my archival requests? [18:33] *** dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [18:38] *** eprillios has quit IRC (Quit: eprillios) [18:40] *** dd0a13f37 has joined #archiveteam-bs [18:41] *** eprillios has joined #archiveteam-bs [18:41] anonymous emails? [18:42] Emails that don't need a phonenumber to sign up [18:42] ie airmail.cc, cock.li [18:43] stupid that mandatory phone numbers for registration is even a thing [18:43] it has to be a *mobile* number too and all I have is a landline or VoIP on my mobile [18:44] Don't landlines work? You can ask them to call [18:45] I think yahoo wanted to send a text message [18:45] Were you scraping some yahoo project and needed an account? [18:46] no I wanted an account for other reasons [18:46] but it was ridiculous the hoops I had to jump through [18:46] oh ok [18:46] https://www.reddit.com/r/DataHoarder/comments/3x3161/pythongithub_mount_a_torrent_as_a_filesystem_if/ this + a huge torrent database would be extremely powerful [18:47] You could offload the parts of your data that are well seeded temporarily, e.g. if you're running a large open directory [18:47] Well, mostly everyone has a phone# [18:47] and the spammers haven't started running phone botnets yet [18:48] it'd be nice if google didn't lie about why they're asking for it. they say it's for "account recovery" [18:48] it may be used for that but that isn't why it's *required* [18:49] "It's all for your own security!" [18:56] Why does the JS debugger in firefox cause extreme lag, even when I blackbox all scripts I don't care about? I set a breakpoint, it doesn't even trigger. What's going on? [18:56] I've gotten it to work before, so it's not completely broken [18:56] Anyone here have vpn/live in a country where people don't care about copyright? It's just too unbearably slow in torbrowser? [18:56] *torbrowser. [18:59] what are you trying to do with tor browser? [18:59] I think most places don't care enough to watch people's traffic for copyright infringement [19:00] I'm trying to get the pdf files from dn.se [19:00] I'm trying to get the pdf files from dn.se [19:00] I know how to do it, but you need an encryption key which you need the js debugger to get [19:01] dn.se is a major swedish newspaper, so they would care enough to find my IP in the logs [19:01] I've used the firefox JS debugger once or twice and it wasn't unusable. I don't imagine tor browser would be much different in that regard [19:01] maybe the script is doing something weird [19:01] Do I need to do anything to get the breakpoints to trigger? [19:02] Nah, I've used it on a site that had the exact same script but with different key and different analytics [19:02] not as heavy-handed [19:02] It goes up to 100% CPU whenever I try to use it [19:03] are you sure noscript isn't interfering? [19:03] it's included with the tor browser [19:03] I've disabled it for that site, it works otherwise [19:04] if you want I could send you login details in query so you can see for yourself (in torbrowser recommended) [19:04] nah, I don't have time to set that up right now [19:04] but when I insert a breakpoint in firefox in the debugger tab, it just works [19:04] ah okay, well I wouldn't recommend it without Tor [19:06] to insert a breakpoint you're pressing ctrl+B right? [19:06] and it's listed in the sources pane with a checkbox [19:07] pressing ctrl+B or clicking the line number, either should work. the line number background should turn blue [19:07] (sorry, I'm going after the obvious here) [19:07] Clicking on line number [19:08] Yeah, it does, and it works on other sites [19:08] It shows up in the breakpoints list [19:08] you're 100% sure the line in question is actually getting executed? [19:09] it [19:09] it's possible it just isn't being executed [19:09] If I try it on another website, it works fine [19:09] Yes, I don't see why it wouldn't - the line of code generates an encryption key, and it has the encryptino key [19:10] and in another identical instance of the same webapp it works fine [19:12] no idea then. I'd probably try moving the breakpoint somewhere higher up in the call stack just to make sure [19:14] I got it to work now I think [19:19] Yeah [19:20] *** SilSte has joined #archiveteam-bs [19:31] *** Asparagir has quit IRC (Read error: Operation timed out) [19:33] *** Asparagir has joined #archiveteam-bs [20:31] *** tobbez has quit IRC (Ping timeout: 250 seconds) [20:42] *** qwebirc87 has joined #archiveteam-bs [20:45] *** dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [20:46] *** qwebirc87 is now known as dd0a13f37 [20:46] https://www.unseen64.net/2017/09/29/8-16-bit-games-you-will-never-play-low-price-edition-book-vol-1/ [21:00] *** hook54321 sets mode: +b *!*@wowana.me [21:00] *** hook54321 sets mode: +b *!*@krustykrab.restaurant [21:01] *** hook54321 sets mode: +b *!*@113.108.141.98 [21:01] *** hook54321 sets mode: +b *!*@207.226.142.68 [21:02] *** hook54321 sets mode: +b *!*@v133-130-110-187.a039.g.tyo1.static.cnode.io [21:02] *** hook54321 sets mode: +b *!*@151.130.201.35.bc.googleusercontent.com [21:13] Moving the discussion over from #archivebot: how to archive source code repositories? [21:14] Git clone over HTTPS is non-intrusive I think since the packfiles are already generated [21:14] And could be done with wpull [21:14] For all the warc stuff [21:15] Yeah, either that or simply taring up the cloned repo. [21:16] Right, but it can be integrated with archivebot if done properly [21:18] That could be done with both solutions. [21:18] But maybe a separate bot would be easier. [21:19] dd0a13f37: On any of the clearnet servers. [21:19] So look around for the password or install tor [21:20] all you need to do is download browser bundle from torproject.org then set local socks to localhost:9150 [21:20] or 9050 for regular, non bundle tor [21:37] *** ola_norsk has joined #archiveteam-bs [21:39] !ia https://twitter.com/lsarsour [21:40] dangit..forgot the command [21:41] is there some reason wayback machine seems to struggle with archiving certain twitter account? [21:42] or is it just due to high traffic on said accounts? [21:45] @hook54321 : I'm guessing you've already updated on Lunduke now being a member of W3C.. [21:45] yup [21:45] #archivebot [21:46] the twitter archived eventually [21:47] im guessing it's got certain reason for high "coverage" currently.. [21:53] *** dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [21:57] so bought 19 tapes today [21:57] i got them from savers [21:59] *** pizzaiolo has joined #archiveteam-bs [22:02] *** qwebirc32 has joined #archiveteam-bs [22:06] *** godane has quit IRC (Read error: Operation timed out) [22:20] What is there in the Wii Shop Channel? Virtual Console has been archived many times over and it's all ROMs anyway [22:24] *** qwebirc32 is now known as dd0a13f37 [22:31] *** wp494 has joined #archiveteam-bs [22:45] *** superkuh has quit IRC (Remote host closed the connection) [22:47] *** superkuh has joined #archiveteam-bs [22:55] https://btdig.com/36ac1d1c556af96099e6b5662a54c11e33c73f5d/wiiware Could someone unpack and see what's inside? Would be much appreciated [22:55] Or nevermind, it's too small [23:30] *** pizzaiolo has quit IRC (pizzaiolo) [23:31] *** pizzaiolo has joined #archiveteam-bs [23:33] *** mkram has joined #archiveteam-bs [23:35] *** pizzaiolo has quit IRC (pizzaiolo) [23:35] *** pizzaiolo has joined #archiveteam-bs [23:40] *** godane has joined #archiveteam-bs [23:40] *** pizzaiolo has quit IRC (Client Quit) [23:41] *** pizzaiolo has joined #archiveteam-bs [23:41] *** dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [23:42] *** mkram has quit IRC (Read error: Connection reset by peer) [23:42] *** mkram has joined #archiveteam-bs [23:45] *** pizzaiolo has quit IRC (Client Quit) [23:45] *** pizzaiolo has joined #archiveteam-bs [23:55] *** pizzaiolo has quit IRC (Quit: pizzaiolo) [23:58] *** godane has quit IRC (Read error: Operation timed out)