#archiveteam-bs 2017-09-30,Sat

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
odemg"It's typically the kind of thing that's a pain to work with in a terminal" this is entirely wrong, the 'terminal' and tools you leverage and can string together inside a terminal give you a VAST flexibility over a dumb and numb gui based app
also fuck windows
[00:01]
Froggingyeah it's hard to give a GUI the same flexibility [00:09]
TBOI vastly prefer having a preference window with fifteen tabs containing radio buttons, fields, checkboxes [00:12]
astridplease [00:12]
TBOYeah, it's superior in ways I care much more about than the flexibility of the linux shell
I love to design UIs.
Since the specifics of a single website sweep can vary so much from another, I'd love a GUI for that
It'd be much faster to change some checkboxes than navigating through a manual building the perfect command, not necessarily knowing at first the options available to me
[00:13]
odemgI just puked in my mouth a little. [00:16]
TBOFiguring the various dependencies/incompatibilities between arguments and options, missings stuff I didn't know I wanted
Haha
Classic elitism
But yeah if you get over yourself you'll learn to love GUIs
Get a CLI for things it's good at. Navigation. Chat. Logs. Low configuration stuff. Things that actually benefit from a shell.
[00:16]
***Soni has quit IRC (Read error: Connection reset by peer) [00:19]
odemgNo I wont, I've been there and short of building your own there are no gui based tools to do half the things I do on a daily basis, I can't even tell if you're a troll at this point honestly your opinion is so far from reality [00:19]
TBOYeah right, a troll
'fcourse
If there's one thing I've learned having the GUI argument over the internet
linux people are the damn worse with this one
I also use linux though.
[00:19]
odemg2 options, do it in shell or wait for a gui tool that may never come. No brainer there buddy, shell. I've been a linux user for 12 years, should I ever have to touch a windows machine I still use command prompt and even when I was running windows daily I still found myself writing my own scripts to do things gui based tools just couldn't [00:22]
TBOnot really a no brainer
I asked this in a bubble that seems to very much like its CLI tools
You probably wouldn't know a good GUI tool since you wouldn't actively search for it
[00:23]
astridcool your jets, both of you [00:24]
TBOno offense with the bubble [00:24]
yipdwthe popularity of console tools is because we have a bunch of one-offs, and with the current state of computing as it is, console is often the path of least resistance. it isn't some religious thing [00:24]
astridi'm going to go out and have a beer, and i encourage you all to do something you find similarly relaxing [00:25]
TBOastrid: timezones :I [00:25]
astridTBO: where are you? [00:25]
***astrid sets mode: +o yipdw [00:26]
TBOFrance
2:30AM
[00:26]
astrid;|
we;lp
[00:26]
***Soni has joined #archiveteam-bs [00:26]
astridmaybe it's bedtime :) [00:26]
TBO2:30 has always been the time for bringing up religious topics D: [00:26]
astridhaha, good point though
anyway. i'm in seattle and it's just after 5pm and i really shouldn't still be at the office, but,
[00:27]
odemgastrid, I'm high as a kite, chill as fook. Also 230am. CLI or Die, I'm out. *Drops mic* [00:28]
***Soni has quit IRC (Ping timeout: 255 seconds)
Soni has joined #archiveteam-bs
[00:37]
TheLovina has joined #archiveteam-bs [00:50]
BlueMaxim has quit IRC (Read error: Connection reset by peer) [01:01]
..... (idle for 24mn)
Frogging[20:12:37] <TBO> I vastly prefer having a preference window with fifteen tabs containing radio buttons, fields, checkboxes [01:25]
TBOya [01:25]
Froggingthere's nothing wrong with that but designing those things and keeping them updated takes a lot of time [01:25]
TBOI also like the fact that menus are implicitly a tree view [01:25]
Froggingyou could design a graphical frontend for youtube-dl :) [01:26]
TBO"i need X option, oh it must be in preferences... video... acceleration... nope, hardware then. There we are"
Instead of "i need X option, man software, try search, nope, other search, nope, okay. *squint* maybe there *scroll scroll scroll* Ah ! Acceleration ! -venable-vacc ? -no-prompt-vacc ? no...."
and occasionally missing something, trying google, but the software is a web spider and you end up looking at pictures of spiders.
I hate spiders
Ah, graphical front ends
[01:26]
***ajshell1 has joined #archiveteam-bs [01:30]
Froggingwell, to be fair, I don't think taking that long list of command line options and putting them into menus would make the process a whole lot easier. you'd still have to go through all of it and find the options you need, and read the documentation to find out what they do [01:30]
TBOYeah, I should. I was thinking about it
There's a whole lot that can be implicit through a well designed GUI
And most importantly, hidden until needed
Description goes in context menus when you hover, for choices you use radio buttons instead or checkboxes conveying if you can use one or more
It shrinks fast. At the cost of the shell. But with a front end you can even export a .sh file
[01:30]
SoulflareI think I did it right? [01:33]
TBOHm ? [01:33]
Soulflareoh wiki edit [01:33]
TBOI don't know
but if you did Git's GUi you did it wrong
[01:33]
SoulflareI didn't edit on github
I use github as pastebin mostly
[01:34]
TBOYeah sorry it was a joke but it went over your head :° [01:35]
Soulflarewhoosh [01:35]
***Soni has quit IRC (Quit: Leaving) [01:49]
Soni has joined #archiveteam-bs [01:55]
......... (idle for 42mn)
BlueMaxim has joined #archiveteam-bs [02:37]
Frogginggit has a GUI? [02:48]
....... (idle for 30mn)
secondWhat do you guys use to organize things? [03:18]
***pizzaiolo has quit IRC (Remote host closed the connection) [03:18]
......... (idle for 44mn)
BlueMaxim has quit IRC (Quit: Leaving) [04:02]
...... (idle for 29mn)
Sk1d has quit IRC (Ping timeout: 194 seconds) [04:31]
Stilett0- has joined #archiveteam-bs
Sk1d has joined #archiveteam-bs
[04:36]
.... (idle for 19mn)
BlueMaxim has joined #archiveteam-bs [04:56]
hook54321second: What kind of things? [05:02]
***Jonimus has quit IRC (Read error: Operation timed out) [05:03]
hook54321In case anyone wants to archive it, the LDS Church is doing their semi-annual General Conference tomorrow and the day after. I think there are various tools to download live streams while it's going. I'm not sure if there are easy ways to save the video viewer chat though. [05:04]
***Jonimus has joined #archiveteam-bs
swebb sets mode: +o Jonimus
[05:07]
........ (idle for 36mn)
PotcFdk has quit IRC (Read error: Operation timed out) [05:43]
PotcFdk has joined #archiveteam-bs [05:53]
....... (idle for 30mn)
kristian_ has joined #archiveteam-bs [06:23]
Petri152 has quit IRC (Read error: Operation timed out)
Petri152 has joined #archiveteam-bs
[06:34]
Ing3b0rg has quit IRC (Ping timeout: 255 seconds)
Ing3b0rg has joined #archiveteam-bs
[06:47]
............ (idle for 55mn)
brayden_ has joined #archiveteam-bs
swebb sets mode: +o brayden_
brayden_ has quit IRC (Client Quit)
brayden has quit IRC (Read error: Operation timed out)
brayden has joined #archiveteam-bs
swebb sets mode: +o brayden
[07:44]
...... (idle for 27mn)
Mateon1 has quit IRC (Ping timeout: 255 seconds)
Mateon1 has joined #archiveteam-bs
schbirid has joined #archiveteam-bs
[08:16]
kristian_ has quit IRC (Quit: Leaving) [08:33]
.... (idle for 16mn)
mls has quit IRC (Quit: leaving) [08:49]
...... (idle for 26mn)
JAALaverne: Yes, electronic program guide data. [09:15]
My Dead Format grab seems to be nearly done. 503k URLs retrieved, 14k left.
My scrapers are almost finished as well. All three-char prefixes have been scraped, four of them are still running because they're very large (and therefore slow).
They discovered 18 additional users since I started the grab. Now 11550 in total.
[09:21]
........................... (idle for 2h14mn)
schbiridwpullmaintenancekickstarterplz [11:38]
***dan- has quit IRC (Ping timeout: 633 seconds) [11:39]
dxrtya [11:39]
schbiridchfoo: would you be willing to work on it if money came?
brb
[11:42]
***schbirid has quit IRC (Quit: Leaving)
dan- has joined #archiveteam-bs
schbirid has joined #archiveteam-bs
[11:44]
trs80 has joined #archiveteam-bs
ajshell1 has quit IRC (Read error: Connection reset by peer)
ajshell1 has joined #archiveteam-bs
[12:01]
REiN^ has quit IRC (Read error: Operation timed out)
REiN^ has joined #archiveteam-bs
[12:11]
BlueMaxim has quit IRC (Quit: Leaving) [12:23]
wp494 has quit IRC (Read error: Connection reset by peer) [12:29]
...... (idle for 26mn)
RichardG has quit IRC (Ping timeout: 250 seconds)
RichardG has joined #archiveteam-bs
[12:55]
.... (idle for 16mn)
Stilett0- has quit IRC () [13:13]
...... (idle for 26mn)
eprillios has quit IRC (Quit: eprillios) [13:39]
eprillios has joined #archiveteam-bs [13:46]
eprillios has quit IRC (Quit: eprillios) [13:56]
.... (idle for 15mn)
eprillios has joined #archiveteam-bs
odemg has quit IRC (Read error: Operation timed out)
[14:11]
..... (idle for 21mn)
odemg has joined #archiveteam-bs [14:35]
.... (idle for 15mn)
icedice has joined #archiveteam-bs [14:50]
...... (idle for 27mn)
hook54321Is there a way to automatically save something onto archive.is every 5 minutes? [15:17]
.... (idle for 17mn)
***TBO has left WeeChat 1.4 [15:34]
....... (idle for 31mn)
Smiley has quit IRC (Read error: Connection reset by peer)
icedice has quit IRC (Read error: Connection reset by peer)
Smiley has joined #archiveteam-bs
[16:05]
........... (idle for 52mn)
schbirid has quit IRC (Read error: Operation timed out) [17:01]
astrid has quit IRC (Read error: Operation timed out)
astrid has joined #archiveteam-bs
swebb sets mode: +o astrid
[17:06]
.... (idle for 19mn)
ranmayoutube-dl never ceases to amaze me
how is it youtube hasn't found a way to block youtube-dl?
or does it mimic a browser THAT perfectly?
[17:25]
....... (idle for 34mn)
***Asparagir has quit IRC (Asparagir)
Asparagir has joined #archiveteam-bs
dd0a13f37 has joined #archiveteam-bs
dd0a13f37 has left
dd0a13f37 has joined #archiveteam-bs
schbirid has joined #archiveteam-bs
[18:00]
dd0a13f37They could, but then youtube-dl would update
and then they'd block it again
It's a game of cat and mouse that would drain more resources for google than youtube-dl
Since youtube-dl would probably get a few new contributors out of spite
And they can't update all the youtube applications in smart tvs, etc easily
Anyone here have vpn/live in a country where people don't care about copyright and know how to use firefox js debugger? It's just too unbearably slow in torbrowser
I've set the breakpoints, but they don't trigger even though the code is executed and everything is painfully slow
About the private trackers (adinbied godane odemg), would it be possible to archive the torrent files and metadata without the actual files?
The categorization could be useful, and you can often programatically map the well-sorted private files to the public files with heuristics (file name, extension, size, scene release lists)
So it's definitely worth saving
[18:06]
***Asparagir has quit IRC (Asparagir) [18:14]
dd0a13f37I asked a website to upload a site archive to archive.org. They said sure, and that they'd upload it and send me a link. Hasn't happened anything for two weeks, what should I do? [18:16]
***Asparagir has joined #archiveteam-bs [18:17]
schbiridask them nicely if you can help [18:17]
dd0a13f37He said that he would ask "his coder" to do it, so I have no idea how I would do that [18:20]
The other ones haven't responded at all, but I know gmail blocks all anonymous emails. Anyone with a clean gmail/hotmail/similar address want to try to and resend my archival requests? [18:26]
***dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [18:33]
eprillios has quit IRC (Quit: eprillios)
dd0a13f37 has joined #archiveteam-bs
eprillios has joined #archiveteam-bs
[18:38]
Frogginganonymous emails? [18:41]
dd0a13f37Emails that don't need a phonenumber to sign up
ie airmail.cc, cock.li
[18:42]
Froggingstupid that mandatory phone numbers for registration is even a thing
it has to be a *mobile* number too and all I have is a landline or VoIP on my mobile
[18:43]
dd0a13f37Don't landlines work? You can ask them to call [18:44]
FroggingI think yahoo wanted to send a text message [18:45]
dd0a13f37Were you scraping some yahoo project and needed an account? [18:45]
Froggingno I wanted an account for other reasons
but it was ridiculous the hoops I had to jump through
[18:46]
dd0a13f37oh ok
https://www.reddit.com/r/DataHoarder/comments/3x3161/pythongithub_mount_a_torrent_as_a_filesystem_if/ this + a huge torrent database would be extremely powerful
You could offload the parts of your data that are well seeded temporarily, e.g. if you're running a large open directory
Well, mostly everyone has a phone#
and the spammers haven't started running phone botnets yet
[18:46]
Froggingit'd be nice if google didn't lie about why they're asking for it. they say it's for "account recovery"
it may be used for that but that isn't why it's *required*
[18:48]
dd0a13f37"It's all for your own security!" [18:49]
Why does the JS debugger in firefox cause extreme lag, even when I blackbox all scripts I don't care about? I set a breakpoint, it doesn't even trigger. What's going on?
I've gotten it to work before, so it's not completely broken
Anyone here have vpn/live in a country where people don't care about copyright? It's just too unbearably slow in torbrowser?
*torbrowser.
[18:56]
Froggingwhat are you trying to do with tor browser?
I think most places don't care enough to watch people's traffic for copyright infringement
[18:59]
dd0a13f37I'm trying to get the pdf files from dn.se
I'm trying to get the pdf files from dn.se
I know how to do it, but you need an encryption key which you need the js debugger to get
dn.se is a major swedish newspaper, so they would care enough to find my IP in the logs
[19:00]
FroggingI've used the firefox JS debugger once or twice and it wasn't unusable. I don't imagine tor browser would be much different in that regard
maybe the script is doing something weird
[19:01]
dd0a13f37Do I need to do anything to get the breakpoints to trigger?
Nah, I've used it on a site that had the exact same script but with different key and different analytics
not as heavy-handed
It goes up to 100% CPU whenever I try to use it
[19:01]
Froggingare you sure noscript isn't interfering?
it's included with the tor browser
[19:03]
dd0a13f37I've disabled it for that site, it works otherwise
if you want I could send you login details in query so you can see for yourself (in torbrowser recommended)
[19:03]
Froggingnah, I don't have time to set that up right now
but when I insert a breakpoint in firefox in the debugger tab, it just works
[19:04]
dd0a13f37ah okay, well I wouldn't recommend it without Tor [19:04]
Froggingto insert a breakpoint you're pressing ctrl+B right?
and it's listed in the sources pane with a checkbox
pressing ctrl+B or clicking the line number, either should work. the line number background should turn blue
(sorry, I'm going after the obvious here)
[19:06]
dd0a13f37Clicking on line number
Yeah, it does, and it works on other sites
It shows up in the breakpoints list
[19:07]
Froggingyou're 100% sure the line in question is actually getting executed?
it
it's possible it just isn't being executed
[19:08]
dd0a13f37If I try it on another website, it works fine
Yes, I don't see why it wouldn't - the line of code generates an encryption key, and it has the encryptino key
and in another identical instance of the same webapp it works fine
[19:09]
Froggingno idea then. I'd probably try moving the breakpoint somewhere higher up in the call stack just to make sure [19:12]
dd0a13f37I got it to work now I think [19:14]
Yeah [19:19]
***SilSte has joined #archiveteam-bs [19:20]
Asparagir has quit IRC (Read error: Operation timed out)
Asparagir has joined #archiveteam-bs
[19:31]
............ (idle for 58mn)
tobbez has quit IRC (Ping timeout: 250 seconds) [20:31]
qwebirc87 has joined #archiveteam-bs
dd0a13f37 has quit IRC (Ping timeout: 268 seconds)
qwebirc87 is now known as dd0a13f37
[20:42]
schbiridhttps://www.unseen64.net/2017/09/29/8-16-bit-games-you-will-never-play-low-price-edition-book-vol-1/ [20:46]
***hook54321 sets mode: +b *!*@wowana.me
hook54321 sets mode: +b *!*@krustykrab.restaurant
hook54321 sets mode: +b *!*@113.108.141.98
hook54321 sets mode: +b *!*@207.226.142.68
hook54321 sets mode: +b *!*@v133-130-110-187.a039.g.tyo1.static.cnode.io
hook54321 sets mode: +b *!*@151.130.201.35.bc.googleusercontent.com
[21:00]
JAAMoving the discussion over from #archivebot: how to archive source code repositories? [21:13]
dd0a13f37Git clone over HTTPS is non-intrusive I think since the packfiles are already generated
And could be done with wpull
For all the warc stuff
[21:14]
JAAYeah, either that or simply taring up the cloned repo. [21:15]
dd0a13f37Right, but it can be integrated with archivebot if done properly [21:16]
JAAThat could be done with both solutions.
But maybe a separate bot would be easier.
[21:18]
hook54321dd0a13f37: On any of the clearnet servers. [21:19]
dd0a13f37So look around for the password or install tor
all you need to do is download browser bundle from torproject.org then set local socks to localhost:9150
or 9050 for regular, non bundle tor
[21:19]
.... (idle for 17mn)
***ola_norsk has joined #archiveteam-bs [21:37]
ola_norsk!ia https://twitter.com/lsarsour
dangit..forgot the command
is there some reason wayback machine seems to struggle with archiving certain twitter account?
or is it just due to high traffic on said accounts?
@hook54321 : I'm guessing you've already updated on Lunduke now being a member of W3C..
[21:39]
hook54321yup
#archivebot
[21:45]
ola_norskthe twitter archived eventually
im guessing it's got certain reason for high "coverage" currently..
[21:46]
***dd0a13f37 has quit IRC (Ping timeout: 268 seconds) [21:53]
godaneso bought 19 tapes today
i got them from savers
[21:57]
***pizzaiolo has joined #archiveteam-bs
qwebirc32 has joined #archiveteam-bs
godane has quit IRC (Read error: Operation timed out)
[21:59]
qwebirc32What is there in the Wii Shop Channel? Virtual Console has been archived many times over and it's all ROMs anyway [22:20]
***qwebirc32 is now known as dd0a13f37 [22:24]
wp494 has joined #archiveteam-bs [22:31]
superkuh has quit IRC (Remote host closed the connection)
superkuh has joined #archiveteam-bs
[22:45]
dd0a13f37https://btdig.com/36ac1d1c556af96099e6b5662a54c11e33c73f5d/wiiware Could someone unpack and see what's inside? Would be much appreciated
Or nevermind, it's too small
[22:55]
........ (idle for 35mn)
***pizzaiolo has quit IRC (pizzaiolo)
pizzaiolo has joined #archiveteam-bs
mkram has joined #archiveteam-bs
pizzaiolo has quit IRC (pizzaiolo)
pizzaiolo has joined #archiveteam-bs
[23:30]
godane has joined #archiveteam-bs
pizzaiolo has quit IRC (Client Quit)
pizzaiolo has joined #archiveteam-bs
dd0a13f37 has quit IRC (Ping timeout: 268 seconds)
mkram has quit IRC (Read error: Connection reset by peer)
mkram has joined #archiveteam-bs
pizzaiolo has quit IRC (Client Quit)
pizzaiolo has joined #archiveteam-bs
[23:40]
pizzaiolo has quit IRC (Quit: pizzaiolo)
godane has quit IRC (Read error: Operation timed out)
[23:55]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)