#archiveteam 2018-02-23,Fri

↑back Search

Time Nickname Message
00:02 πŸ”— dashcloud has joined #archiveteam
00:11 πŸ”— RichardG has quit IRC (Read error: Connection reset by peer)
00:12 πŸ”— RichardG has joined #archiveteam
00:43 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
00:48 πŸ”— dashcloud has joined #archiveteam
01:07 πŸ”— WubTheCap has joined #archiveteam
01:09 πŸ”— muramasa has joined #archiveteam
02:15 πŸ”— bitBaron has quit IRC (Quit: Bye!)
02:19 πŸ”— Odd0002 has quit IRC (Ping timeout: 260 seconds)
02:25 πŸ”— Odd0002 has joined #archiveteam
02:46 πŸ”— yuitimoth has quit IRC (Ping timeout: 250 seconds)
03:40 πŸ”— nightpool has joined #archiveteam
03:58 πŸ”— muramasa has quit IRC (Read error: Connection reset by peer)
03:58 πŸ”— muramasa has joined #archiveteam
04:02 πŸ”— espes__ has quit IRC (Ping timeout: 252 seconds)
04:02 πŸ”— espes__ has joined #archiveteam
04:06 πŸ”— djbeadle has joined #archiveteam
04:20 πŸ”— muramasa has quit IRC (Read error: Connection reset by peer)
04:38 πŸ”— qw3rty111 has joined #archiveteam
04:44 πŸ”— qw3rty119 has quit IRC (Read error: Operation timed out)
05:03 πŸ”— octothorp has quit IRC (Remote host closed the connection)
05:04 πŸ”— octothorp has joined #archiveteam
05:11 πŸ”— muramasa has joined #archiveteam
05:31 πŸ”— ivan has quit IRC (Leaving)
05:33 πŸ”— ivan has joined #archiveteam
05:37 πŸ”— djbeadle has quit IRC (My MacBook has gone to sleep.)
05:41 πŸ”— Jens has quit IRC (Remote host closed the connection)
05:42 πŸ”— Jens has joined #archiveteam
05:46 πŸ”— rsznick has joined #archiveteam
05:47 πŸ”— rsznik has quit IRC (Read error: Operation timed out)
05:47 πŸ”— fie has joined #archiveteam
06:18 πŸ”— RichardG has quit IRC (Ping timeout: 250 seconds)
06:33 πŸ”— bithippo has joined #archiveteam
07:01 πŸ”— zyphlar_ has joined #archiveteam
07:06 πŸ”— bithippo has quit IRC (Quit: Page closed)
07:37 πŸ”— bwn has quit IRC (Read error: Operation timed out)
08:04 πŸ”— SketchCow https://github.com/N0taN3rd/Squidwarc
08:04 πŸ”— SketchCow Anyone want to check out, report back
08:06 πŸ”— bwn has joined #archiveteam
08:15 πŸ”— PurpleSym Uh, there’s chromebot in #archivebot.
08:19 πŸ”— SketchCow Yes
08:19 πŸ”— SketchCow And does this have different features, etc
08:25 πŸ”— PurpleSym chromebot currently lacks support for recursive crawls. squidwarc has no IRC bot (config file based) and no custom behavior scripts (i.e. JavaScript injected into the page to perform some action).
08:28 πŸ”— PurpleSym Looks like they are using the same interface as chromebot to capture network requests (no proxy).
08:32 πŸ”— Mateon1 has quit IRC (Ping timeout: 250 seconds)
08:32 πŸ”— Mateon1 has joined #archiveteam
08:32 πŸ”— Mateon1 has quit IRC (Connection closed)
08:48 πŸ”— Ctrl has joined #archiveteam
09:01 πŸ”— atomotic has joined #archiveteam
09:09 πŸ”— schbirid has joined #archiveteam
09:37 πŸ”— JAA ... which I still think is not the right way to tackle it.
10:17 πŸ”— z00nx has quit IRC (Ping timeout: 252 seconds)
10:17 πŸ”— mr_archiv has quit IRC (Ping timeout: 252 seconds)
10:23 πŸ”— mr_archiv has joined #archiveteam
10:23 πŸ”— z00nx has joined #archiveteam
10:58 πŸ”— atomotic has quit IRC (Quit: atomotic)
10:59 πŸ”— zyphlar_ has quit IRC (Quit: Connection closed for inactivity)
11:40 πŸ”— fie has quit IRC (Quit: Leaving)
12:05 πŸ”— Ctrl has quit IRC (Read error: Operation timed out)
12:39 πŸ”— atomotic has joined #archiveteam
12:51 πŸ”— djbeadle has joined #archiveteam
13:21 πŸ”— djbeadle has quit IRC (My MacBook has gone to sleep.)
13:51 πŸ”— yuitimoth has joined #archiveteam
14:12 πŸ”— RichardG has joined #archiveteam
14:18 πŸ”— jrwr JAA: the thing is with "shitty" javascript webapps, rendered HTML might be best to scrape
14:23 πŸ”— JAA jrwr: In my opinion, we should capture both the raw network traffic of everything retrieved by the browser as well as the resulting DOM. I'm not entirely sure how the latter should be stored though. It doesn't fit into the WARC model of requests and responses; maybe a new record type for such "derived" resources would be needed.
14:26 πŸ”— JAA brozzler handles the network traffic side (and wpull + PhantomJS as well, I think). chromebot and Squidwarc are somewhere inbetween as far as I understand it (not the raw traffic because Chromium's API doesn't expose that -- transfer encoding is stripped, for example, and headers are in a standardised format rather than the raw bytes sent by the server -- but it's also not the final DOM).
14:27 πŸ”— JAA archive.is would be an example for storing only the resulting DOM (I believe).
14:34 πŸ”— atomotic has quit IRC (Quit: atomotic)
14:39 πŸ”— Feld0 has joined #archiveteam
14:41 πŸ”— GLaDOS has joined #archiveteam
14:44 πŸ”— djbeadle has joined #archiveteam
15:20 πŸ”— Ctrl has joined #archiveteam
15:33 πŸ”— Ctrl has quit IRC (Read error: Operation timed out)
15:44 πŸ”— GLaDOS has quit IRC (Quit: Leaving)
15:50 πŸ”— atomotic has joined #archiveteam
16:07 πŸ”— atomotic has quit IRC (Quit: atomotic)
16:22 πŸ”— Mateon1 has joined #archiveteam
16:22 πŸ”— Mateon1 has quit IRC (Connection closed)
16:52 πŸ”— Ctrl has joined #archiveteam
17:19 πŸ”— SketchCow https://www.twitch.tv/textfilesdotcom
17:19 πŸ”— SketchCow GET SOME LEARNING, FELLOWS
18:08 πŸ”— atomicthu has quit IRC (Read error: Operation timed out)
18:10 πŸ”— c4rc4s has quit IRC (Ping timeout: 600 seconds)
18:48 πŸ”— c4rc4s has joined #archiveteam
19:10 πŸ”— atomicthu has joined #archiveteam
19:52 πŸ”— jschwart has joined #archiveteam
20:17 πŸ”— n00b559 has joined #archiveteam
20:19 πŸ”— n00b559 Hello, I lost a video in yahoo videos back in 2011 or so, can I find out how to find it on here?
20:23 πŸ”— RichardG has quit IRC (Read error: Connection reset by peer)
20:24 πŸ”— RichardG has joined #archiveteam
20:26 πŸ”— n00b559 has quit IRC (Ping timeout: 260 seconds)
20:59 πŸ”— bsmith093 has quit IRC (Quit: Leaving.)
21:02 πŸ”— bsmith093 has joined #archiveteam
21:29 πŸ”— ats has quit IRC (Quit: it's new kernel time!)
21:31 πŸ”— ats has joined #archiveteam
21:45 πŸ”— sekolyn has joined #archiveteam
21:45 πŸ”— octothorp has quit IRC (Read error: Connection reset by peer)
21:52 πŸ”— sekolyn has quit IRC (Read error: Connection reset by peer)
21:52 πŸ”— octothorp has joined #archiveteam
21:59 πŸ”— Asparagir has joined #archiveteam
22:27 πŸ”— schbirid has quit IRC (Quit: Leaving)
22:30 πŸ”— dashcloud has quit IRC (Ping timeout: 260 seconds)
22:34 πŸ”— dashcloud has joined #archiveteam
22:37 πŸ”— dashcloud has quit IRC (Read error: Operation timed out)
22:37 πŸ”— dashcloud has joined #archiveteam
22:51 πŸ”— ola_norsk has joined #archiveteam
22:52 πŸ”— macker has quit IRC (Quit: out of beer...)
22:52 πŸ”— ola_norsk is there anyone at Internet Archive that is responsible for IA social media precense? I'd like to hand over https://www.minds.com/InternetArchive
22:53 πŸ”— ola_norsk (i don't have faceboor or twitter :/ )
22:53 πŸ”— ola_norsk facebook*
22:54 πŸ”— macker- has joined #archiveteam
22:54 πŸ”— ola_norsk e.g some @archive.org mail i could send the u/p to?
22:54 πŸ”— macker- is now known as macker
23:01 πŸ”— jschwart has quit IRC (Quit: Konversation terminated!)
23:07 πŸ”— kitties has joined #archiveteam
23:10 πŸ”— RichardG has quit IRC (Read error: Connection reset by peer)
23:11 πŸ”— RichardG has joined #archiveteam
23:15 πŸ”— * ola_norsk is just going to guess Alexis Rossi and CC the rest..
23:22 πŸ”— ola_norsk https://www.emailsherlock.com/emailsearch/jscott@archive.org/
23:24 πŸ”— JAA I'd say just email info@archive.org, asking them if they're interested etc. You'll either get a reply from the person you're looking for or instructions how to contact them.
23:28 πŸ”— ola_norsk holy crap, how that get pasted into the window??
23:28 πŸ”— ola_norsk JAA: ok
23:29 πŸ”— ola_norsk does irssi do drag-n-drop? :/
23:30 πŸ”— ola_norsk JAA: i'm just going to CC though..these day's one email address is usually not enough.
23:32 πŸ”— ola_norsk has quit IRC (Wanting people to listen, you can't just tap them on the shoulder anymore. You have to hit them with a sledgehammer)
23:40 πŸ”— BobJonkma has joined #archiveteam
23:49 πŸ”— djbeadle has quit IRC (My MacBook has gone to sleep.)
23:55 πŸ”— Stiletto has quit IRC (Ping timeout: 246 seconds)
23:59 πŸ”— Stilett0 has joined #archiveteam

irclogger-viewer