#archiveteam-bs 2019-03-08,Fri

↑back Search

Time Nickname Message
00:12 🔗 godane i'm recapturing a tape cause of sync issues
00:22 🔗 godane ok now i think the recording is out of sync
00:22 🔗 godane the other recording on this tape has no sync issues
00:26 🔗 godane so the recording was christine movie on cbs in 1987-04-18
00:27 🔗 SimpBrain has quit IRC (Read error: Operation timed out)
00:29 🔗 SimpBrain has joined #archiveteam-bs
00:33 🔗 godane has quit IRC (Ping timeout: 246 seconds)
00:35 🔗 JAA BartoCH: ^ That should be everything I threw into ArchiveBot. Looks like I didn't do anything for the March 2018 vote (Billag & finances). Once the bot runs, we'll get pretty tables for everything. :-)
00:36 🔗 tammy_ has joined #archiveteam-bs
00:36 🔗 tammy_ I'm the one who has the InterfaceLIFT warc scrape from a year or 2 ago. Is there a tool to upload this to IA that I can ratelimit the upload? I'd prefer to do it that way rather than go through the web interface.
00:36 🔗 evul_ has joined #archiveteam-bs
00:38 🔗 JAA Sorry, didn't see your message on Reddit since I was busy adding stuff to our wiki.
00:38 🔗 tammy_ no worries
00:38 🔗 JAA Looks like "ia" doesn't have a rate limiting option, but I think you can also upload with curl, and that should have an option somewhere.
00:38 🔗 tammy_ long time no see jaa
00:38 🔗 JAA Indeed :-)
00:38 🔗 JAA https://archive.org/help/abouts3.txt has details on how to upload with curl.
00:39 🔗 tammy_ ok, I'll look into that after dinner. playing some rocket league. dataset is nice and safe though :)
00:39 🔗 JAA With that large an item, make sure to provide a size hint (described somewhere in that document).
00:40 🔗 JAA But if you can, I'd suggest you just use the "ia" tool instead since it's the canonical way of uploading large amounts of data to IA.
00:40 🔗 godane has joined #archiveteam-bs
00:41 🔗 godane i'm taking a break digitizing dashcloud tapes
00:42 🔗 godane i was going to use vlc to sync the eariler rip but then vlc crash the system
00:43 🔗 godane like mouse moved but nothing responsed to it
00:48 🔗 JAA tammy_: I linked the tool in my PM, by the way, but here's the link again: https://archive.org/services/docs/api/internetarchive/ (Python package "internetarchive")
01:05 🔗 marked has quit IRC (Read error: Operation timed out)
01:06 🔗 marked has joined #archiveteam-bs
01:06 🔗 marked has quit IRC (west.us.hub irc.Prison.NET)
01:06 🔗 godane has quit IRC (west.us.hub irc.Prison.NET)
01:06 🔗 achip has quit IRC (west.us.hub irc.Prison.NET)
01:10 🔗 Exairnous has joined #archiveteam-bs
01:16 🔗 achip has joined #archiveteam-bs
01:16 🔗 marked has joined #archiveteam-bs
01:16 🔗 godane has joined #archiveteam-bs
01:23 🔗 BlueMax has joined #archiveteam-bs
01:32 🔗 Dimtree has joined #archiveteam-bs
01:40 🔗 ndiddy has joined #archiveteam-bs
01:41 🔗 Exairnous JAA: I see what you mean about youtube on IA. Is there anyway to put a link on the youtube video page to the actual video
01:41 🔗 Exairnous or do you know of another place to save youtube that handles playback better?
02:17 🔗 bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…)
02:56 🔗 JAA Exairnous: No, fortunately there is no way to add links like that to the Wayback Machine. It could completely compromise the authenticity of the archived snapshot, since it would be a fake response. And no, I'm not aware of any good solution to archiving YouTube pages. Playback will always be tricky with sites like that; even if you use a full browser for the archival etc., playback might happen on a
02:56 🔗 JAA different browser or platform, which can change which URLs (or in this case, which video resolution, for example) is requested, thus breaking the playback. Archiving these things is a huge nightmare really. The best solution is to extract the relevant information from it and present it in a more sane way.
03:02 🔗 Exairnous JAA: What about links/embeds to the archived youtube videos on an archived website? Will they still work?
03:05 🔗 JAA Exairnous: No, probably not. The WBM has some stuff for handling YT videos specially though and replacing them with their own player, but I'm not sure if we can feed into that in any way.
03:06 🔗 Exairnous :(
03:07 🔗 Exairnous JAA: There are several youtube links in pages on ngharmony.ca. Is there any way to have them resolve correctly after the youtube channel is taken down?
03:08 🔗 JAA Exairnous: Define "resolve correctly". They'll still point to the same YouTube pages, which will be broken in the WBM.
03:10 🔗 Flashfire Um I am having trouble with the save now feature
03:10 🔗 Flashfire it 404s when I try and save a page
03:10 🔗 Exairnous JAA: Point to a working video.
03:10 🔗 JAA Exairnous: Almost certainly no.
03:11 🔗 Exairnous :(
03:11 🔗 Flashfire https://web.archive.org/save/https://www.youtube.com/watch?v=El41sHXck-E gave me a 404 damn it
03:11 🔗 JAA YouTube's fault really. If they simply used an HTML5 <video> tag, it would all work fine.
03:11 🔗 Flashfire Dont ask why I am trying to save youtube videos like that but why its not working and 404ing on me is annoying
03:11 🔗 godane has quit IRC (Ping timeout: 255 seconds)
03:12 🔗 Flashfire Can someone else check if they are having problems with the save now feature please or if its just me?
03:12 🔗 JAA Flashfire: Works fine for me. Well, except the saved page is broken, but that's expected.
03:13 🔗 Flashfire I mean does using the https://web.archive.org/save/ work for any page
03:13 🔗 Flashfire it just 404s when I click save page
03:13 🔗 JAA Yes, I simply visited the link you pasted, and it archived the page.
03:13 🔗 Exairnous JAA: I just had a look at a youtube video with a browser inspector. I'm pretty sure it had a video tag with a blob: link.
03:14 🔗 JAA https://web.archive.org/web/20190308031204/https://www.youtube.com/watch?v=El41sHXck-E
03:15 🔗 Flashfire Try visiting the save now page and saving a random link. It wont work for me
03:15 🔗 Flashfire The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.
03:15 🔗 Flashfire I get that error
03:15 🔗 JAA Exairnous: Yeah, they use a <video> tag but then modify its contents with JS. Specifically, the <source> tag has an attribute src$="[[videoThumbnail_.url]]" instead of simply src with an actual URL.
03:15 🔗 JAA What I really mean is a site that just works without JS.
03:16 🔗 Exairnous of course they do :/
03:16 🔗 SimpBrain has quit IRC (Read error: Operation timed out)
03:17 🔗 JAA Yeah, modern websites need to use at least three frameworks on both client and server, otherwise they're not modern enough.
03:18 🔗 JAA Well, welcome to the hell that is archiving JS-heavy websites. :-)
03:19 🔗 Exairnous JS-heavy purposely obfuscated websites :P
03:20 🔗 Exairnous Cause I'm fairly sure WM can playback at least some JS?
03:20 🔗 JAA Oh, JS on its own works fine. It's the xmlHttpRequests and similar stuff which break.
03:21 🔗 Exairnous that sounds like it needs a server to wrok properly
03:21 🔗 Exairnous *work
03:22 🔗 SimpBrain has joined #archiveteam-bs
03:22 🔗 underscor has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 Hani has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 noirscape has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 argus has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 arbin has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 ReimuHaku has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 Ganonmast has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 PurpleSym has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 kisspunch has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 Frogging has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 jodizzle has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 VoynichCr has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 MrRadar2 has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 Tenebrae has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 BnAboyZ has quit IRC (hub.efnet.us irc.efnet.nl)
03:22 🔗 JAA Yeah, but IA's URLs also come into play since the absolute URL is different.
03:22 🔗 JAA WBM's URLs*
03:22 🔗 slyphic has quit IRC (Read error: Operation timed out)
03:22 🔗 slyphic has joined #archiveteam-bs
03:23 🔗 Jopik has joined #archiveteam-bs
03:23 🔗 JAA I think someone here (PurpleSym?) had a PoC of something based on service workers for rewriting URLs on the fly.
03:23 🔗 JAA WBM currently works by rewriting anything that looks like a URL statically.
03:23 🔗 JAA That solution would instead hijack any requests sent by the browser, rewrite them into the equivalent WBM URLs, and then send that request instead.
03:24 🔗 JAA That still doesn't help with the potential differences in URLs based on browser versions etc. though.
03:24 🔗 underscor has joined #archiveteam-bs
03:24 🔗 Hani has joined #archiveteam-bs
03:24 🔗 noirscape has joined #archiveteam-bs
03:24 🔗 argus has joined #archiveteam-bs
03:24 🔗 arbin has joined #archiveteam-bs
03:24 🔗 ReimuHaku has joined #archiveteam-bs
03:24 🔗 Ganonmast has joined #archiveteam-bs
03:24 🔗 PurpleSym has joined #archiveteam-bs
03:24 🔗 kisspunch has joined #archiveteam-bs
03:24 🔗 Frogging has joined #archiveteam-bs
03:24 🔗 jodizzle has joined #archiveteam-bs
03:24 🔗 VoynichCr has joined #archiveteam-bs
03:24 🔗 MrRadar2 has joined #archiveteam-bs
03:24 🔗 Tenebrae has joined #archiveteam-bs
03:24 🔗 BnAboyZ has joined #archiveteam-bs
03:24 🔗 irc.efnet.nl sets mode: +oo PurpleSym MrRadar2
03:24 🔗 JAA And the archival would still require a full browser, which is very inefficient compared to our usual methods of archiving things.
03:25 🔗 tammy_ has quit IRC (Ping timeout: 261 seconds)
03:25 🔗 VerifiedJ has quit IRC (Ping timeout: 252 seconds)
03:25 🔗 Exairnous JAA: Would something like Rhizome's Webrecorder produce a warc that could be uploaded to IA and playback correctly? Or does youtube have to be dynamic?
03:26 🔗 JAA The problem partially lies in the Wayback Machine itself.
03:26 🔗 JAA So no, playback would almost certainly not work correctly.
03:27 🔗 flipflop has quit IRC (Read error: Operation timed out)
03:32 🔗 Flashfire JAA try putting https://vaguthu.mv/evaguthu/163689 through the save now page found at https://web.archive.org/save/
03:32 🔗 Flashfire its not working
03:34 🔗 VerifiedJ has joined #archiveteam-bs
03:44 🔗 Flashfire wtf is going on for me to not be able to use the save now feature
03:45 🔗 Flashfire Have I been marked as a spammer from the weird urls?
04:07 🔗 odemgi has joined #archiveteam-bs
04:09 🔗 odemgi_ has quit IRC (Ping timeout: 252 seconds)
04:13 🔗 hook54321 Flashfire: What message do you get when trying to save it?
04:14 🔗 Flashfire The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.
04:15 🔗 hook54321 I've had that happen a few times, not sure why. Try another URL and see what happens.
04:15 🔗 odemg has quit IRC (Ping timeout: 615 seconds)
04:19 🔗 Flashfire it does it with other urls as well
04:22 🔗 odemg has joined #archiveteam-bs
04:30 🔗 VerifiedJ has quit IRC (Ping timeout: 252 seconds)
04:34 🔗 VerifiedJ has joined #archiveteam-bs
04:46 🔗 qw3rty111 has joined #archiveteam-bs
04:49 🔗 m007a83_ is now known as m007a83
04:50 🔗 qw3rty119 has quit IRC (Read error: Operation timed out)
04:54 🔗 HashbangI has quit IRC (Read error: Operation timed out)
04:54 🔗 nataraj_ has joined #archiveteam-bs
04:55 🔗 a_spook_ has joined #archiveteam-bs
04:57 🔗 HashbangI has joined #archiveteam-bs
04:57 🔗 a_spook_ Flashfire: dunno if it helps, but I have weird issues with wayback sometimes and they go away when I clear cookies? Though, I don't think it was the same error message as yours.
05:02 🔗 a_spook_ Flashfire: also I just did https://web.archive.org/save/https://www.youtube.com/watch?v=El41sHXck-E&disable_polymer=1 because ew modern youtube :P
05:03 🔗 Flashfire Yeah see doing it that way works but using the save now button uses less of my computers resources. or at least makes the fan not scream as loud
05:03 🔗 Flashfire but its not letting me do that
05:08 🔗 ndiddy_ has joined #archiveteam-bs
05:09 🔗 a_spook_ Flashfire: ah I see, I missed that page you said you were using, sorry
05:12 🔗 Flashfire a_spook_ Yeah trying to use the save now page
05:13 🔗 ndiddy has quit IRC (Ping timeout: 492 seconds)
05:30 🔗 a_spook_ Flashfire: I've actually never used that before and just tried it. I'm getting the same error as you on a random page I chose to test. Guess it's not just you then! :')
05:37 🔗 SimpBrain has quit IRC (Read error: Connection reset by peer)
05:39 🔗 SimpBrain has joined #archiveteam-bs
05:42 🔗 Exairnous Is it better to use an IA save now bookmarklet or archivebot for a single page?
05:44 🔗 Exairnous Cause I looked at one of the youtube embeds in my site (seems to be in IA now, yay) and the iframe link resolves to a valid link not in the wayback machine
05:45 🔗 Exairnous I think if I archive that link the embed may work, but I'm wondering whether to use archivebot or a bookmarklet.
05:52 🔗 wp494 has quit IRC (Read error: Operation timed out)
05:52 🔗 wp494 has joined #archiveteam-bs
06:14 🔗 ndiddy_ has quit IRC ()
06:58 🔗 Exairnous JAA: ^^
07:25 🔗 SimpBrain has quit IRC (Remote host closed the connection)
07:25 🔗 SimpBrain has joined #archiveteam-bs
07:34 🔗 SimpBrain has quit IRC (Remote host closed the connection)
07:34 🔗 SimpBrain has joined #archiveteam-bs
07:44 🔗 BlueMax has quit IRC (Read error: Connection reset by peer)
07:44 🔗 SimpBrain has quit IRC (Read error: Connection reset by peer)
07:47 🔗 Pixi` has joined #archiveteam-bs
07:48 🔗 Pixi has quit IRC (Read error: Operation timed out)
07:51 🔗 SimpBrain has joined #archiveteam-bs
07:54 🔗 VerifiedJ has quit IRC (Ping timeout: 252 seconds)
07:58 🔗 SimpBrain has quit IRC (Remote host closed the connection)
08:05 🔗 SimpBrain has joined #archiveteam-bs
08:06 🔗 VerifiedJ has joined #archiveteam-bs
08:30 🔗 S1mpbrain has joined #archiveteam-bs
08:30 🔗 SimpBrain has quit IRC (Remote host closed the connection)
08:47 🔗 lag__ has joined #archiveteam-bs
08:55 🔗 S1mpbrain has quit IRC (Ping timeout: 615 seconds)
10:13 🔗 Mateon1 has quit IRC (Ping timeout: 740 seconds)
10:14 🔗 Mateon1 has joined #archiveteam-bs
10:38 🔗 JAA Exairnous: Not sure. Both methods have advantages and disadvantages. But I don't know which works better for YouTube.
10:39 🔗 JAA VoynichCr: Oh, awesome! I was looking for a way to do that but couldn't figure it out. :-)
10:40 🔗 JAA I guess there's no way to filter out the /list pages, right?
10:44 🔗 Hani has quit IRC (Read error: Connection reset by peer)
10:44 🔗 Hani has joined #archiveteam-bs
10:51 🔗 Gfy has quit IRC (Ping timeout: 265 seconds)
10:54 🔗 a_spook_ has quit IRC (Quit: Connection closed for inactivity)
11:03 🔗 Gfy has joined #archiveteam-bs
12:16 🔗 bitBaron has joined #archiveteam-bs
13:42 🔗 bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…)
13:52 🔗 godane has joined #archiveteam-bs
14:15 🔗 bitBaron has joined #archiveteam-bs
14:53 🔗 wp494 has quit IRC (Ping timeout: 492 seconds)
14:55 🔗 wp494 has joined #archiveteam-bs
15:43 🔗 deevious has quit IRC (Quit: deevious)
16:02 🔗 Oddly has joined #archiveteam-bs
16:03 🔗 schbirid has joined #archiveteam-bs
16:26 🔗 VerifiedJ has quit IRC (Ping timeout: 252 seconds)
17:27 🔗 Hani111 has joined #archiveteam-bs
17:28 🔗 Hani has quit IRC (Read error: Connection reset by peer)
17:28 🔗 Hani111 is now known as Hani
17:38 🔗 Oddly has quit IRC (Ping timeout: 255 seconds)
17:44 🔗 VerifiedJ has joined #archiveteam-bs
17:48 🔗 JAA My wiki bot will now keep the WBM exclusion list sorted.
18:02 🔗 nataraj_ has quit IRC (Read error: Operation timed out)
18:16 🔗 Oddly has joined #archiveteam-bs
18:55 🔗 VoynichCr JAA: i dont think that filtering /list pages is possible
19:18 🔗 bitBaron has quit IRC (Quit: My computer has gone to sleep. 😴😪ZZZzzz…)
19:35 🔗 Exairnous JAA: Does saving with a bookmarklet interfere with what archivebot got?
19:36 🔗 bitBaron has joined #archiveteam-bs
19:47 🔗 evul_ is now known as evul
19:58 🔗 BlueMax has joined #archiveteam-bs
21:05 🔗 Albardin has quit IRC (Read error: Operation timed out)
21:07 🔗 Oddly has quit IRC (Ping timeout: 255 seconds)
21:08 🔗 kiskabak has quit IRC (Ping timeout: 265 seconds)
21:13 🔗 Hani has quit IRC (Read error: Operation timed out)
21:13 🔗 Hani has joined #archiveteam-bs
21:20 🔗 Hani has quit IRC (Ping timeout: 268 seconds)
21:20 🔗 Hani has joined #archiveteam-bs
22:39 🔗 wyatt8740 has joined #archiveteam-bs
23:00 🔗 JAA Exairnous: Well, the Wayback Machine is one big mixture of WARCs from all over the place, including the "save now" feature and ArchiveBot. Meaning, when you view the AB snapshot, you may also see content (e.g. images, stylesheets, scripts) from "save now" and vice-versa. So yes, it could interfere in that way. But the AB snapshot itself won't be affected by it in any way.
23:01 🔗 jodizzle Seems like a lot of the Venezuelan sites are down right now. Wonder if it's because of this: https://www.theguardian.com/world/2019/mar/07/venezuela-hit-by-major-power-outage
23:06 🔗 BlueMax has quit IRC (Quit: Leaving)
23:18 🔗 MR9K has quit IRC (Remote host closed the connection)
23:19 🔗 MR9K has joined #archiveteam-bs
23:39 🔗 Gfy SketchCow: is there a chance day addnfo-2010-1020.zip got skipped in the process somewhere? (regarding https://archive.org/download/nfo_large_collection_2009_2012)
23:58 🔗 wp494 has quit IRC (Read error: Operation timed out)
23:59 🔗 wp494 has joined #archiveteam-bs

irclogger-viewer