[00:27] well, i already started it with winhttrack but i will try that for my next mirror. I hate winnhtrack so much [00:27] It's glitchy, slow, unreliable the UI is dated af [00:30] I also tried wget but it wasn't setting the links to be relevant to the mirror [00:31] *** MC0 has quit IRC (Read error: Connection reset by peer) [00:37] *** ndiddy has quit IRC (Quit: WeeChat 1.4) [00:38] *** ndiddy has joined #archiveteam [01:12] *** RichardG_ has joined #archiveteam [01:18] *** RichardG has quit IRC (Read error: Operation timed out) [01:28] winhttrack failed, it managed to log itself out of the site. I'm trying grab-site now. I noticed I can't get to the html files to check if it's staying logged in. How can I do that? [01:29] It's still in progress fwiw [01:30] Here's what I see: https://i.imgur.com/viTH9XL.png [01:32] nevermind [01:32] this won't work either, it logged it self out also [01:33] ShellyRol: there might be a /logout or something you need to ignore [01:33] It looks like this http://www.novaworld2.com/index.php?idtag=5d3cf68eec1bc&do=/public/logout/ [01:33] I'm conerned that idtag will change [01:34] you can ignore all do=/public/logout/ [01:34] --import-ignores: Copy this file to to DIR/ignores before the crawl begins. [01:34] for looking inside the WARC probably https://github.com/webrecorder/webrecorder-player [01:35] to clarify, `--import-ignores FILE` where file has a line: do=/public/logout/ [01:36] *** RichardG_ is now known as RichardG [01:37] I'll try that, thank you [01:40] fwiw here's the command i'm using: user@Server01:~/share/Novaworld2$ grab-site "http://www.novaworld2.com/index.php?idtag=5d3cf5e46b94c&do=/public/forums/" --wpull-args=--load-cookies=/home/user/share/Novaworld2/cookies.txt --ua "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36" --no-offsite-links --import-ignores /home/user/share/Novaworld2/ignore [01:40] --import-ignores /home/user/share/Novaworld2/ignore [01:42] let's move this to #archiveteam-ot [01:42] and ignore literally just contains "do=/public/logout/" (w/o quotes). I'll see how it goes, thanks again [01:57] *** kiskabak has quit IRC (Remote host closed the connection) [01:57] *** kiskabak has joined #archiveteam [01:57] *** Fusl__ sets mode: +o kiskabak [01:57] *** Fusl sets mode: +o kiskabak [01:57] *** Fusl_ sets mode: +o kiskabak [02:36] *** killsushi has quit IRC (Quit: Leaving) [02:48] Just learned that instaud.io is shutting down. https://instaud.io/shutting-down [02:48] Might be another proejct [02:49] #nomoreaud.io [03:12] *** Arctic has joined #archiveteam [03:13] instaud.io Is [03:13] Whoops. [03:13] Pressed enter too early. [03:13] #nomoreaud.io [03:13] instaud.io is shutting down. [03:13] Got it. [03:17] *** Arctic has quit IRC (Remote host closed the connection) [03:18] *** Arctic has joined #archiveteam [03:19] *** Fusl_ changes topic to: Archive Team: We're not archive.org | https://archiveteam.org/ | Discussion: #archiveteam-bs | Offtopic: #archiveteam-ot | instaud.io: #nomoreaud.io [03:21] *** DogsRNice has quit IRC (Read error: Connection reset by peer) [03:21] *** Arctic has quit IRC (Remote host closed the connection) [03:48] *** wyatt8740 has quit IRC (Read error: Operation timed out) [03:49] *** wyatt8740 has joined #archiveteam [03:52] *** qw3rty119 has joined #archiveteam [03:56] *** qw3rty118 has quit IRC (Read error: Operation timed out) [04:11] *** wyatt8740 has quit IRC (Read error: Operation timed out) [04:14] *** wyatt8740 has joined #archiveteam [05:01] *** wyatt8740 has quit IRC (Read error: Operation timed out) [06:06] *** cerca has quit IRC (Remote host closed the connection) [06:33] *** Blokatt has joined #archiveteam [07:45] *** Flashfloo has quit IRC (Remote host closed the connection) [07:45] *** Flashfire has quit IRC (Remote host closed the connection) [07:45] *** kiska has quit IRC (Remote host closed the connection) [07:45] *** kiska has joined #archiveteam [07:45] *** Flashfloo has joined #archiveteam [07:45] *** Fusl__ sets mode: +o kiska [07:45] *** Fusl sets mode: +o kiska [07:45] *** Fusl_ sets mode: +o kiska [07:45] *** Flashfire has joined #archiveteam [08:08] *** VADemon_ has joined #archiveteam [08:08] *** JH88 has quit IRC (Read error: Connection reset by peer) [08:08] *** wyatt8740 has joined #archiveteam [08:09] *** JH88 has joined #archiveteam [08:14] *** VADemon has quit IRC (Read error: Operation timed out) [08:47] *** Blokatt has quit IRC (Read error: Connection reset by peer) [08:47] *** Blokatt has joined #archiveteam [09:09] *** MCO has joined #archiveteam [09:18] *** schbirid has joined #archiveteam [09:24] *** m007a83 has quit IRC (Read error: Operation timed out) [09:49] *** DigiDigi has quit IRC (Remote host closed the connection) [10:03] *** DigiDigi has joined #archiveteam [10:15] *** raz^r has quit IRC (Read error: Connection reset by peer) [12:10] Not sure if archivable but Instagram is getting rid of a bunch of accounts that post memes [12:11] https://www.rt.com/news/465213-instagram-meme-account-shutdown/amp/ [12:24] *** BlueMax has quit IRC (Read error: Connection reset by peer) [12:36] *** MCO has quit IRC (Read error: Connection reset by peer) [12:50] > A teenager named Caige whose two suspended accounts, @yerdank and @autist, boasted more than 850,000 followers, said he had made over $30,000 so far this year from the pages. [12:50] Boo hoo [13:04] elections coming, gotta clean social networks [13:43] *** Dragnog has quit IRC (Quit: The Lounge - https://thelounge.chat) [13:50] *** Dragnog has joined #archiveteam [14:47] *** benjinsmi has quit IRC (Remote host closed the connection) [14:48] *** benjinsmi has joined #archiveteam [14:49] Hi, apologies if this is the wrong place to ask but I was wondering if you would be able to help with some archive jobs. Basically Blizzard Entertainment have migrated many of their forums. The old forums are currently in read only mode and we've been told they will be up for the foreseeable future but I worry that they will eventually be lost, lik [14:49] e the previous migration before that. I'm not quite sure what qualifies for archival but thought it was worth a shot asking here. The forums root https://us.battle.net/forums/en/wow/ is redirecting to the new forums but the actual sub forums as still in tact e.g. https://us.battle.net/forums/en/wow/984270/ in read only mode. Thanks in advance [14:50] totally qualifies [14:50] Dragnog: let´s move this to #archiveteam-bs (this channel is mostly for official announcements) [14:55] I´ll set up an archivebot job for it later, see how that runs [15:29] *** muramasa_ has quit IRC (Ping timeout: 252 seconds) [16:01] *** Selanda has quit IRC (Quit: Lost terminal) [16:20] *** Selanda has joined #archiveteam [16:36] *** squidboy has joined #archiveteam [17:00] *** noirscape has quit IRC (Quit: ZNC 1.7.3 - https://znc.in) [17:02] *** noirscape has joined #archiveteam [17:15] *** cerca has joined #archiveteam [17:26] *** squidboy has quit IRC (Quit: Leaving) [17:42] *** edsu has joined #archiveteam [17:48] *** VerifiedJ has joined #archiveteam [17:52] *** Muramasa has joined #archiveteam [18:12] *** Ctrl has quit IRC (Read error: Operation timed out) [19:29] *** Blokatt has quit IRC (Read error: Operation timed out) [20:41] *** DogsRNice has joined #archiveteam [20:48] *** schbirid has quit IRC (Remote host closed the connection) [22:30] *** VerifiedJ has quit IRC (Quit: Leaving) [23:12] *** BlueMax has joined #archiveteam