#wikiteam 2020-03-06,Fri

↑back Search

Time Nickname Message
00:07 🔗 benjins has joined #wikiteam
00:40 🔗 Wingy has quit IRC (Read error: Operation timed out)
00:44 🔗 Wingy has joined #wikiteam
07:22 🔗 VADemon_ has quit IRC (Read error: Operation timed out)
16:13 🔗 JAA This seems archival-worthy: https://en.wikichip.org/wiki/WikiChip No dump on IA as far as I can see. It's a slightly concealed MW: https://en.wikichip.org/wiki/Special:Version
17:32 🔗 systwi has quit IRC (Read error: Operation timed out)
17:33 🔗 systwi has joined #wikiteam
18:32 🔗 freeacc has joined #wikiteam
18:32 🔗 freeacc hey there
18:33 🔗 freeacc i would like to be able to create a .zim file for offline wiki viewing
18:33 🔗 freeacc wiki server is a mediawiki instance
18:34 🔗 freeacc tried to use mwoffliner, but I keep getting errors
18:34 🔗 freeacc c(connection timeout, and other network related ones)
18:34 🔗 freeacc i just downloaded tthe WikiTeam/wikiteam repo
18:35 🔗 freeacc and about to use the dummper python script
18:35 🔗 freeacc would like to know if there is any tool that i could use to convert the generated ddump to .zim
18:36 🔗 freeacc thanks
18:36 🔗 freeacc server in question: outward.gamepedia.com, in case there already is a dump ssomewhere
18:49 🔗 freeacc anyone there?
18:51 🔗 kiska has quit IRC (Remote host closed the connection)
18:52 🔗 kiska has joined #wikiteam
18:52 🔗 svchfoo1 sets mode: +o kiska
18:57 🔗 JAA Hi freeacc. Hang around and someone in the know might get back to you eventually. This is IRC, so expect that to take hours or even days.
18:58 🔗 freeacc JAA: thanks
20:23 🔗 Nemo_bis freeacc: I'm not sure I understand. You set up your own Parsoid instance backed by an XML import of that wiki?
20:23 🔗 Nemo_bis Or how did you expect mwoffliner to help?
20:24 🔗 freeacc Nemo_bis: i though it was some sort of scraper that saves the info inside a .zim file
20:24 🔗 Nemo_bis freeacc: yes, but it scrapes Parsoid
20:25 🔗 freeacc and parsoid is some king of markup2html converter. right?
20:25 🔗 Nemo_bis It's the node.js version of the PHP parser
20:25 🔗 Nemo_bis And don't get me started on how terrible the whole idea is :D
20:26 🔗 freeacc anyways. here's the command i'm running.
20:26 🔗 Nemo_bis This is a small wiki, I doubt mwoffliner is the best solution
20:27 🔗 Nemo_bis You might be better off with the usual old way of using dumpHTML on your own mirror of the wiki
20:27 🔗 freeacc https://www.irccloud.com/pastebin/oLcaOGko/
20:27 🔗 freeacc oh. ok
20:27 🔗 Nemo_bis Hm yes. In theory you can get the HTML from the API, but in practice that path is not used much so who knows what happens
20:28 🔗 Nemo_bis Wikis are often not particularly happy of being asked to reparse their entire content for you
20:28 🔗 Nemo_bis If you're lucky and dumpHTML works (small chance but who knows), you might be done in few minutes with that route
20:29 🔗 freeacc oh. will try that, then.
20:29 🔗 Nemo_bis Otherwise, please proceed to #kiwix on freenode because the last time I used mwoffliner was possibly 5 years ago
20:31 🔗 freeacc i also think that importing the dumpgenerator output would be much simpler
20:31 🔗 Nemo_bis "simpler" not, because you need to install MediaWiki and all the Gamepedia extensions and then run the parsing yourself
20:31 🔗 Nemo_bis However it *might* happen to be faster or more reliable on a small wiki like that
20:32 🔗 Nemo_bis It's the way we used to make ZIM files until 2008 or so
20:32 🔗 Nemo_bis Sorry, since 2008 or so and until mwoffliner was created
20:33 🔗 freeacc it just sucks that the tooling around such a task isn't so accessible.
20:33 🔗 Nemo_bis Well, the alternative for most CMS is that there's nothing at all :)
20:34 🔗 freeacc ok thanks a lot.
20:34 🔗 Nemo_bis (Well, last time I checked, a few years ago, there was a "static website exporter" for Joomla which had gone stale a few years before)
20:34 🔗 freeacc that's true, i mean im thankfull that i even have the option to create a dump
21:37 🔗 Nemo_bis JAA: not the nicest wiki on the block requests.exceptions.HTTPError: 521 Server Error: status code 521 for url: https://en.wikichip.org/w/api.php?format=json&continue=&meta=siteinfo%7Cuserinfo%7Cuserinfo&action=query&siprop=general%7Cnamespaces&uiprop=groups%7Crights%7Cblockinfo%7Chasmsg
21:38 🔗 Nemo_bis they already blocked special:export so it's probably only a matter of time before they block all relevant APIs as well
22:58 🔗 JAA Nemo_bis: Aw, too bad. Thanks for trying though.

irclogger-viewer