[00:37] *** phuzion has quit IRC (Read error: Operation timed out) [00:42] *** phuzion has joined #archiveteam-bs [00:43] *** GinhijiQu has quit IRC (Quit: ZNC - http://znc.in) [01:18] *** kristian_ has joined #archiveteam-bs [01:38] what's 'FOS'? [01:39] http://archiveteam.org/index.php?title=Fortress_of_Solitude [01:39] Fortress of Solitude [02:01] *** VADemon has quit IRC (Quit: left4dead) [02:02] thanks [02:10] this is so weird https://web.archive.org/web/20170103012405/https://www.fsf.org/blogs/licensing/licensing-resource-series-the-most-popular-resources-for-2016 [02:10] look at how many archivals in a few days [02:14] seems like most of them were manual triggered crawls. Not very uncommon, when something hits HN/reddit. [02:14] *** vitzli has joined #archiveteam-bs [02:15] nice to see that many other people do manual crawls as well [02:17] btw medowar how can you tell the crawls were manual? [02:17] web-beta tells you, from which collection this is from: https://web-beta.archive.org/web/20170103012405/https://www.fsf.org/blogs/licensing/licensing-resource-series-the-most-popular-resources-for-2016 [02:18] neat! [02:41] *** RichardG has quit IRC (Ping timeout: 245 seconds) [02:49] *** RichardG has joined #archiveteam-bs [02:52] *** RichardG has quit IRC (Remote host closed the connection) [02:52] *** RichardG has joined #archiveteam-bs [02:58] *** rocode has joined #archiveteam-bs [02:58] *** RichardG has quit IRC (Read error: Operation timed out) [03:00] *** schbirid2 has joined #archiveteam-bs [03:01] *** schbirid has quit IRC (Ping timeout: 250 seconds) [03:07] *** pizzaiolo has left [03:42] *** RichardG has joined #archiveteam-bs [03:44] *** RichardG_ has joined #archiveteam-bs [03:46] *** RichardG has quit IRC (Ping timeout: 245 seconds) [03:47] *** RichardG has joined #archiveteam-bs [03:51] *** RichardG has quit IRC (Ping timeout: 250 seconds) [03:52] *** RichardG_ has quit IRC (Read error: Operation timed out) [04:03] *** RichardG has joined #archiveteam-bs [04:09] *** RichardG has quit IRC (Read error: Operation timed out) [04:14] *** ndiddy has quit IRC (Quit: Leaving) [04:22] *** kristian_ has quit IRC (Quit: Leaving) [04:40] *** RichardG has joined #archiveteam-bs [04:46] *** RichardG has quit IRC (Ping timeout: 370 seconds) [04:52] *** ndiddy has joined #archiveteam-bs [04:52] *** ndiddy has quit IRC (Read error: Connection reset by peer) [05:03] *** RichardG has joined #archiveteam-bs [05:03] *** RichardG has quit IRC (Read error: Connection reset by peer) [05:10] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:17] *** RichardG has joined #archiveteam-bs [05:18] *** Sk1d has joined #archiveteam-bs [05:24] *** RichardG_ has joined #archiveteam-bs [05:28] *** RichardG has quit IRC (Ping timeout: 633 seconds) [05:33] *** RichardG_ has quit IRC (Ping timeout: 244 seconds) [05:47] *** RichardG_ has joined #archiveteam-bs [05:54] *** RichardG_ has quit IRC (Remote host closed the connection) [06:12] *** RichardG has joined #archiveteam-bs [06:18] *** RichardG_ has joined #archiveteam-bs [06:18] *** RichardG has quit IRC (Read error: Operation timed out) [06:29] *** RichardG_ has quit IRC (Ping timeout: 633 seconds) [06:38] *** RichardG has joined #archiveteam-bs [06:44] *** RichardG_ has joined #archiveteam-bs [06:45] *** RichardG has quit IRC (Ping timeout: 250 seconds) [06:47] *** RichardG has joined #archiveteam-bs [06:54] *** RichardG_ has quit IRC (Read error: Operation timed out) [06:56] *** RichardG has quit IRC (Ping timeout: 245 seconds) [06:57] *** RichardG has joined #archiveteam-bs [07:06] *** RichardG has quit IRC (Ping timeout: 245 seconds) [07:09] *** RichardG has joined #archiveteam-bs [07:17] *** RichardG has quit IRC (Ping timeout: 260 seconds) [07:29] *** RichardG_ has joined #archiveteam-bs [07:33] *** Aranje has quit IRC (Quit: Three sheets to the wind) [07:38] *** RichardG_ has quit IRC (Read error: Operation timed out) [07:43] *** RichardG_ has joined #archiveteam-bs [07:50] *** RichardG has joined #archiveteam-bs [07:52] *** RichardG_ has quit IRC (Read error: Operation timed out) [07:54] *** RichardG has quit IRC (Read error: Connection reset by peer) [08:01] *** mistym has joined #archiveteam-bs [08:09] *** RichardG has joined #archiveteam-bs [08:12] *** RichardG has quit IRC (Read error: Connection reset by peer) [08:17] *** RichardG has joined #archiveteam-bs [08:22] *** RichardG_ has joined #archiveteam-bs [08:22] *** RichardG has quit IRC (Read error: Operation timed out) [08:28] *** RichardG_ has quit IRC (Read error: Operation timed out) [08:37] *** RichardG has joined #archiveteam-bs [08:44] *** RichardG has quit IRC (Remote host closed the connection) [08:45] *** RichardG has joined #archiveteam-bs [08:50] *** RichardG_ has joined #archiveteam-bs [08:52] *** RichardG has quit IRC (Read error: Operation timed out) [08:54] *** RichardG_ has quit IRC (Read error: Operation timed out) [09:05] *** RichardG has joined #archiveteam-bs [09:10] *** RichardG has quit IRC (Ping timeout: 255 seconds) [09:18] *** RichardG has joined #archiveteam-bs [09:27] *** RichardG has quit IRC (Ping timeout: 370 seconds) [09:28] *** GE has joined #archiveteam-bs [09:32] *** RichardG has joined #archiveteam-bs [09:37] *** Honno has joined #archiveteam-bs [09:40] *** RichardG has quit IRC (Read error: Connection reset by peer) [09:40] *** RichardG has joined #archiveteam-bs [09:46] *** VADemon has joined #archiveteam-bs [09:53] *** RichardG has quit IRC (Ping timeout: 260 seconds) [10:00] *** RichardG has joined #archiveteam-bs [10:04] *** BlueMaxim has quit IRC (Quit: Leaving) [11:14] *** GE has quit IRC (Remote host closed the connection) [12:11] PurpleSym: I see the nin audio items are being added :D [12:12] Yes, arkiver. Almost done, 3k remaining. [12:13] Let’s see how long they last… [13:03] *** GE has joined #archiveteam-bs [13:54] *** Lord_Nigh has quit IRC (Ping timeout: 244 seconds) [13:55] *** Lord_Nigh has joined #archiveteam-bs [14:03] *** Honno has quit IRC (Read error: Operation timed out) [14:07] *** pizzaiolo has joined #archiveteam-bs [14:14] *** vitzli has quit IRC (Quit: Leaving) [14:51] folks, ipernity is shutting down this month http://ipernity.com/ [14:51] I ran archivebot on it, but I'm not sure whether all of it was saved, because it didn't take as long as I imagine it would [14:54] had a look at the website, everythings seems to be sequential, so should be saveable [15:00] https://archive.fart.website/archivebot/viewer/job/3d0fr ~ 167 GB grabbed [15:12] *** GinhijiQu has joined #archiveteam-bs [15:26] *** kurt has joined #archiveteam-bs [15:38] w0pr: do you think that's all of it? I'm not sure [15:39] "Join the thousands of people who trust us" the jokes write themselves. [15:39] I don't think that's all [15:39] we'll get a warrior project running [15:39] nice [15:41] rocode: "With ipernity your photos and videos have a bright future." [15:42] pizzaiolo, I am looking at their API right now to see if it can be used for discovery. [15:42] Unfortunately, it looks like they don't have an index traverser. [15:47] yeah seems small. when I noticed it on the dashboard 20th december, it had only done 5% of the total urls (completed + queued) in 1 week so extrapolating it didn't look like it would finish in time anyway. [15:48] I don't think we need to do a discovery [15:48] explore.docs.getPopular API call does not appear to have a limit on search depth. My script is currently at 490 pages. [15:48] 490 pages of what [15:48] 50 item results. [15:49] i.e. working backward down the index via popularity. [15:49] let's make a channel for this [15:52] it'll be here https://github.com/ArchiveTeam/ipernity-grab [15:53] looks like we still need a wikipage [15:54] looks like a few million users. possible a few hundred million pictures [15:55] How about #ipergone ? [15:55] #ipfinite [15:56] #iperished [16:00] I love the puns [16:01] came for the archiving, stayed for the puns [16:12] voting for #ipfinite [16:12] #ipermanent [16:14] #ipfinite then? [16:14] Sounds good. [16:15] ok, #ipfinite [16:20] *** rocode has quit IRC (Remote host closed the connection) [16:21] *** GE_ has joined #archiveteam-bs [16:22] *** GE has quit IRC (Ping timeout: 255 seconds) [16:23] *** GE_ is now known as GE [16:23] *** rocode has joined #archiveteam-bs [16:52] You can do the math yourself ... there are about three thousand Club members [16:53] lack of paying members killed that service [16:54] https://www.euronext.com/en/products/equities/FR0010777680-XMLI/company-information [16:58] ouch 9 per share, down to 0.20 per share [17:00] wait 0.18 683 shares dumped 27/12 [17:09] *** GinhijiQu has quit IRC (Ping timeout: 250 seconds) [17:11] *** GinhijiQu has joined #archiveteam-bs [18:01] *** Honno has joined #archiveteam-bs [19:21] *** pizzaiolo has quit IRC (Ping timeout: 245 seconds) [19:41] *** pizzaiolo has joined #archiveteam-bs [19:42] *** Asparagir has joined #archiveteam-bs [21:03] *** schbirid2 has quit IRC (Quit: Leaving) [21:41] *** BlueMaxim has joined #archiveteam-bs [21:47] *** Start has quit IRC (Read error: Connection reset by peer) [21:48] *** Start_ has joined #archiveteam-bs [21:55] *** terg has joined #archiveteam-bs [22:49] *** pizzaiolo has left [22:55] *** pizzaiolo has joined #archiveteam-bs [22:58] *** GE has quit IRC (Quit: zzz) [23:07] *** GinhijiQu has quit IRC (Quit: ZNC - http://znc.in) [23:08] *** GinhijiQu has joined #archiveteam-bs [23:08] *** FalconK has joined #archiveteam-bs [23:09] hey, does anyone know of a project that makes use of wpull 2.x, particularly the plugin mechanism? [23:09] I'm stuck on several things and need a working example [23:13] *** GinhijiQu is now known as Ve [23:13] *** Ve is now known as VeganMars [23:17] chfoo: do you know of such a thing? [23:44] FalconK, unfortunately all the examples I can find use wpull 1.x, doing a quick search of github and pypi.