[00:01] Can't find it at the moment. [00:02] There are 2 additional limitations of Appshopper. [00:03] JAA: not sure, but it visited /{all,ipad,universal,mac}/reference [00:03] for instance [00:03] One is that for some unexplainable reason, apps do not get recorded and appear on Appshopper. [00:04] I'm looking at my database of iOS games to fetch examples. [00:06] Ah, here it is: https://itunes.apple.com/us/app/cubes-brain-teaser/id1195780835 [00:06] There is no such page on Appshopper at all. [00:06] The only other game it can be found as determined by Appshopper is http://appshopper.com/games/digit-conquer [00:07] If you look under "Other Apps by zPower Software FZE", the game "Cubes : brain teaser" doesn't appear at all! [00:12] Another example: https://itunes.apple.com/app/rise-free/id1206130260 [00:12] Can't find at Appshopper as well. [00:24] One other limitation of Appshopper is that through some trial and error, I think certain pages are not archived on their website because apps are released anything that not under "United States". [00:24] Or English, or something, it's a bit hazy on how it works but I came across these things. [00:35] This is the absolute example of what I'm talking about: https://itunes.apple.com/TH/app/id1050551131?mt=8 [00:37] When you change "th" (it's not case sensitive) to something like https://itunes.apple.com/us/app/id1050551131?mt=8 or https://itunes.apple.com/jp/app/id1050551131?mt=8 - it doesn't exist, because it's not released in that country. [00:38] *** pizzaiolo has quit IRC (Read error: Connection reset by peer) [00:39] It's like someone at the company forgot to release it worldwide instead of that one country (as far as I know). [00:40] *** pizzaiolo has joined #archiveteam-bs [00:44] *** pnJay has quit IRC (Leaving) [00:46] Or they can't release it outside a certain jurisdiction for legal reasons. [00:47] But yeah, you'll only be able to get a complete, comprehensive archive of all apps in all countries for $$$$$$$. [00:47] *** GE has quit IRC (Remote host closed the connection) [00:47] *** DopefishJ has joined #archiveteam-bs [00:48] *** JAA has quit IRC (Quit: Page closed) [00:49] When finding "Dragon Encounter" on Appshopper, it's not found. Going into http://appshopper.com/games/dragon-encounter manually shows that this game is delisted, but the game clearly exists on that page I linked earlier, but under country "th". [00:50] I want to say that Appshopper failed to recognize that the game exists, and removes the "delisted" mark, but it seems to be muddled in that when clicking "Buy" to go thru referal link gives me https://itunes.apple.com/us/app/apple-store/id1080905142?mt=8 - whereas the one I found is https://itunes.apple.com/th/app/id1050551131?mt=8 [00:51] *** t2t2 has joined #archiveteam-bs [00:52] *** DFJustin has quit IRC (Read error: Connection reset by peer) [00:52] *** bztoot has quit IRC (Quit: No Ping reply in 180 seconds.) [00:59] That's all the limitations of Appshopper that I know of. [00:59] I'm saying this as someone who doesn't have an account, as I'm not sure if it opens up a lot more if you use an account. [01:25] All the info I can give so far, that's my proposal on perpetual archiving of Appshopper's app pages (new and updates, unsure about price changes). There's a lot of quirks to mind when handling Appshopper. [01:25] Oh yeah! [01:25] One other thing, app developers can request their apps to not be listed on their website. [01:29] Or that's what I think it was checking http://appshopper.com/copyright-agent/ again [01:36] *** iSO has quit IRC (Quit: Page closed) [01:38] *** Ravenloft has quit IRC (Remote host closed the connection) [02:17] *** ndiddy has joined #archiveteam-bs [02:18] *** pizzaiolo has left [02:54] How long does it normally take for something to show up on archive.fart.website/archivebot/viewer/ ? [02:57] nightpool: a couple of days or so [02:57] Ah, thanks [02:57] it has to be uploaded to IA, then the viewer has to index it [02:58] yeah. How long does it take archivebot stuff to make it into IA? [02:58] a couple of days or so :-) [02:58] and is there any additional delay betweeen it getting derived and it going onto the wayback machine? [02:58] I'm trying to test if vines with --youtube-dl will get archived properly. [02:58] there are a lot of sources of delay :-) [03:00] If it isn't in the Wayback Machine within a week, I think that would be an unusual delay -- but I'm not sure. [03:08] *** VADemon has quit IRC (Quit: left4dead) [03:47] *** ndiddy has quit IRC () [04:34] *** jbroome has quit IRC (Read error: Operation timed out) [04:37] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [04:45] *** Sk1d has joined #archiveteam-bs [05:12] *** DopefishJ is now known as DFJustin [05:43] *** vap9r has left [05:57] *** akaibu has quit IRC (Quit: Connection closed for inactivity) [06:12] *** Honno has joined #archiveteam-bs [06:58] *** schbirid has joined #archiveteam-bs [07:08] so i found a way to auto rename the mp4s for tagesschau 20-clock evening news [07:09] but they suck at put right info for dates on the pages sometimes [07:21] *** GE has joined #archiveteam-bs [07:29] anyways march of 1994 episodes of tagesschau is going up [07:35] *** schbirid2 has joined #archiveteam-bs [07:38] *** schbirid has quit IRC (Read error: Operation timed out) [07:50] *** wabu has quit IRC (Read error: Operation timed out) [08:22] *** wabu has joined #archiveteam-bs [08:34] *** chrono has quit IRC (Quit: ZNC 1.6.3+deb1 - http://znc.in) [08:42] *** chrono- has joined #archiveteam-bs [08:42] *** chrono- has quit IRC (Client Quit) [08:42] *** chrono has joined #archiveteam-bs [09:04] *** GE has quit IRC (Remote host closed the connection) [10:29] *** GE has joined #archiveteam-bs [10:58] *** Jonison has joined #archiveteam-bs [10:58] *** SilSte has joined #archiveteam-bs [11:28] *** pizzaiolo has joined #archiveteam-bs [12:00] *** username1 has joined #archiveteam-bs [12:02] *** schbirid2 has quit IRC (Read error: Operation timed out) [12:23] *** Honno_ has joined #archiveteam-bs [12:28] *** Honno has quit IRC (Ping timeout: 370 seconds) [12:35] *** Honno__ has joined #archiveteam-bs [12:37] *** BlueMaxim has quit IRC (Read error: Operation timed out) [12:40] *** Honno_ has quit IRC (Ping timeout: 370 seconds) [13:41] *** pnJay has joined #archiveteam-bs [14:18] *** HP has quit IRC (Read error: Operation timed out) [14:21] *** HP has joined #archiveteam-bs [14:36] *** odemg has joined #archiveteam-bs [14:39] *** JensRex has quit IRC (Remote host closed the connection) [14:40] *** schbirid2 has joined #archiveteam-bs [14:41] *** JAA has joined #archiveteam-bs [14:41] *** JensRex has joined #archiveteam-bs [14:44] *** username1 has quit IRC (Read error: Operation timed out) [14:48] My WunderBlogs grab is done. :-) [15:24] *** username1 has joined #archiveteam-bs [15:28] *** schbirid2 has quit IRC (Read error: Operation timed out) [15:37] *** username1 is now known as schbirid [15:53] *** Stilett0 is now known as Stiletto [16:16] *** odemg has quit IRC (Remote host closed the connection) [16:20] *** schbirid2 has joined #archiveteam-bs [16:22] *** schbirid has quit IRC (Read error: Operation timed out) [16:30] *** odemg has joined #archiveteam-bs [16:31] *** RichardG_ has joined #archiveteam-bs [16:35] *** RichardG has quit IRC (Read error: Operation timed out) [16:44] *** username1 has joined #archiveteam-bs [16:46] *** odemg has quit IRC (Remote host closed the connection) [16:47] *** odemg has joined #archiveteam-bs [16:48] *** schbirid2 has quit IRC (Read error: Operation timed out) [17:03] *** schbirid2 has joined #archiveteam-bs [17:07] *** username1 has quit IRC (Read error: Operation timed out) [17:27] *** username1 has joined #archiveteam-bs [17:31] *** schbirid2 has quit IRC (Read error: Operation timed out) [17:47] *** LastNinja has quit IRC (Remote host closed the connection) [17:48] *** LastNinja has joined #archiveteam-bs [17:50] *** schbirid2 has joined #archiveteam-bs [17:52] *** username1 has quit IRC (Read error: Operation timed out) [17:53] *** username1 has joined #archiveteam-bs [17:56] *** schbirid2 has quit IRC (Read error: Operation timed out) [18:16] *** schbirid2 has joined #archiveteam-bs [18:19] *** username1 has quit IRC (Read error: Operation timed out) [18:30] *** ndiddy has joined #archiveteam-bs [18:38] *** username1 has joined #archiveteam-bs [18:41] *** schbirid2 has quit IRC (Read error: Operation timed out) [19:10] *** GE has quit IRC (Quit: zzz) [19:19] *** schbirid2 has joined #archiveteam-bs [19:23] *** RichardG_ is now known as RichardG [19:23] *** username1 has quit IRC (Read error: Operation timed out) [19:37] *** Stiletto has quit IRC (Ping timeout: 244 seconds) [19:37] *** username1 has joined #archiveteam-bs [19:40] *** schbirid2 has quit IRC (Read error: Operation timed out) [20:05] What is the preferred compression for uploading to IA, zip or .tar.gz? [20:06] zip [20:06] unless you have special circumstances [20:27] *** schbirid2 has joined #archiveteam-bs [20:28] *** schbirid2 has quit IRC (Client Quit) [20:30] *** GE has joined #archiveteam-bs [20:30] *** username1 has quit IRC (Read error: Operation timed out) [20:31] *** K4k has joined #archiveteam-bs [20:31] rocode: thanks for the heads up. I was unaware of this channel [20:33] * xmc grumbles that it's in the #archiveteam channel topic [20:34] xmc, who do we need to talk to for a warrior project setup? [20:35] i'm not sure who's done it recently. look in the archiveteam github for creators of recent projects? [20:35] Normally I ping arkiver but I haven't seen him around. :P [20:39] *** pnJay has quit IRC (Quit: Leaving) [20:43] *** pnJay has joined #archiveteam-bs [20:47] *** odemg has quit IRC (Remote host closed the connection) [20:50] *** odemg has joined #archiveteam-bs [20:51] *** pnJay_ has joined #archiveteam-bs [20:51] *** pnJay_ has quit IRC (Read error: Connection reset by peer) [20:52] *** pnJay_ has joined #archiveteam-bs [20:55] *** pnJay_ has quit IRC (Read error: Connection reset by peer) [20:56] *** pnJay_ has joined #archiveteam-bs [20:56] *** btfo has quit IRC (Read error: Operation timed out) [20:59] *** pnJay has quit IRC (Read error: Operation timed out) [21:04] An update on my Mininova grab: 780k done, currently 11k queued, but that's nowhere near the actual number. I'm skipping some pages which don't contain additional information so I can at least get all the torrent descriptions and .torrent files in time. [21:04] *** pnJay_ has quit IRC (Read error: Connection reset by peer) [21:05] I'm currently at 62.5k .torrents downloaded, 64.7k discovered. Should be similar for the descriptions. [21:05] *** pnJay_ has joined #archiveteam-bs [21:06] (Out of 72055 total according to the website's statistics page) [21:09] *** pnJay_ has quit IRC (Read error: Connection reset by peer) [21:10] *** pnJay has joined #archiveteam-bs [21:11] *** pnJay has quit IRC (Client Quit) [21:11] *** btfo has joined #archiveteam-bs [21:11] *** pnJay has joined #archiveteam-bs [21:12] Sorry if i have been connection spamming, windows went weird on me [21:13] *** Jonison has quit IRC (Read error: Connection reset by peer) [21:14] *** pnJay has quit IRC (Client Quit) [21:24] *** pnJay has joined #archiveteam-bs [21:24] *** JAA has quit IRC (Quit: Page closed) [21:25] save me tom cruise x.x [22:20] *** Stilett0 has joined #archiveteam-bs [22:39] *** REiN^ has quit IRC (Read error: Operation timed out) [22:40] *** odemg has quit IRC (Remote host closed the connection) [22:40] *** REiN^ has joined #archiveteam-bs [22:41] *** odemg has joined #archiveteam-bs [23:08] *** BlueMaxim has joined #archiveteam-bs [23:09] *** Stilett0 is now known as Stiletto [23:23] so NewsActive3 youtube channel is over +137gb [23:24] i'm still not done downloading it [23:25] hi rocode [23:25] I'm available [23:25] arkiver, we need your assistance in bringing all the boys to the yard. [23:26] arkiver, we need a project for http://archiveteam.org/index.php?title=MLKSHK [23:26] having a look at it [23:26] Closure date is April 6th/7th, but it can technically die at any time. Posts were frozen on April 1st. [23:28] do we know if post IDs are incremental? https://mlkshk.com/p/QUHG [23:28] looks like it [23:29] it's incremental, all digits and capital letters [23:30] I'll get something going [23:30] do we have a channel? [23:30] #totheyard [23:33] *** bwn has quit IRC (Ping timeout: 244 seconds) [23:39] *** bwn has joined #archiveteam-bs [23:52] *** VeganMar- has quit IRC (Ping timeout: 250 seconds) [23:53] *** Honno__ has quit IRC (Ping timeout: 370 seconds) [23:53] *** VeganMars has joined #archiveteam-bs