[01:06] if it comes down to IA SPN vs AB !ao, I'd like to think that issuing AB !ao commands is less load on IA than using IA SPN. I know it is less immediate load. But OTOH, with whoever is scraping AB for URLs and submitting those back to IA SPN, means that single pages are getting grabbed twice. [01:34] Hmm, problem is I don't exactly wanna spam it up with a ton of "!ao" stuff in #archivebot as there's no -spam equivalent right now [01:35] The big advantage of AB is that the WARCs are publicly accessible. [01:39] Does that apply the same with chromebot? [01:41] Yes, but the chromebot archives are a bit messier since all jobs are mixed together into one WARC. [01:42] Still publicly accessible though. [01:53] Ah, interesting~ [02:08] *** sivoais_ has quit IRC (Read error: Operation timed out) [02:11] *** dxrt has quit IRC (Ping timeout: 276 seconds) [02:13] *** sivoais has joined #internetarchive [02:14] Ryz, !ao commands can be combined. Look at what socialbot does [02:14] e.g. !ao < https://transfer.notkiska.pw/ZuKSM/twitter-%23CoronaVirusSA --explain "For Craigle - socialscrape job 87b042289aa73354cf1c12a03b769ce29d193513" [02:14] *** dxrt has joined #internetarchive [02:15] *** svchfoo3 sets mode: +o dxrt [02:17] Ryz is well aware of that, but it only makes sense if the URLs in the list have some relation. If they don't, I'll /kickban your arse out of #archivebot faster than you can blink. :-) [02:29] Heh, yeah I'm aware of "!ao <", the list of links I'm working through it's just a personal list of individual links relating to video games stuff; don't think it's necessarily worth it to run it in a list [02:30] You did say AB is more efficient than WBM's SPN atphoenix~ [02:43] not sure if that was directed at me, but I haven't submitted any unrelated lists via "!ao <". Probably should have added a 'to state the obvious' to my earlier message. [02:45] as for efficiency...I said I *think* AB is less load. It should be less load, if considered a single page grab is considered in isolation. I don't have proof. I did point out another caveat that probably flips the balance the other way. Public WARC access is certainly an AB advantage. [02:45] delete first instance of 'considered' [02:50] *** VADemon has quit IRC (Read error: Connection reset by peer) [03:06] *** qw3rty__ has joined #internetarchive [03:14] *** qw3rty_ has quit IRC (Read error: Operation timed out) [03:59] *** fredgido has joined #internetarchive [04:07] *** fredgido_ has quit IRC (Read error: Operation timed out) [04:35] *** dxrt_ has quit IRC (Ping timeout (120 seconds)) [04:35] *** dxrt_ has joined #internetarchive [04:35] *** dxrt sets mode: +o dxrt_ [07:12] *** legoktm has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.) [07:22] *** legoktm has joined #internetarchive [08:53] *** OrIdow6 has quit IRC (Ping timeout: 276 seconds) [09:12] *** OrIdow6 has joined #internetarchive [12:59] *** figpucker has joined #internetarchive [13:00] *** figpucker has quit IRC (Read error: Connection reset by peer) [13:01] *** figpucker has joined #internetarchive [13:51] *** figpucker has quit IRC (Quit: Leaving) [14:27] AB is definitely less load for IA than SPN2. No idea about SPN1. [18:40] *** systwi_ has joined #internetarchive [18:47] *** systwi has quit IRC (Ping timeout: 622 seconds) [21:25] *** DogsRNice has joined #internetarchive [22:15] *** fredgido has quit IRC (Remote host closed the connection) [22:16] *** fredgido has joined #internetarchive [22:26] *** jrwr has quit IRC (Ping timeout: 264 seconds) [22:31] *** svchfoo1 has quit IRC (hub.efnet.us irc.servercentral.net) [22:48] *** jrwr has joined #internetarchive [22:50] *** jrwr has quit IRC (Ping timeout: 264 seconds) [23:24] *** kiska117 has joined #internetarchive [23:54] *** svchfoo1 has joined #internetarchive [23:55] *** svchfoo3 sets mode: +o svchfoo1 [23:57] *** jrwr has joined #internetarchive