[00:02] *** pizzaiolo has joined #archiveteam-bs [00:16] *** Asparagir has joined #archiveteam-bs [00:20] *** Yoshimura has quit IRC (Ping timeout: 255 seconds) [00:24] *** Simpbrain has joined #archiveteam-bs [00:36] *** wp494 has joined #archiveteam-bs [00:37] *** dashcloud has quit IRC (Read error: Operation timed out) [00:38] *** dashcloud has joined #archiveteam-bs [00:38] *** Ravenloft has joined #archiveteam-bs [00:50] https://torrentfreak.com/tool-downloads-any-netflix-video-instantly-161228/ [00:50] oh wow [01:29] *** yuitimoth has joined #archiveteam-bs [01:39] so i will be uploading some 32kbs versions of Wallbuilders Live [01:39] i can't get 2012-06 to 2012-08-27 mp3s [01:39] there descriptions for those with mp3 links but the mp3 links don't work [02:24] *** Ravenloft has quit IRC (Ping timeout: 264 seconds) [03:08] *** Start_ has joined #archiveteam-bs [03:09] *** Start has quit IRC (Read error: Operation timed out) [03:20] *** robink has quit IRC (Ping timeout: 246 seconds) [03:23] *** robink has joined #archiveteam-bs [03:25] *** wm_ has quit IRC (Quit: gone) [03:30] *** wm_ has joined #archiveteam-bs [03:45] *** wm_ has quit IRC (Quit: gone) [03:45] *** ndiddy has joined #archiveteam-bs [03:49] *** wm_ has joined #archiveteam-bs [04:06] *** jrwr has quit IRC (Remote host closed the connection) [04:37] As pointed out by a couple people, the pipeline information page broke. [04:37] Seems to be a known linux stupid [04:37] So it's working again. New one being generated as we speak. [04:37] fos.textfiles.com/pipeline.html [04:43] *** ndiddy has quit IRC (Quit: Leaving) [04:50] *** VADemon has joined #archiveteam-bs [05:15] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [05:21] *** Sk1d has joined #archiveteam-bs [06:11] *** Asparagir has quit IRC (Asparagir) [06:24] *** pizzaiolo has quit IRC (Remote host closed the connection) [08:37] *** balrog has quit IRC (Read error: Operation timed out) [08:40] *** dashcloud has quit IRC (Ping timeout: 250 seconds) [08:41] *** balrog has joined #archiveteam-bs [08:45] We have no method to archive all of the files on https://www.androidfilehost.com/ [08:45] Which is extremely valuable but archivebot seems to have issues with it [08:46] *** dashcloud has joined #archiveteam-bs [08:51] Jon: Audio files are currently uploading to IA. I’m also running grab-site on forum.nin.com [08:54] Does phantomjs handle countdowns? Because androidfilehost makes someone wait 10 seconds before it gives them the link to the file [08:57] no [09:20] *** Honno has joined #archiveteam-bs [09:24] Just found this petition on accident: https://secure.avaaz.org/en/petition/The_Internet_Archive_Include_Every_Site_on_the_Wayback_Machine_Regardless_of_Robotstxt/ [09:29] if the download url is there in the js in plaintext, wpull will find it, otherwise no [09:30] *** yuitimoth has quit IRC (Remote host closed the connection) [09:32] It is not, 3 requests are made to get server mirrors [09:41] *** arkiver2 has joined #archiveteam-bs [09:44] *** schbirid has joined #archiveteam-bs [09:55] *** sroot has joined #archiveteam-bs [09:56] hook54321, hi [09:57] hi, this is what you missed: [09:57] if the download url is there in the js in plaintext, wpull will find it, otherwise no [09:57] It is not, 3 requests are made to get server mirrors [10:00] Hmm... [10:05] This might be more then what I really bargained for. I checked on Upwork with some python experts, its affordable and it most likely require updates as the host will change certain things. I like the goal of this, I'll run the Warrior app on my vms [10:21] *** sroot has quit IRC (Quit: sroot) [10:47] *** yuitimoth has joined #archiveteam-bs [10:59] *** siemensak has joined #archiveteam-bs [11:13] *** yan has quit IRC (Ping timeout: 260 seconds) [11:23] *** yan has joined #archiveteam-bs [11:29] *** BlueMaxim has quit IRC (Read error: Operation timed out) [11:30] *** yuitimoth has quit IRC (Remote host closed the connection) [11:48] *** Stilett0 has joined #archiveteam-bs [11:50] *** Stiletto has quit IRC (Read error: Operation timed out) [12:01] *** sep332 has quit IRC (konversation out) [12:04] *** yuitimoth has joined #archiveteam-bs [12:40] *** siemensak has quit IRC (Ping timeout: 268 seconds) [12:41] *** siemensak has joined #archiveteam-bs [12:56] *** siemensak has quit IRC (Quit: Page closed) [13:07] *** yuitimoth has quit IRC (Remote host closed the connection) [13:54] pushing data into ACD is fast and with rclone easy [13:54] rclone does not seem as polished as i thought though [13:54] i am ge4tting countless 429s [14:00] and it sounds like verification is on size and timestamp, not hashes? [14:19] *** Whopper_ has joined #archiveteam-bs [14:21] *** Whopper has quit IRC (Read error: Operation timed out) [14:39] For anyone who uses rclone: It's a good idea to split big (40gb+) files. rclone doesn't always handle them well [14:49] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [15:25] *** RichardG has joined #archiveteam-bs [17:22] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [17:47] *** ndiddy has joined #archiveteam-bs [17:50] yan: OK, makes enough sense to me. I'll put the password back to what's listed on bugmenot, and mention it on the user page. If SketchCow or someone else objects to it or it starts being used for spam, they can disable it then. [18:16] *** Asparagir has joined #archiveteam-bs [18:18] Aoede: at least ACD ilmits to 50G max :\ [18:18] not rclone's fault in that cas [18:19] Oh didn't know that. I had same issue with hubic [18:19] (Using ACD now) [18:20] is there some easy way for automatic splitting? like the crypt remote thing? [18:22] Dunno, I use split. I would prefer something easier too [18:53] *** kyounko has joined #archiveteam-bs [19:48] *** arkiver2 has joined #archiveteam-bs [20:37] on the AT wiki I think we should split off the info about the government FTP archiving from the page [[USA-Gov]] [20:37] e.g. to a page called ftp-gov [20:40] I'd be bold but I forgot the s3cret password [20:42] yahoosucks [20:48] there's someone here who's trying to spin the Drake equation and cryogenics into some sort of coherent thread [20:48] I'm wondering how I suddenly transported to Palo Alto [20:50] yipdw: cryonics? [20:51] oops [20:51] yeah, that [21:23] What's the Drake equation? [21:27] the Drake equation is a thing used to frame arguments about the prevalance or absence of extraterrestrial civilizations [21:43] a funny one [21:45] *** BlueMaxim has joined #archiveteam-bs [21:52] *** Stilett0 has quit IRC (Read error: Operation timed out) [22:26] *** ndizzle has joined #archiveteam-bs [22:26] *** ndiddy has quit IRC (Read error: Connection reset by peer) [22:35] *** arkiver2 has quit IRC (Ping timeout: 244 seconds) [22:53] *** arkiver2 has joined #archiveteam-bs [22:54] *** arkiver2 has quit IRC (Client Quit) [22:55] *** arkiver2 has joined #archiveteam-bs [23:02] *** schbirid has quit IRC (Quit: Leaving) [23:11] Whenever I tty to start the warrior in virtualbox, it just crashes and says "A critical error has occurred while running the virtual machine and the machine execution has been stopped." [23:11] *try [23:12] What am I doing wrong? [23:12] It also says something about guru meditation [23:13] hook54321: does a normal VM work fine? [23:13] Dunno [23:15] I pressed ignore this time and it's just on a black screen with a little line kinda in the corner [23:24] *** yuitimoth has joined #archiveteam-bs [23:36] *** VADemon has quit IRC (Read error: Operation timed out) [23:58] *** Honno has quit IRC (Read error: Operation timed out)