[00:15] also, I had budget alerts setup for a $1 [00:15] so it shutdown the VMs ASAP once it ran out of credits [00:16] I had set it to 75% of the credits I had [00:34] *** Sk1d has quit IRC (Read error: Operation timed out) [00:34] *** BlueMax has quit IRC (Quit: Leaving) [00:36] *** Sk1d has joined #archiveteam-bs [00:43] *** pawbs has joined #archiveteam-bs [00:52] *** Sk1d has quit IRC (Read error: Operation timed out) [00:56] *** Sk1d has joined #archiveteam-bs [01:01] *** VerfiedJ has quit IRC (Quit: Leaving) [01:29] *** kbtoo has joined #archiveteam-bs [01:37] *** kbtoo_ has quit IRC (Read error: Operation timed out) [01:43] *** kbtoo_ has joined #archiveteam-bs [01:44] *** kbtoo has quit IRC (Ping timeout: 255 seconds) [02:04] PurpleSym: NOOOO! My laptop crashed while backing up Microchip after 6 days. [02:05] This is really sad. [02:19] *** arbin has quit IRC (Remote host closed the connection) [02:22] *** arbin has joined #archiveteam-bs [02:27] *** Sk1d has quit IRC (Read error: Operation timed out) [02:29] *** Sk1d has joined #archiveteam-bs [02:35] *** arbin has quit IRC (Quit: .) [02:36] *** arbin has joined #archiveteam-bs [02:39] *** arbin has quit IRC (Client Quit) [02:40] *** exoire has joined #archiveteam-bs [02:41] *** arbin has joined #archiveteam-bs [02:45] *** tapedrive has quit IRC (Ping timeout: 252 seconds) [02:45] *** betamax has quit IRC (Read error: Operation timed out) [03:10] *** Despatche has quit IRC (Read error: Connection reset by peer) [03:10] *** Despatche has joined #archiveteam-bs [03:12] *** Despatche has quit IRC (Client Quit) [03:13] *** Despatche has joined #archiveteam-bs [03:26] *** Despatche has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** Sk1d has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** brayden has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** ndiddy has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** odemgi has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** m007a83 has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** fredgido has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** frainz has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** mistym has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** LFlare has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** Kenshin has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** phuzion has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** ReimuHaku has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** Odd0002 has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** RichardG has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** Jens has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** chfoo has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** cf has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** dashcloud has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** yuitimoth has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** obskyr has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** thejsa has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** ats has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** atomicthu has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** robogoat has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** decay has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** ephemer0l has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** ggus has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** closure has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** Fletcher has quit IRC (hub.dk irc.inet.tele.dk) [03:26] *** robogoat_ has joined #archiveteam-bs [03:26] *** frainz_ has joined #archiveteam-bs [03:26] *** ats_ has joined #archiveteam-bs [03:26] *** RKenshin has joined #archiveteam-bs [03:26] *** ndiddy_ has joined #archiveteam-bs [03:26] *** decay_ has joined #archiveteam-bs [03:26] *** computerf has joined #archiveteam-bs [03:26] *** chfoo-_ has joined #archiveteam-bs [03:26] *** ggus_ has joined #archiveteam-bs [03:26] *** thejsa_ has joined #archiveteam-bs [03:26] *** brayden_ has joined #archiveteam-bs [03:26] *** Odd0002_ has joined #archiveteam-bs [03:26] *** RichardG_ has joined #archiveteam-bs [03:26] *** closure_ has joined #archiveteam-bs [03:27] *** fredgido_ has joined #archiveteam-bs [03:28] *** phuz has joined #archiveteam-bs [03:28] *** m007a83_ has joined #archiveteam-bs [03:32] *** actually_ has joined #archiveteam-bs [03:33] *** odemgi_ has joined #archiveteam-bs [03:34] *** erin has joined #archiveteam-bs [03:38] *** mistym- has joined #archiveteam-bs [03:41] *** ReimuHaku has joined #archiveteam-bs [03:41] *** jmtd is now known as Jon [03:41] *** Odd0002_ is now known as Odd0002 [03:41] *** RKenshin is now known as Kenshin [03:41] *** decay_ is now known as decay [03:41] *** ephemer0l has joined #archiveteam-bs [03:41] *** yuitimoth has joined #archiveteam-bs [03:42] *** dashcloud has joined #archiveteam-bs [03:42] *** LFlare has joined #archiveteam-bs [03:42] *** ndiddy_ is now known as ndiddy [03:43] *** atomicthu has joined #archiveteam-bs [03:53] *** icedice has joined #archiveteam-bs [04:03] *** Hani111 has joined #archiveteam-bs [04:07] *** Hani has quit IRC (Read error: Operation timed out) [04:07] *** Hani111 is now known as Hani [04:40] *** qw3rty118 has joined #archiveteam-bs [04:46] *** qw3rty117 has quit IRC (Read error: Operation timed out) [04:50] *** odemgi_ has quit IRC (Read error: Operation timed out) [04:52] *** odemg has quit IRC (Ping timeout: 265 seconds) [05:04] *** odemg has joined #archiveteam-bs [05:28] *** ndiddy has quit IRC (Read error: Operation timed out) [05:54] *** RichardG_ has quit IRC (Ping timeout: 252 seconds) [05:56] *** RichardG has joined #archiveteam-bs [07:06] *** odemgi has joined #archiveteam-bs [07:16] *** BlueMax has joined #archiveteam-bs [07:26] *** Oddly has joined #archiveteam-bs [07:27] *** exoire has quit IRC (Read error: Operation timed out) [07:50] *** Hani111 has joined #archiveteam-bs [07:55] *** Hani has quit IRC (Read error: Operation timed out) [07:56] *** Hani111 is now known as Hani [08:01] *** Oddly has quit IRC (Remote host closed the connection) [08:29] t3: I think there’s some magic to restart the job. [08:32] *** wp494_ has joined #archiveteam-bs [08:36] *** wp494 has quit IRC (Ping timeout: 265 seconds) [08:52] *** BlueMax has quit IRC (Quit: Leaving) [09:01] *** Mateon1 has quit IRC (Read error: Operation timed out) [09:02] *** Mateon1 has joined #archiveteam-bs [09:06] *** icedice has quit IRC (Quit: Leaving) [10:06] *** Gfy has quit IRC (Ping timeout: 265 seconds) [10:35] *** Hani111 has joined #archiveteam-bs [10:38] *** Hani111 has quit IRC (Client Quit) [10:39] *** Hani has quit IRC (Ping timeout: 255 seconds) [10:42] *** Hani has joined #archiveteam-bs [11:17] *** Sk1d has joined #archiveteam-bs [11:59] *** justas has joined #archiveteam-bs [12:03] *** Fletcher has joined #archiveteam-bs [12:22] latest digitize scans : https://www.patreon.com/posts/digitize-scans-24101025 [13:09] *** godane has quit IRC (Quit: Leaving.) [13:20] *** godane has joined #archiveteam-bs [13:20] *** VerfiedJ has joined #archiveteam-bs [13:25] *** jspiros has quit IRC (Quit: brb) [13:45] *** LFlare has quit IRC (Quit: Ping timeout (120 seconds)) [13:45] *** LFlare has joined #archiveteam-bs [13:48] *** justas is now known as jut [14:00] *** Gfy has joined #archiveteam-bs [14:00] arkiver: how would i upload that data to IA? i don't have any access [14:02] *** sardine has joined #archiveteam-bs [14:07] *** sardine has quit IRC (Remote host closed the connection) [14:48] *** alencar has joined #archiveteam-bs [15:25] *** Pixi has quit IRC (Quit: Pixi) [15:28] *** Pixi has joined #archiveteam-bs [15:48] *** VADemon has joined #archiveteam-bs [16:11] Fusl: create an account and use the IA python library [16:40] arkiver: like so? https://archive.org/details/www.minecraftforum.net-forums-2019-01-16-c12ee6eb-00000.warc.gz [16:43] that would be one of many parts [16:44] Can you set mediatype:web? [16:46] as --metadata=mediatype:web or --header=mediatype:web? [16:47] Metadata. [16:50] reuploading with metadata now [17:03] uploading www.minecraftforum.net-forums-2019-01-16-c12ee6eb-00000.warc.gz: [################################] 5121/5121 - 00:07:02 [17:03] error uploading www.minecraftforum.net-forums-2019-01-16-c12ee6eb-00000.warc.gz: Please reduce your request rate. - Your upload of mcf-00000 from username x3yhhh6e@meo.ws appears to be spam. If you believe this is a mistake, contact info@archive.org and include this entire message in your email. [17:03] :( [17:29] Fusl: I'd recommend one item for the whole thing, not one item per file. Unless it's very large and needs to be split up. [17:30] JAA: grab-site splits them up into 5gb parts and i offload the files onto slow storage when the disk gets full so there's that [17:32] *** wp494 has joined #archiveteam-bs [17:33] Fusl: Sure, but you can upload multiple files to one item. [17:34] by re-packaging them with something like warcio? [17:34] OH [17:34] i see what you mean [17:36] Simply 'ia upload identifier file1 file2 file3 ...' [17:36] (Plus any options you need, obviously.) [17:39] *** wp494_ has quit IRC (Read error: Operation timed out) [17:45] *** Sk1d has quit IRC (Read error: Operation timed out) [17:49] *** Sk1d has joined #archiveteam-bs [18:05] well i'll wait for the entire grab-site to finish then [18:06] *** betamax has joined #archiveteam-bs [18:23] *** tuluu has joined #archiveteam-bs [18:38] Fusl: Did it work? [18:39] the grab-site job is still running, 3.7M urls left to crawl [18:40] Okay. Let me know if you need help uploading to IA. [18:51] *** ndiddy has joined #archiveteam-bs [19:27] *** jspiros has joined #archiveteam-bs [19:55] *** exoire has joined #archiveteam-bs [20:10] I'm receiving "Disk quota exceeded" for Flickr uploads [20:12] uh [20:12] can you post the full log in #flickrfckr ? [20:12] Will see what I can do [20:23] *** RichardG_ has joined #archiveteam-bs [20:23] *** RichardG has quit IRC (Read error: Connection reset by peer) [20:59] *** ndiddy has quit IRC (Remote host closed the connection) [20:59] *** ndiddy has joined #archiveteam-bs [21:12] *** Despatche has joined #archiveteam-bs [21:24] *** BlueMax has joined #archiveteam-bs [21:37] *** tuluu has quit IRC (Read error: Operation timed out) [21:38] *** tuluu has joined #archiveteam-bs [21:59] *** ndiddy has quit IRC (Ping timeout: 265 seconds) [22:20] *** schbirid has quit IRC (Remote host closed the connection) [22:22] *** Sk1d has quit IRC (Read error: Operation timed out) [22:28] *** Sk1d has joined #archiveteam-bs [22:33] *** ndiddy has joined #archiveteam-bs [22:41] *** tomaspark has joined #archiveteam-bs [23:13] *** DFJustin has quit IRC (Remote host closed the connection) [23:17] *** DFJustin has joined #archiveteam-bs [23:18] *** svchfoo3 sets mode: +o DFJustin [23:24] *** Sk1d has quit IRC (Read error: Operation timed out) [23:26] *** Sk1d has joined #archiveteam-bs [23:51] not sure how big of a site they are, but got an email that WedPics.com is shutting down February 15.