[00:27] *** DoomTay has joined #archiveteam [00:35] *** pguth_ has quit IRC (Remote host closed the connection) [00:35] *** pguth_ has joined #archiveteam [00:38] *** philpem has quit IRC (Ping timeout: 260 seconds) [00:49] SketchCow: so we want to have archivebot check if something is already in the wayback machine while it's doing the grabs? [00:50] Or will this be after a grab finished? [00:50] or only a deduplication of record on IA's side? [00:52] Not clear yet [00:52] I think it'd be best to not do it during a crawl. [01:06] Yeah, especially if you'll be checkin each asset. That would take forever [01:09] *** nightpool has quit IRC (Read error: Operation timed out) [01:14] It would be nice to *know* how many URLs were in the wayback machine via a archivebot exclamation command. I wouldn't want it to automatically de-dupe at that point though, of course. [01:46] *** RichardG has quit IRC (Ping timeout: 258 seconds) [01:50] *** anjacks0n has joined #archiveteam [01:53] *** anjacks0n has quit IRC (Ping timeout: 190 seconds) [02:12] *** nightpool has joined #archiveteam [02:30] *** pguth_ has quit IRC (Remote host closed the connection) [02:30] *** pguth_ has joined #archiveteam [02:39] *** pguth_ has quit IRC (Remote host closed the connection) [02:39] *** pguth_ has joined #archiveteam [03:22] *** ndiddy has quit IRC (Read error: Connection reset by peer) [03:22] *** khaoohs_ has quit IRC (Read error: Connection reset by peer) [03:22] *** khaoohs_ has joined #archiveteam [03:22] *** beardicus has quit IRC (Read error: Operation timed out) [03:23] *** ndiddy has joined #archiveteam [03:23] *** Coderjoe has quit IRC (Read error: Operation timed out) [03:24] *** trs80 has quit IRC (ircd.choopa.net irc.umich.edu) [03:24] *** remsen has quit IRC (Read error: Operation timed out) [03:24] *** remsen has joined #archiveteam [03:26] *** beardicus has joined #archiveteam [03:26] *** swebb sets mode: +o beardicus [03:28] *** wp494 has quit IRC (Read error: Connection reset by peer) [03:33] *** Coderjoe has joined #archiveteam [04:05] *** RichardG has joined #archiveteam [04:28] *** robink has quit IRC (Ping timeout: 246 seconds) [04:34] *** Aranje has joined #archiveteam [04:38] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:40] *** robink has joined #archiveteam [04:45] *** redlob_ has quit IRC (Read error: Operation timed out) [04:46] *** Sk1d has joined #archiveteam [04:49] *** redlob has joined #archiveteam [05:02] *** Asparagir has quit IRC (Asparagir) [05:08] *** ndiddy has quit IRC (Quit: Leaving) [05:14] *** JesseW has quit IRC (Ping timeout: 370 seconds) [05:30] *** DoomTay has quit IRC (Quit: Page closed) [05:38] *** wp494 has joined #archiveteam [05:56] *** nightpool has quit IRC (Read error: Operation timed out) [06:03] *** Aranje has quit IRC (Quit: Three sheets to the wind) [06:05] *** nightpool has joined #archiveteam [06:12] *** nightpool has quit IRC (Read error: Operation timed out) [06:18] hm, my waffleimages rsync stopped... [06:27] *** Coderjoe has quit IRC (Read error: Operation timed out) [06:28] *** trs80 has joined #archiveteam [06:28] *** REiN^ has joined #archiveteam [06:31] *** pguth_ has quit IRC (Remote host closed the connection) [06:31] *** pguth_ has joined #archiveteam [06:35] *** schbirid has joined #archiveteam [06:36] *** VADemon has joined #archiveteam [06:41] *** kristian_ has joined #archiveteam [06:42] Scuttle: Sorry about that, inode quota was exceeded. I increased it to 100m files. Can you try again? [06:44] *** Coderjoe has joined #archiveteam [07:00] done [07:01] 2587252 files in total [07:04] *** nertzy has quit IRC (Read error: Operation timed out) [07:06] *** nightpool has joined #archiveteam [07:13] *** nightpool has quit IRC (Ping timeout: 244 seconds) [07:27] *** kristian_ has quit IRC (Leaving) [07:49] *** fdc has joined #archiveteam [07:49] *** fdc has quit IRC (Client Quit) [08:01] arkiver: Second scan of Yahoo! Answers completed. Found 6m items: https://6xq.net/paste/ya-qid-2016-08-01.txt.xz [08:02] *** Coderjoe has quit IRC (Read error: Operation timed out) [08:03] *** Coderjoe has joined #archiveteam [08:09] *** nightpool has joined #archiveteam [08:13] *** nightpool has quit IRC (Ping timeout: 250 seconds) [08:49] *** WinterFox has joined #archiveteam [09:11] *** tomwsmf has quit IRC (Read error: Operation timed out) [09:11] *** tomwsmf has joined #archiveteam [09:24] *** BlueMaxim has quit IRC (Read error: Operation timed out) [09:25] *** nightpool has joined #archiveteam [09:30] *** nightpool has quit IRC (Ping timeout: 250 seconds) [09:31] *** BlueMaxim has joined #archiveteam [09:31] *** tomwsmf has quit IRC (Ping timeout: 258 seconds) [09:48] *** REiN^ has quit IRC () [09:53] *** signius has quit IRC (Ping timeout: 260 seconds) [10:05] *** signius has joined #archiveteam [10:14] *** REiN^ has joined #archiveteam [10:26] *** nightpool has joined #archiveteam [10:31] *** nightpool has quit IRC (Ping timeout: 260 seconds) [10:36] *** pguth_ has quit IRC (Remote host closed the connection) [10:37] *** pguth_ has joined #archiveteam [11:26] *** BlueMaxim has quit IRC (Quit: Leaving) [11:27] *** nightpool has joined #archiveteam [11:30] *** Morbus has quit IRC (Quit: http://www.disobey.com/) [11:35] *** nightpool has quit IRC (Read error: Operation timed out) [12:28] *** nightpool has joined #archiveteam [12:37] *** nightpool has quit IRC (Read error: Operation timed out) [12:47] *** pguth_ has quit IRC (Remote host closed the connection) [12:47] *** pguth_ has joined #archiveteam [12:52] *** nightpool has joined #archiveteam [12:57] *** nightpool has quit IRC (Ping timeout: 244 seconds) [13:03] *** Morbus has joined #archiveteam [13:17] *** WinterFox has quit IRC (Read error: Operation timed out) [13:34] *** Atom-- has joined #archiveteam [13:48] *** Coderjoe has quit IRC (Read error: Operation timed out) [13:53] *** RichardG has quit IRC (Ping timeout: 633 seconds) [13:55] *** vitzli has joined #archiveteam [13:59] *** nightpool has joined #archiveteam [14:00] *** pguth_ has quit IRC (Remote host closed the connection) [14:00] *** pguth_ has joined #archiveteam [14:03] *** JSharp___ has quit IRC (Read error: Connection reset by peer) [14:03] *** Ctrl-S___ has quit IRC (Write error: Connection reset by peer) [14:03] *** beeper has quit IRC (Read error: Connection reset by peer) [14:04] *** Boltsie has quit IRC (Read error: Connection reset by peer) [14:04] *** sigkell has quit IRC (Ping timeout: 260 seconds) [14:04] *** abartov__ has quit IRC (Ping timeout: 260 seconds) [14:04] *** antonizoo has quit IRC (Ping timeout: 260 seconds) [14:04] *** kevin has quit IRC (Ping timeout: 260 seconds) [14:04] *** VonGuard has quit IRC (Ping timeout: 260 seconds) [14:04] *** voltagex has quit IRC (Read error: Connection reset by peer) [14:04] *** HCross2 has quit IRC (Read error: Connection reset by peer) [14:04] *** johtso has quit IRC (Read error: Connection reset by peer) [14:04] *** nightpool has quit IRC (Read error: Operation timed out) [14:04] *** uiolll has joined #archiveteam [14:05] *** uiolll has quit IRC (Client Quit) [14:06] *** Coderjoe has joined #archiveteam [14:09] *** antonizoo has joined #archiveteam [14:12] *** JSharp___ has joined #archiveteam [14:12] *** deathy has quit IRC (Connection closed) [14:13] *** Ctrl-S___ has joined #archiveteam [14:15] *** beeper has joined #archiveteam [14:15] *** Boltsie has joined #archiveteam [14:16] *** sigkell has joined #archiveteam [14:37] *** HCross2 has joined #archiveteam [14:37] *** abartov__ has joined #archiveteam [14:37] *** johtso has joined #archiveteam [14:37] *** kevin has joined #archiveteam [14:37] *** VonGuard has joined #archiveteam [14:40] *** VADemon has quit IRC (Quit: left4dead) [14:47] *** RichardG has joined #archiveteam [14:47] *** Coderjoe has quit IRC (Read error: Operation timed out) [14:49] *** metalcamp has joined #archiveteam [14:58] *** K4k_ has quit IRC (Quit: WeeChat 1.5) [14:59] *** K4k has joined #archiveteam [15:12] Thank you PurpleSym! [15:26] *** Coderjoe has joined #archiveteam [15:31] *** nightpool has joined #archiveteam [15:35] *** JesseW has joined #archiveteam [15:36] arkiver: I’ll repeat the same search for the localized Y!A now, but I’ll have to do it for each of the 22 sites separately it seems. [15:37] would be great if you can do that [15:37] I'm currently working on flickr, it's going well [15:39] Yeah, that second Flickr crawl of mine still has not finished… It’ll take a few more weeks. [15:52] *** Coderjoe_ has joined #archiveteam [15:52] *** Coderjoe has quit IRC (Read error: Operation timed out) [15:56] *** Doom_ has joined #archiveteam [15:56] *** Doom_ has left [15:57] *** DoomTay has joined #archiveteam [16:06] *** JesseW has quit IRC (Ping timeout: 370 seconds) [16:25] *** pguth_ has quit IRC (Remote host closed the connection) [16:25] *** pguth_ has joined #archiveteam [16:26] https://www.grahamcluley.com/2016/08/secure-email-service-ghostmail-shutting-fear-abused/ [16:29] https://www.youtube.com/watch?v=GFiBYrBLlYI [16:39] *** anjacks0n has joined #archiveteam [16:40] *** pguth_ has quit IRC (Remote host closed the connection) [16:40] *** pguth_ has joined #archiveteam [16:47] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [16:51] *** nightpool has quit IRC (Read error: Connection reset by peer) [16:51] *** metalcamp has quit IRC (Quit: Bye) [16:57] *** sep332 has quit IRC (Read error: Connection reset by peer) [17:08] *** nightpool has joined #archiveteam [17:19] *** ndiddy has joined #archiveteam [17:25] Kagi, payment processor, died yesterday: http://webcache.googleusercontent.com/search?q=cache:cjYVLvwvgxMJ:www.kagi.com/+&cd=1&hl=en&ct=clnk&gl=us [17:35] *** Honno has joined #archiveteam [17:47] *** sep332 has joined #archiveteam [17:49] *** Honno_ has joined #archiveteam [17:51] *** Honno__ has joined #archiveteam [17:59] *** Honno has quit IRC (Read error: Operation timed out) [18:03] *** Honno_ has quit IRC (Read error: Operation timed out) [18:06] *** philpem has joined #archiveteam [18:31] WHAT [18:31] HOLY SHIT [18:31] REALLY [18:37] SketchCow: ? [18:39] *** vitzli has quit IRC (Leaving) [18:40] Kagi.com was one of my first providers [18:40] o my [18:40] Ouch [18:50] *** Coderjoe_ has quit IRC (Read error: Operation timed out) [19:13] *** sanquiAFK has quit IRC (Ping timeout: 260 seconds) [19:14] *** DoomTay has quit IRC (Quit: Page closed) [19:14] *** Coderjoe has joined #archiveteam [19:16] *** Honno__ has quit IRC (Read error: Operation timed out) [19:21] *** Honno__ has joined #archiveteam [19:22] *** tomwsmf has joined #archiveteam [19:34] so how long do we think google will keep this up? https://www.localguidesconnect.com/ [19:39] *** Sanqui has joined #archiveteam [19:57] *** DoomTay has joined #archiveteam [20:05] *** Honno__ has quit IRC (Read error: Operation timed out) [20:23] Is that the thing they launched this week? [20:25] *** schbirid has quit IRC (Quit: Leaving) [20:25] Looks like yet another way to enlist free workforce, so they'll keep it open as long as it produces more than it costs, pretty easy [20:39] *** Coderjoe has quit IRC (Ping timeout: 260 seconds) [20:48] *** Coderjoe has joined #archiveteam [20:49] is there any good way of downloading all pictures from a FB profile? [20:50] have you tried the facebook export tool? [20:53] *** RichardG has joined #archiveteam [20:56] *** zhongfu has quit IRC (Remote host closed the connection) [20:58] *** zhongfu has joined #archiveteam [21:00] *** DiscantX has joined #archiveteam [21:01] *** RichardG has quit IRC (Ping timeout: 258 seconds) [21:02] *** RichardG has joined #archiveteam [21:07] *** RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) [21:32] well its not my profile [21:33] but I can borrow her laptop when she is not looking... nvm [21:59] *** REiN^ has quit IRC (Read error: Operation timed out) [22:00] *** pguth_ has quit IRC (Remote host closed the connection) [22:01] *** pguth_ has joined #archiveteam [22:04] .... [22:10] *** DoomTay has quit IRC (Quit: Page closed) [22:48] *** DoomTay has joined #archiveteam [23:01] *** nightpool has quit IRC (Read error: Operation timed out) [23:02] *** BlueMaxim has joined #archiveteam [23:30] *** DoomTay has quit IRC (Quit: Page closed) [23:34] *** RichardG has joined #archiveteam