#archiveteam 2019-08-20,Tue

↑back Search

Time Nickname Message
00:12 πŸ”— twigfoot has quit IRC (Read error: Operation timed out)
00:13 πŸ”— twigfoot has joined #archiveteam
00:17 πŸ”— twigfoot has quit IRC (Read error: Operation timed out)
00:17 πŸ”— twigfoot has joined #archiveteam
00:25 πŸ”— twigfoot has quit IRC (Read error: Operation timed out)
00:27 πŸ”— ris has quit IRC (Read error: Operation timed out)
00:40 πŸ”— justas1 has joined #archiveteam
00:46 πŸ”— justas has quit IRC (Ping timeout: 745 seconds)
02:02 πŸ”— Verified_ has quit IRC (Ping timeout: 252 seconds)
02:05 πŸ”— Verified_ has joined #archiveteam
02:14 πŸ”— Pixi` has quit IRC (Quit: Pixi`)
02:15 πŸ”— Pixi has joined #archiveteam
03:11 πŸ”— twigfoot has joined #archiveteam
03:15 πŸ”— qw3rty113 has joined #archiveteam
03:17 πŸ”— DogsRNice has quit IRC (Read error: Connection reset by peer)
03:21 πŸ”— qw3rty112 has quit IRC (Ping timeout: 600 seconds)
03:33 πŸ”— CyberVenu has joined #archiveteam
03:35 πŸ”— odemgi has joined #archiveteam
03:39 πŸ”— odemgi_ has quit IRC (Read error: Operation timed out)
03:40 πŸ”— CyberVenu Are we aware of or looked into shodan.io ? At first I was thinking about using their FTP server list for that project, but then I realized that they list everything even all the servers with no public contents. So now I’m thinking we should have an archive of just the database, which they just hand out to enterprise users, and subscribed users have an API but can’t just download an entire database dump in one go. Free users seem to have unrestrict
03:40 πŸ”— CyberVenu I can tell, but only via the website interface. No API access.
03:42 πŸ”— CyberVenu I’m just not sure how practical it is to archive what is basically an indexed database of the entire net via search result crawling. That’s be a bit like indexing the entire web by brute-forcing every possible Google search and crawling those results.
03:46 πŸ”— CyberVenu has quit IRC (Ping timeout: 260 seconds)
03:58 πŸ”— c0mpass has joined #archiveteam
04:00 πŸ”— lunik1 has quit IRC (:x)
04:02 πŸ”— lunik1 has joined #archiveteam
04:34 πŸ”— nataraj has joined #archiveteam
05:28 πŸ”— drcd_ has joined #archiveteam
05:28 πŸ”— Deewiant_ has joined #archiveteam
05:29 πŸ”— drcd has quit IRC (Ping timeout: 186 seconds)
05:29 πŸ”— Deewiant has quit IRC (Ping timeout: 186 seconds)
05:29 πŸ”— xhdr has quit IRC (Ping timeout: 186 seconds)
05:29 πŸ”— stick has quit IRC (Ping timeout: 186 seconds)
05:29 πŸ”— drcd_ is now known as drcd
05:29 πŸ”— stick has joined #archiveteam
05:31 πŸ”— xhdr has joined #archiveteam
05:31 πŸ”— xhdr has quit IRC (Excess Flood)
05:31 πŸ”— xhdr has joined #archiveteam
06:18 πŸ”— systwi has quit IRC (Read error: Connection reset by peer)
06:19 πŸ”— arkiver has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— ShellyRol has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— Fusl__ has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— nyany_ has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— Hooloovoo has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— matthusby has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— nyany has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— voker57 has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— h3ndr1k has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— zerkalo has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— lukeman has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— Ripley has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— patricko- has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— eientei95 has quit IRC (ircd.choopa.net irc.mzima.net)
06:19 πŸ”— svchfoo3 has quit IRC (ircd.choopa.net irc.mzima.net)
06:20 πŸ”— twigfoot has quit IRC (Read error: Operation timed out)
06:20 πŸ”— systwi has joined #archiveteam
06:20 πŸ”— twigfoot has joined #archiveteam
06:22 πŸ”— Verified_ has quit IRC (Ping timeout: 252 seconds)
06:25 πŸ”— arkiver has joined #archiveteam
06:25 πŸ”— ShellyRol has joined #archiveteam
06:25 πŸ”— Fusl__ has joined #archiveteam
06:25 πŸ”— nyany_ has joined #archiveteam
06:25 πŸ”— Hooloovoo has joined #archiveteam
06:25 πŸ”— matthusby has joined #archiveteam
06:25 πŸ”— nyany has joined #archiveteam
06:25 πŸ”— voker57 has joined #archiveteam
06:25 πŸ”— h3ndr1k has joined #archiveteam
06:25 πŸ”— zerkalo has joined #archiveteam
06:25 πŸ”— lukeman has joined #archiveteam
06:25 πŸ”— Ripley has joined #archiveteam
06:25 πŸ”— patricko- has joined #archiveteam
06:25 πŸ”— eientei95 has joined #archiveteam
06:25 πŸ”— svchfoo3 has joined #archiveteam
06:25 πŸ”— irc.mzima.net sets mode: +oo Fusl__ svchfoo3
06:25 πŸ”— Fusl sets mode: +o Fusl__
06:25 πŸ”— Fusl sets mode: +o svchfoo3
06:25 πŸ”— Fusl_ sets mode: +o Fusl__
06:25 πŸ”— Fusl_ sets mode: +o svchfoo3
06:26 πŸ”— Fusl__ sets mode: +o kiska
06:26 πŸ”— Fusl__ sets mode: +o ivan_
06:26 πŸ”— Fusl__ sets mode: +o kiska1
06:26 πŸ”— Fusl__ sets mode: +o HCross
06:26 πŸ”— Fusl__ sets mode: +o hook54321
06:26 πŸ”— Fusl__ sets mode: +o Kaz
06:26 πŸ”— Fusl__ sets mode: +o Fusl_
06:26 πŸ”— Fusl__ sets mode: +o SketchCow
06:26 πŸ”— Fusl__ sets mode: +o AlsoJAA
06:27 πŸ”— Fusl__ sets mode: +o Fusl___
06:27 πŸ”— Fusl__ sets mode: +o Fusl
06:27 πŸ”— Fusl__ sets mode: +o Kenshin
06:27 πŸ”— Fusl__ sets mode: +o dxrt
06:27 πŸ”— Fusl__ sets mode: +o kiskabak
06:27 πŸ”— Fusl__ sets mode: +o JAA
06:27 πŸ”— Fusl__ sets mode: +o jrwr
06:27 πŸ”— Fusl__ sets mode: +o astrid
06:27 πŸ”— Fusl__ sets mode: +o chfoo
06:27 πŸ”— Fusl__ sets mode: +o svchfoo1
06:35 πŸ”— benjinsmi has joined #archiveteam
06:37 πŸ”— benjins has quit IRC (Ping timeout: 252 seconds)
06:38 πŸ”— Verified_ has joined #archiveteam
07:10 πŸ”— bluefoo has quit IRC (Read error: Operation timed out)
07:18 πŸ”— oli has quit IRC (Ping timeout: 255 seconds)
07:21 πŸ”— oli has joined #archiveteam
07:26 πŸ”— oli has quit IRC (Remote host closed the connection)
07:49 πŸ”— oli has joined #archiveteam
08:26 πŸ”— N4Y has quit IRC (Ping timeout: 745 seconds)
08:27 πŸ”— N4Y has joined #archiveteam
08:34 πŸ”— bluefoo has joined #archiveteam
08:53 πŸ”— trc has joined #archiveteam
09:07 πŸ”— Maylay has quit IRC (Ping timeout: 252 seconds)
09:08 πŸ”— Verified_ has quit IRC (Quit: Quit)
09:09 πŸ”— Cameron_D has joined #archiveteam
09:10 πŸ”— Maylay has joined #archiveteam
09:29 πŸ”— icedice has joined #archiveteam
09:35 πŸ”— mtntmnky_ has joined #archiveteam
09:40 πŸ”— mtntmnky has quit IRC (Ping timeout: 600 seconds)
10:37 πŸ”— BlueMax has quit IRC (Quit: Leaving)
10:39 πŸ”— benjinss has joined #archiveteam
10:41 πŸ”— benjinsmi has quit IRC (Ping timeout: 252 seconds)
10:49 πŸ”— bluefoo has quit IRC (Quit: bluefoo)
11:04 πŸ”— bluefoo has joined #archiveteam
12:07 πŸ”— kiskabak has quit IRC (Remote host closed the connection)
12:07 πŸ”— kiskabak has joined #archiveteam
12:07 πŸ”— Fusl__ sets mode: +o kiskabak
12:07 πŸ”— Fusl sets mode: +o kiskabak
12:07 πŸ”— Fusl_ sets mode: +o kiskabak
13:16 πŸ”— mike__ has joined #archiveteam
13:17 πŸ”— asie has joined #archiveteam
13:19 πŸ”— asie Has anyone yet brought up Atlassian's new announcement? They are deleting all Mercurial repositories from Bitbucket by June 1st, 2020, and forbidding creating new Mercurial repositories by February 1st, 2020. https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket
13:19 πŸ”— asie Hmm. Not sure if that shouldn't have gone into -bs or -ot.
13:39 πŸ”— satoshi has quit IRC (Remote host closed the connection)
13:41 πŸ”— MrRadar asie: Since they're actually deleting the content I think this is the right channel, at least to announce the closure
13:47 πŸ”— Damme has joined #archiveteam
13:47 πŸ”— Damme has quit IRC (Remote host closed the connection)
13:48 πŸ”— Damme has joined #archiveteam
13:55 πŸ”— killsushi has quit IRC (Quit: Leaving)
14:05 πŸ”— mike__ Hi all, I run a non-profit called Free Law Project that just started an Archive-Team-like thing to scrape API responses from an API provided by Harvard Law Library. Several years ago, Harvard Law Library signed a deal with a start up to scan their entire collection of case law books β€” thousands of books in all, it was a HUGE project. The scanning is now complete, but they made a curious deal with the startup (now owned by LexisNexus).
14:07 πŸ”— mike__ The deal says that each person creating an account can only get access to 500 of the cases per day. Given that there are 6.3M scans in the API, this doesn't take you very far. Unless...you crowdsource the whole thing. So that's what we're doing.
14:07 πŸ”— mike__ We have a macOS app and a docker image that you plug your API credentials into, and when you run them, they'll query our server for 500 items to download. You'll go get those from the API, then send us the results, which we'll upload to Internet Archive.
14:08 πŸ”— mike__ We need about 200 people running the macOS app or the docker image to get this done in about 60 days.
14:08 πŸ”— mike__ Any interest here in helping with this project?
14:10 πŸ”— Dallas mike__ go to #archiveteam-ot I'll throw a server at it :)
14:11 πŸ”— mike__ Oh shoot, I did misjudge channels. I was afraid I'd do that, but then decided this was sufficiently *on* topic. I'll hop over there! Thanks @dallas.
14:38 πŸ”— DogsRNice has joined #archiveteam
14:45 πŸ”— zhongfu has quit IRC (Ping timeout: 745 seconds)
15:29 πŸ”— joepie91 has joined #archiveteam
15:30 πŸ”— joepie91 Bitbucket will be deleting(!) all Mercurial repositories in less than a year: https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket
15:30 πŸ”— nataraj has quit IRC (Read error: Operation timed out)
15:30 πŸ”— Fusl changes topic to: Archive Team: We're not archive.org | https://archiveteam.org/ | Discussion: #archiveteam-bs | Offtopic: #archiveteam-ot | Thanks, we know about Bitbucket.
15:46 πŸ”— bluefoo has quit IRC (Read error: Operation timed out)
16:32 πŸ”— icedice has quit IRC (Leaving)
17:04 πŸ”— pombreda has joined #archiveteam
17:04 πŸ”— pombreda https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket
17:04 πŸ”— JAA /topic
17:05 πŸ”— pombreda FYI, this means eventually thousands of public hg repos gone?
17:05 πŸ”— pombreda JAA: ok :) sry
17:06 πŸ”— pombreda actually SWH may already have it archived
17:11 πŸ”— arkiver has quit IRC (Quit: Leaving)
17:12 πŸ”— Arkiver2 has joined #archiveteam
17:12 πŸ”— Fusl sets mode: +o Arkiver2
17:12 πŸ”— Fusl__ sets mode: +o Arkiver2
17:12 πŸ”— Fusl_ sets mode: +o Arkiver2
17:13 πŸ”— mike__ has quit IRC (Quit: Page closed)
17:17 πŸ”— RichardG has joined #archiveteam
17:18 πŸ”— Arkiver2 has quit IRC (Connection closed)
17:18 πŸ”— arkiver has joined #archiveteam
17:18 πŸ”— Fusl sets mode: +o arkiver
17:18 πŸ”— Fusl__ sets mode: +o arkiver
17:18 πŸ”— Fusl_ sets mode: +o arkiver
17:23 πŸ”— pombreda JAA: actually SWH seems to have a proper "scrper" https://forge.softwareheritage.org/source/swh-lister/browse/master/swh/lister/bitbucket/ and may it all safekept alright
17:23 πŸ”— pombreda *scraper
17:23 πŸ”— pombreda I will check with them
17:24 πŸ”— JAA pombreda: Alright, thanks. Anything further about this in #archiveteam-bs please since this is mostly a channel for announcements.
17:25 πŸ”— pombreda ack
17:45 πŸ”— Dragnog94 has quit IRC (The Lounge - https://thelounge.chat)
17:48 πŸ”— Dragnog94 has joined #archiveteam
17:49 πŸ”— asdf0101 has quit IRC (Read error: Operation timed out)
17:49 πŸ”— markedL has quit IRC (Read error: Operation timed out)
18:15 πŸ”— asie N
18:15 πŸ”— asie sorry
19:01 πŸ”— PhrackD has quit IRC (Read error: Operation timed out)
19:04 πŸ”— justyn has joined #archiveteam
19:18 πŸ”— tomaspark has joined #archiveteam
19:21 πŸ”— justyn has quit IRC (Ping timeout: 260 seconds)
19:33 πŸ”— PhrackD has joined #archiveteam
19:34 πŸ”— nataraj has joined #archiveteam
20:01 πŸ”— ris has joined #archiveteam
20:19 πŸ”— ShellyRol has quit IRC (Read error: Operation timed out)
20:20 πŸ”— ShellyRol has joined #archiveteam
20:22 πŸ”— n00b850 has joined #archiveteam
20:23 πŸ”— n00b850 WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD
20:24 πŸ”— n00b850 What forsooth, Prithee tell me the secret word
20:24 πŸ”— JAA n00b850: Please choose a proper nick.
20:24 πŸ”— n00b850 has quit IRC (Client Quit)
20:24 πŸ”— xItsMudki has joined #archiveteam
20:25 πŸ”— xItsMudki WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD
20:25 πŸ”— JAA xItsMudki: What's your quest?
20:29 πŸ”— xItsMudki has quit IRC (Ping timeout: 260 seconds)
20:52 πŸ”— nicolas17 has joined #archiveteam
20:54 πŸ”— nataraj has quit IRC (Read error: Operation timed out)
20:55 πŸ”— trc has quit IRC (Leaving)
22:18 πŸ”— magic-114 has joined #archiveteam
22:18 πŸ”— magic-114 has quit IRC (Client Quit)
22:34 πŸ”— BlueMax has joined #archiveteam
23:03 πŸ”— qw3rty114 has joined #archiveteam
23:08 πŸ”— qw3rty113 has quit IRC (Ping timeout: 600 seconds)
23:38 πŸ”— markedL has joined #archiveteam
23:38 πŸ”— asdf0101 has joined #archiveteam
23:45 πŸ”— kiska1 has quit IRC (Remote host closed the connection)
23:45 πŸ”— d5f4a3622 has quit IRC (Read error: Connection reset by peer)
23:45 πŸ”— kiska1 has joined #archiveteam
23:45 πŸ”— Fusl sets mode: +o kiska1
23:45 πŸ”— Fusl__ sets mode: +o kiska1
23:45 πŸ”— Fusl_ sets mode: +o kiska1
23:48 πŸ”— d5f4a3622 has joined #archiveteam
23:55 πŸ”— tomaspark has quit IRC (Ping timeout: 360 seconds)

irclogger-viewer