Time |
Nickname |
Message |
00:12
π
|
|
twigfoot has quit IRC (Read error: Operation timed out) |
00:13
π
|
|
twigfoot has joined #archiveteam |
00:17
π
|
|
twigfoot has quit IRC (Read error: Operation timed out) |
00:17
π
|
|
twigfoot has joined #archiveteam |
00:25
π
|
|
twigfoot has quit IRC (Read error: Operation timed out) |
00:27
π
|
|
ris has quit IRC (Read error: Operation timed out) |
00:40
π
|
|
justas1 has joined #archiveteam |
00:46
π
|
|
justas has quit IRC (Ping timeout: 745 seconds) |
02:02
π
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
02:05
π
|
|
Verified_ has joined #archiveteam |
02:14
π
|
|
Pixi` has quit IRC (Quit: Pixi`) |
02:15
π
|
|
Pixi has joined #archiveteam |
03:11
π
|
|
twigfoot has joined #archiveteam |
03:15
π
|
|
qw3rty113 has joined #archiveteam |
03:17
π
|
|
DogsRNice has quit IRC (Read error: Connection reset by peer) |
03:21
π
|
|
qw3rty112 has quit IRC (Ping timeout: 600 seconds) |
03:33
π
|
|
CyberVenu has joined #archiveteam |
03:35
π
|
|
odemgi has joined #archiveteam |
03:39
π
|
|
odemgi_ has quit IRC (Read error: Operation timed out) |
03:40
π
|
CyberVenu |
Are we aware of or looked into shodan.io ? At first I was thinking about using their FTP server list for that project, but then I realized that they list everything even all the servers with no public contents. So now Iβm thinking we should have an archive of just the database, which they just hand out to enterprise users, and subscribed users have an API but canβt just download an entire database dump in one go. Free users seem to have unrestrict |
03:40
π
|
CyberVenu |
I can tell, but only via the website interface. No API access. |
03:42
π
|
CyberVenu |
Iβm just not sure how practical it is to archive what is basically an indexed database of the entire net via search result crawling. Thatβs be a bit like indexing the entire web by brute-forcing every possible Google search and crawling those results. |
03:46
π
|
|
CyberVenu has quit IRC (Ping timeout: 260 seconds) |
03:58
π
|
|
c0mpass has joined #archiveteam |
04:00
π
|
|
lunik1 has quit IRC (:x) |
04:02
π
|
|
lunik1 has joined #archiveteam |
04:34
π
|
|
nataraj has joined #archiveteam |
05:28
π
|
|
drcd_ has joined #archiveteam |
05:28
π
|
|
Deewiant_ has joined #archiveteam |
05:29
π
|
|
drcd has quit IRC (Ping timeout: 186 seconds) |
05:29
π
|
|
Deewiant has quit IRC (Ping timeout: 186 seconds) |
05:29
π
|
|
xhdr has quit IRC (Ping timeout: 186 seconds) |
05:29
π
|
|
stick has quit IRC (Ping timeout: 186 seconds) |
05:29
π
|
|
drcd_ is now known as drcd |
05:29
π
|
|
stick has joined #archiveteam |
05:31
π
|
|
xhdr has joined #archiveteam |
05:31
π
|
|
xhdr has quit IRC (Excess Flood) |
05:31
π
|
|
xhdr has joined #archiveteam |
06:18
π
|
|
systwi has quit IRC (Read error: Connection reset by peer) |
06:19
π
|
|
arkiver has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
ShellyRol has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
Fusl__ has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
nyany_ has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
Hooloovoo has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
matthusby has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
nyany has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
voker57 has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
h3ndr1k has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
zerkalo has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
lukeman has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
Ripley has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
patricko- has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
eientei95 has quit IRC (ircd.choopa.net irc.mzima.net) |
06:19
π
|
|
svchfoo3 has quit IRC (ircd.choopa.net irc.mzima.net) |
06:20
π
|
|
twigfoot has quit IRC (Read error: Operation timed out) |
06:20
π
|
|
systwi has joined #archiveteam |
06:20
π
|
|
twigfoot has joined #archiveteam |
06:22
π
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
06:25
π
|
|
arkiver has joined #archiveteam |
06:25
π
|
|
ShellyRol has joined #archiveteam |
06:25
π
|
|
Fusl__ has joined #archiveteam |
06:25
π
|
|
nyany_ has joined #archiveteam |
06:25
π
|
|
Hooloovoo has joined #archiveteam |
06:25
π
|
|
matthusby has joined #archiveteam |
06:25
π
|
|
nyany has joined #archiveteam |
06:25
π
|
|
voker57 has joined #archiveteam |
06:25
π
|
|
h3ndr1k has joined #archiveteam |
06:25
π
|
|
zerkalo has joined #archiveteam |
06:25
π
|
|
lukeman has joined #archiveteam |
06:25
π
|
|
Ripley has joined #archiveteam |
06:25
π
|
|
patricko- has joined #archiveteam |
06:25
π
|
|
eientei95 has joined #archiveteam |
06:25
π
|
|
svchfoo3 has joined #archiveteam |
06:25
π
|
|
irc.mzima.net sets mode: +oo Fusl__ svchfoo3 |
06:25
π
|
|
Fusl sets mode: +o Fusl__ |
06:25
π
|
|
Fusl sets mode: +o svchfoo3 |
06:25
π
|
|
Fusl_ sets mode: +o Fusl__ |
06:25
π
|
|
Fusl_ sets mode: +o svchfoo3 |
06:26
π
|
|
Fusl__ sets mode: +o kiska |
06:26
π
|
|
Fusl__ sets mode: +o ivan_ |
06:26
π
|
|
Fusl__ sets mode: +o kiska1 |
06:26
π
|
|
Fusl__ sets mode: +o HCross |
06:26
π
|
|
Fusl__ sets mode: +o hook54321 |
06:26
π
|
|
Fusl__ sets mode: +o Kaz |
06:26
π
|
|
Fusl__ sets mode: +o Fusl_ |
06:26
π
|
|
Fusl__ sets mode: +o SketchCow |
06:26
π
|
|
Fusl__ sets mode: +o AlsoJAA |
06:27
π
|
|
Fusl__ sets mode: +o Fusl___ |
06:27
π
|
|
Fusl__ sets mode: +o Fusl |
06:27
π
|
|
Fusl__ sets mode: +o Kenshin |
06:27
π
|
|
Fusl__ sets mode: +o dxrt |
06:27
π
|
|
Fusl__ sets mode: +o kiskabak |
06:27
π
|
|
Fusl__ sets mode: +o JAA |
06:27
π
|
|
Fusl__ sets mode: +o jrwr |
06:27
π
|
|
Fusl__ sets mode: +o astrid |
06:27
π
|
|
Fusl__ sets mode: +o chfoo |
06:27
π
|
|
Fusl__ sets mode: +o svchfoo1 |
06:35
π
|
|
benjinsmi has joined #archiveteam |
06:37
π
|
|
benjins has quit IRC (Ping timeout: 252 seconds) |
06:38
π
|
|
Verified_ has joined #archiveteam |
07:10
π
|
|
bluefoo has quit IRC (Read error: Operation timed out) |
07:18
π
|
|
oli has quit IRC (Ping timeout: 255 seconds) |
07:21
π
|
|
oli has joined #archiveteam |
07:26
π
|
|
oli has quit IRC (Remote host closed the connection) |
07:49
π
|
|
oli has joined #archiveteam |
08:26
π
|
|
N4Y has quit IRC (Ping timeout: 745 seconds) |
08:27
π
|
|
N4Y has joined #archiveteam |
08:34
π
|
|
bluefoo has joined #archiveteam |
08:53
π
|
|
trc has joined #archiveteam |
09:07
π
|
|
Maylay has quit IRC (Ping timeout: 252 seconds) |
09:08
π
|
|
Verified_ has quit IRC (Quit: Quit) |
09:09
π
|
|
Cameron_D has joined #archiveteam |
09:10
π
|
|
Maylay has joined #archiveteam |
09:29
π
|
|
icedice has joined #archiveteam |
09:35
π
|
|
mtntmnky_ has joined #archiveteam |
09:40
π
|
|
mtntmnky has quit IRC (Ping timeout: 600 seconds) |
10:37
π
|
|
BlueMax has quit IRC (Quit: Leaving) |
10:39
π
|
|
benjinss has joined #archiveteam |
10:41
π
|
|
benjinsmi has quit IRC (Ping timeout: 252 seconds) |
10:49
π
|
|
bluefoo has quit IRC (Quit: bluefoo) |
11:04
π
|
|
bluefoo has joined #archiveteam |
12:07
π
|
|
kiskabak has quit IRC (Remote host closed the connection) |
12:07
π
|
|
kiskabak has joined #archiveteam |
12:07
π
|
|
Fusl__ sets mode: +o kiskabak |
12:07
π
|
|
Fusl sets mode: +o kiskabak |
12:07
π
|
|
Fusl_ sets mode: +o kiskabak |
13:16
π
|
|
mike__ has joined #archiveteam |
13:17
π
|
|
asie has joined #archiveteam |
13:19
π
|
asie |
Has anyone yet brought up Atlassian's new announcement? They are deleting all Mercurial repositories from Bitbucket by June 1st, 2020, and forbidding creating new Mercurial repositories by February 1st, 2020. https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket |
13:19
π
|
asie |
Hmm. Not sure if that shouldn't have gone into -bs or -ot. |
13:39
π
|
|
satoshi has quit IRC (Remote host closed the connection) |
13:41
π
|
MrRadar |
asie: Since they're actually deleting the content I think this is the right channel, at least to announce the closure |
13:47
π
|
|
Damme has joined #archiveteam |
13:47
π
|
|
Damme has quit IRC (Remote host closed the connection) |
13:48
π
|
|
Damme has joined #archiveteam |
13:55
π
|
|
killsushi has quit IRC (Quit: Leaving) |
14:05
π
|
mike__ |
Hi all, I run a non-profit called Free Law Project that just started an Archive-Team-like thing to scrape API responses from an API provided by Harvard Law Library. Several years ago, Harvard Law Library signed a deal with a start up to scan their entire collection of case law books β thousands of books in all, it was a HUGE project. The scanning is now complete, but they made a curious deal with the startup (now owned by LexisNexus). |
14:07
π
|
mike__ |
The deal says that each person creating an account can only get access to 500 of the cases per day. Given that there are 6.3M scans in the API, this doesn't take you very far. Unless...you crowdsource the whole thing. So that's what we're doing. |
14:07
π
|
mike__ |
We have a macOS app and a docker image that you plug your API credentials into, and when you run them, they'll query our server for 500 items to download. You'll go get those from the API, then send us the results, which we'll upload to Internet Archive. |
14:08
π
|
mike__ |
We need about 200 people running the macOS app or the docker image to get this done in about 60 days. |
14:08
π
|
mike__ |
Any interest here in helping with this project? |
14:10
π
|
Dallas |
mike__ go to #archiveteam-ot I'll throw a server at it :) |
14:11
π
|
mike__ |
Oh shoot, I did misjudge channels. I was afraid I'd do that, but then decided this was sufficiently *on* topic. I'll hop over there! Thanks @dallas. |
14:38
π
|
|
DogsRNice has joined #archiveteam |
14:45
π
|
|
zhongfu has quit IRC (Ping timeout: 745 seconds) |
15:29
π
|
|
joepie91 has joined #archiveteam |
15:30
π
|
joepie91 |
Bitbucket will be deleting(!) all Mercurial repositories in less than a year: https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket |
15:30
π
|
|
nataraj has quit IRC (Read error: Operation timed out) |
15:30
π
|
|
Fusl changes topic to: Archive Team: We're not archive.org | https://archiveteam.org/ | Discussion: #archiveteam-bs | Offtopic: #archiveteam-ot | Thanks, we know about Bitbucket. |
15:46
π
|
|
bluefoo has quit IRC (Read error: Operation timed out) |
16:32
π
|
|
icedice has quit IRC (Leaving) |
17:04
π
|
|
pombreda has joined #archiveteam |
17:04
π
|
pombreda |
https://bitbucket.org/blog/sunsetting-mercurial-support-in-bitbucket |
17:04
π
|
JAA |
/topic |
17:05
π
|
pombreda |
FYI, this means eventually thousands of public hg repos gone? |
17:05
π
|
pombreda |
JAA: ok :) sry |
17:06
π
|
pombreda |
actually SWH may already have it archived |
17:11
π
|
|
arkiver has quit IRC (Quit: Leaving) |
17:12
π
|
|
Arkiver2 has joined #archiveteam |
17:12
π
|
|
Fusl sets mode: +o Arkiver2 |
17:12
π
|
|
Fusl__ sets mode: +o Arkiver2 |
17:12
π
|
|
Fusl_ sets mode: +o Arkiver2 |
17:13
π
|
|
mike__ has quit IRC (Quit: Page closed) |
17:17
π
|
|
RichardG has joined #archiveteam |
17:18
π
|
|
Arkiver2 has quit IRC (Connection closed) |
17:18
π
|
|
arkiver has joined #archiveteam |
17:18
π
|
|
Fusl sets mode: +o arkiver |
17:18
π
|
|
Fusl__ sets mode: +o arkiver |
17:18
π
|
|
Fusl_ sets mode: +o arkiver |
17:23
π
|
pombreda |
JAA: actually SWH seems to have a proper "scrper" https://forge.softwareheritage.org/source/swh-lister/browse/master/swh/lister/bitbucket/ and may it all safekept alright |
17:23
π
|
pombreda |
*scraper |
17:23
π
|
pombreda |
I will check with them |
17:24
π
|
JAA |
pombreda: Alright, thanks. Anything further about this in #archiveteam-bs please since this is mostly a channel for announcements. |
17:25
π
|
pombreda |
ack |
17:45
π
|
|
Dragnog94 has quit IRC (The Lounge - https://thelounge.chat) |
17:48
π
|
|
Dragnog94 has joined #archiveteam |
17:49
π
|
|
asdf0101 has quit IRC (Read error: Operation timed out) |
17:49
π
|
|
markedL has quit IRC (Read error: Operation timed out) |
18:15
π
|
asie |
N |
18:15
π
|
asie |
sorry |
19:01
π
|
|
PhrackD has quit IRC (Read error: Operation timed out) |
19:04
π
|
|
justyn has joined #archiveteam |
19:18
π
|
|
tomaspark has joined #archiveteam |
19:21
π
|
|
justyn has quit IRC (Ping timeout: 260 seconds) |
19:33
π
|
|
PhrackD has joined #archiveteam |
19:34
π
|
|
nataraj has joined #archiveteam |
20:01
π
|
|
ris has joined #archiveteam |
20:19
π
|
|
ShellyRol has quit IRC (Read error: Operation timed out) |
20:20
π
|
|
ShellyRol has joined #archiveteam |
20:22
π
|
|
n00b850 has joined #archiveteam |
20:23
π
|
n00b850 |
WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD |
20:24
π
|
n00b850 |
What forsooth, Prithee tell me the secret word |
20:24
π
|
JAA |
n00b850: Please choose a proper nick. |
20:24
π
|
|
n00b850 has quit IRC (Client Quit) |
20:24
π
|
|
xItsMudki has joined #archiveteam |
20:25
π
|
xItsMudki |
WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD |
20:25
π
|
JAA |
xItsMudki: What's your quest? |
20:29
π
|
|
xItsMudki has quit IRC (Ping timeout: 260 seconds) |
20:52
π
|
|
nicolas17 has joined #archiveteam |
20:54
π
|
|
nataraj has quit IRC (Read error: Operation timed out) |
20:55
π
|
|
trc has quit IRC (Leaving) |
22:18
π
|
|
magic-114 has joined #archiveteam |
22:18
π
|
|
magic-114 has quit IRC (Client Quit) |
22:34
π
|
|
BlueMax has joined #archiveteam |
23:03
π
|
|
qw3rty114 has joined #archiveteam |
23:08
π
|
|
qw3rty113 has quit IRC (Ping timeout: 600 seconds) |
23:38
π
|
|
markedL has joined #archiveteam |
23:38
π
|
|
asdf0101 has joined #archiveteam |
23:45
π
|
|
kiska1 has quit IRC (Remote host closed the connection) |
23:45
π
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
23:45
π
|
|
kiska1 has joined #archiveteam |
23:45
π
|
|
Fusl sets mode: +o kiska1 |
23:45
π
|
|
Fusl__ sets mode: +o kiska1 |
23:45
π
|
|
Fusl_ sets mode: +o kiska1 |
23:48
π
|
|
d5f4a3622 has joined #archiveteam |
23:55
π
|
|
tomaspark has quit IRC (Ping timeout: 360 seconds) |