| Time |
Nickname |
Message |
|
00:26
🔗
|
|
ephemer0l has quit IRC (Quit: http://quassel-irc.org - Chat comfortably. Anywhere.) |
|
00:31
🔗
|
|
ephemer0l has joined #archiveteam-bs |
|
01:52
🔗
|
|
killsushi has joined #archiveteam-bs |
|
02:32
🔗
|
Somebody2 |
continuing from #archiveteam, Raccoon |
|
02:32
🔗
|
Raccoon |
ok |
|
02:33
🔗
|
Somebody2 |
there's no index of stuff that was grabbed by archiveteam and not put up on archive.org -- that's correct. |
|
02:33
🔗
|
Raccoon |
that's a very specific request I didn't make though :) |
|
02:33
🔗
|
Somebody2 |
The archiveteam wiki might provide some vague hints |
|
02:33
🔗
|
Raccoon |
I see what you did there |
|
02:34
🔗
|
Somebody2 |
and as for an index of stuff grabbed by archiveteam and put up on archive.org -- for that, you can just use the archive.org search |
|
02:34
🔗
|
Raccoon |
so what about the stuff that archiveteam grabbed, while forgetting that archive.org even exists |
|
02:34
🔗
|
Somebody2 |
that would only be documented on the archiveteam wiki |
|
02:35
🔗
|
Somebody2 |
generally, most efforts by archiveteam are documented there |
|
02:35
🔗
|
Raccoon |
ok, so there is a complete file index somewhere on the wiki |
|
02:35
🔗
|
Somebody2 |
but not particularly completely or consistently |
|
02:35
🔗
|
Somebody2 |
a file index? heck no. It's an index of *projects* -- i.e. "the time when we grabbed this recipie website" |
|
02:36
🔗
|
Somebody2 |
or "the time we got yelled at by Apple for trying to grab something they were trying to remove" |
|
02:36
🔗
|
Somebody2 |
(these are hypothetical examples) |
|
02:36
🔗
|
Raccoon |
most projects are comprised of files with file names, right? |
|
02:37
🔗
|
Somebody2 |
most projects are lists of URLs that are grabbed and stored into WARC files. |
|
02:37
🔗
|
Somebody2 |
and then posted to archive.org and included in the Wayback Machine |
|
02:37
🔗
|
Somebody2 |
that's the usual flow |
|
02:37
🔗
|
Raccoon |
hmm |
|
02:38
🔗
|
Raccoon |
that's the kicker. you can't really search for a *\filename.here query on archive.or |
|
02:38
🔗
|
Raccoon |
.org |
|
02:38
🔗
|
Somebody2 |
yes you can |
|
02:38
🔗
|
Raccoon |
one needs to know the domain name for which they want to find said file |
|
02:38
🔗
|
Somebody2 |
ah, not in the Wayback Machine, I see |
|
02:38
🔗
|
Somebody2 |
yeah, the Wayback Machine search is still somewhat limited |
|
02:39
🔗
|
Somebody2 |
although I think it allows more than full URL searches (but I think it is still limited to domains) |
|
02:39
🔗
|
Raccoon |
and you say that archiveteam doesn't keep a master index of urls that can be grepped for \\filename\.here |
|
02:45
🔗
|
Raccoon |
Hopefully if the day comes where we need to find all ten parts of the disarm code to the doom's day machine (cleverly hosted on 10 different free hosting websites between 1998 and 2005, under the filename disarmcode.html), the search engine will be prepared for this :P |
|
03:03
🔗
|
Somebody2 |
hopefully! |
|
03:03
🔗
|
Somebody2 |
I mean, if someone wanted to throw enough money at one of the cloud services, making such a filename index at least of the stuff ... |
|
03:04
🔗
|
Somebody2 |
... grabbed by archiveteam would absolutely be possible. |
|
03:04
🔗
|
Somebody2 |
And I don't see any reason it wouldn't be welcomed. |
|
03:04
🔗
|
* |
Flashfire throws monopoly money |
|
03:05
🔗
|
|
Maylay has quit IRC (Pipe Terminated) |
|
03:05
🔗
|
* |
Somebody2 catches the monopoly money, stares at it (it says: "Valid only on AWS; expires in 1995"), and throws it back |
|
03:07
🔗
|
|
Maylay has joined #archiveteam-bs |
|
03:07
🔗
|
|
Maylay has quit IRC (Remote host closed the connection!) |
|
03:08
🔗
|
|
Maylay has joined #archiveteam-bs |
|
03:10
🔗
|
kiska |
I assume we know about tinypic shutting down? |
|
03:11
🔗
|
kiska |
https://server8.kiska.pw/uploads/397c396a6c83b1bc/unknown.png |
|
03:12
🔗
|
Raccoon |
:( |
|
03:13
🔗
|
|
wyatt8740 has quit IRC (Remote host closed the connection) |
|
03:16
🔗
|
Raccoon |
Somebody2: that's one of the things that's carried me through the years in completing collections. Getting lucky with a Google intitle:"index of" search of known filenames already in the set, finding somebody else hosting them, and hitting the jackpot |
|
03:16
🔗
|
Raccoon |
since other people have picked up on that, this has really gone away for the most part. (i discovered the trick before it was hipster) |
|
03:17
🔗
|
Raccoon |
would also clue me in on the merits of contributing some of my junk |
|
03:17
🔗
|
Somebody2 |
Raccoon: hm? |
|
03:18
🔗
|
Raccoon |
hmm? |
|
03:18
🔗
|
arkiver |
ah shit |
|
03:18
🔗
|
arkiver |
kiska: let´s think of a channel |
|
03:19
🔗
|
dxrt |
oh shit |
|
03:20
🔗
|
Raccoon |
how many dick pics do you suppose they've hosted over the years? |
|
03:20
🔗
|
kiska |
I think #ohshit is applicable |
|
03:20
🔗
|
dxrt |
#tinydick |
|
03:20
🔗
|
Raccoon |
jinxed dxrt |
|
03:20
🔗
|
arkiver |
nice |
|
03:20
🔗
|
dxrt |
haha |
|
03:21
🔗
|
arkiver |
kiska: agree with #tinydick? |
|
03:21
🔗
|
kiska |
Yep |
|
03:21
🔗
|
arkiver |
awesome |
|
03:22
🔗
|
Raccoon |
can't wait for mega.nz to shut down |
|
03:23
🔗
|
* |
Raccoon squats on #megadick for the puns |
|
03:23
🔗
|
kiska |
Please no mega.nz there is so much js on there |
|
03:24
🔗
|
Raccoon |
don't they have an api |
|
03:24
🔗
|
Raccoon |
mobile apps |
|
03:33
🔗
|
ivan_ |
https://github.com/meganz/MEGAcmd |
|
03:58
🔗
|
|
qw3rty119 has joined #archiveteam-bs |
|
04:04
🔗
|
|
qw3rty118 has quit IRC (Read error: Operation timed out) |
|
04:15
🔗
|
|
Pixi` has quit IRC (Read error: Connection reset by peer) |
|
04:15
🔗
|
|
Pixi has joined #archiveteam-bs |
|
04:17
🔗
|
|
d5f4a3622 has quit IRC (Read error: Connection reset by peer) |
|
04:19
🔗
|
|
d5f4a3622 has joined #archiveteam-bs |
|
04:46
🔗
|
|
Pokemonpr has joined #archiveteam-bs |
|
04:47
🔗
|
Pokemonpr |
Hey, question. Is there a way to check what the bot has archived? |
|
04:55
🔗
|
ivan_ |
Which bot |
|
04:55
🔗
|
Pokemonpr |
...uhm, the main one that auto-archives smaller sites? Not sure if it has a proper name |
|
04:56
🔗
|
ivan_ |
See #archivebot topic |
|
04:56
🔗
|
Pokemonpr |
There's a site I suggested for it to archive a little while ago; but I'm not sure if it got done. The site went from "Sort of dead but not in real danger" to "We're shutting down August 1st" and I wanted to check |
|
04:56
🔗
|
Pokemonpr |
Thank you |
|
04:56
🔗
|
Pokemonpr |
Haven't been here in a little while, sorry if this was a dumb quesiton |
|
04:57
🔗
|
ivan_ |
http://archive.fart.website/archivebot/viewer/ |
|
04:59
🔗
|
|
godane1 has joined #archiveteam-bs |
|
05:00
🔗
|
|
godane has quit IRC (Read error: Operation timed out) |
|
05:06
🔗
|
Pokemonpr |
Can't see it there.. Could I request something then? |
|
05:58
🔗
|
dxrt |
Pokemonpr: what site? |
|
06:03
🔗
|
|
m007a83 has quit IRC (Read error: Operation timed out) |
|
06:07
🔗
|
Pokemonpr |
dxrt it's amesfanclub.com ; it recently announced out of the blue that it was going down August 1st due to reasons out of their control. |
|
06:08
🔗
|
|
Dimtree has joined #archiveteam-bs |
|
06:11
🔗
|
dxrt |
Pokemonpr: I've added it. |
|
06:34
🔗
|
Pokemonpr |
thank you |
|
07:58
🔗
|
|
m007a83 has joined #archiveteam-bs |
|
09:45
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
10:23
🔗
|
JAA |
Somebody2: How does one search by filename on IA? I'm not aware of any method to do so. It only searches item metadata (identifier, title, description, etc.), not the names of files inside items. |
|
11:00
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
|
12:07
🔗
|
|
BIER has joined #archiveteam-bs |
|
12:07
🔗
|
|
BIER has quit IRC (Client Quit) |
|
12:18
🔗
|
|
killsushi has quit IRC (Quit: Leaving) |
|
13:04
🔗
|
|
HashbangI has quit IRC (Remote host closed the connection) |
|
13:12
🔗
|
|
HashbangI has joined #archiveteam-bs |
|
14:34
🔗
|
Somebody2 |
um, let me look. |
|
14:35
🔗
|
Somebody2 |
if nothing else, you can download the (now rather out of date) IA census and use that. |
|
14:35
🔗
|
Somebody2 |
that may be the only way, indeed. |
|
15:10
🔗
|
|
Hani has quit IRC (Quit: Hani) |
|
15:17
🔗
|
|
Verified_ has quit IRC (Ping timeout: 252 seconds) |
|
15:47
🔗
|
fallenoak |
All you really need to search by files in the projects that produced megawarcs is the cdx files (which are fortunately fairly small) |
|
15:47
🔗
|
fallenoak |
At least, that's what I did when I wanted to comb through the files in the GameFront grab |
|
15:49
🔗
|
|
wyatt8740 has joined #archiveteam-bs |
|
16:05
🔗
|
Igloo |
betamax: CD’s sorted |
|
16:06
🔗
|
|
schbirid has joined #archiveteam-bs |
|
16:16
🔗
|
betamax |
Yay! |
|
16:29
🔗
|
Somebody2 |
fallenoak: yes, but you need to know which project you care about first :-) |
|
16:38
🔗
|
|
Hani has joined #archiveteam-bs |
|
17:00
🔗
|
Igloo |
if http_stat.statcode == 500 then |
|
17:00
🔗
|
Igloo |
-- try again |
|
17:00
🔗
|
Igloo |
woops |
|
17:16
🔗
|
|
DogsRNice has joined #archiveteam-bs |
|
18:15
🔗
|
|
Joseph_ has joined #archiveteam-bs |
|
18:15
🔗
|
|
VerifiedJ has quit IRC (Read error: Connection reset by peer) |
|
18:26
🔗
|
|
antomati_ is now known as antomatic |
|
18:41
🔗
|
|
Dallas has joined #archiveteam-bs |
|
18:50
🔗
|
|
hi has joined #archiveteam-bs |
|
19:45
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
19:45
🔗
|
|
Joseph_ has quit IRC (Read error: Connection reset by peer) |
|
19:46
🔗
|
|
VerifiedJ has quit IRC (Read error: Connection reset by peer) |
|
19:47
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
19:50
🔗
|
|
Ravenloft has joined #archiveteam-bs |
|
19:57
🔗
|
|
DogsRNice has quit IRC (Ping timeout: 252 seconds) |
|
19:58
🔗
|
|
Dj-Wawa has joined #archiveteam-bs |
|
19:59
🔗
|
|
DogsRNice has joined #archiveteam-bs |
|
20:07
🔗
|
|
hi has quit IRC (Quit: Page closed) |
|
20:19
🔗
|
|
DogsRNice has quit IRC (Ping timeout: 252 seconds) |
|
20:28
🔗
|
|
Smiley has quit IRC (Ping timeout: 265 seconds) |
|
20:29
🔗
|
|
Smiley has joined #archiveteam-bs |
|
20:38
🔗
|
|
schbirid has quit IRC (Remote host closed the connection) |
|
20:39
🔗
|
|
DogsRNice has joined #archiveteam-bs |
|
20:59
🔗
|
|
Ravenloft has quit IRC (Remote host closed the connection) |
|
21:42
🔗
|
|
VerifiedJ has quit IRC (Read error: Connection reset by peer) |
|
21:42
🔗
|
|
VerifiedJ has joined #archiveteam-bs |
|
22:28
🔗
|
|
Dj-Wawa has quit IRC (Quit: Connection closed for inactivity) |
|
22:29
🔗
|
|
Dj-Wawa has joined #archiveteam-bs |
|
22:30
🔗
|
|
fredgido_ has quit IRC (Read error: Operation timed out) |
|
22:36
🔗
|
|
dashcloud has quit IRC (Remote host closed the connection) |
|
22:37
🔗
|
|
dashcloud has joined #archiveteam-bs |
|
23:22
🔗
|
|
BlueMax has joined #archiveteam-bs |
|
23:26
🔗
|
|
fredgido has joined #archiveteam-bs |
|
23:26
🔗
|
|
SmileyG has joined #archiveteam-bs |
|
23:27
🔗
|
|
Smiley has quit IRC (Read error: Operation timed out) |
|
23:32
🔗
|
|
benjinsmi has joined #archiveteam-bs |
|
23:33
🔗
|
|
benjins has quit IRC (Ping timeout: 252 seconds) |
|
23:42
🔗
|
|
benjins has joined #archiveteam-bs |
|
23:43
🔗
|
|
benjinsmi has quit IRC (Ping timeout: 604 seconds) |
|
23:47
🔗
|
|
VerifiedJ has quit IRC (Read error: Operation timed out) |