#archiveteam-bs 2017-06-14,Wed

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***schbirid2 has quit IRC (Read error: Operation timed out) [00:01]
......... (idle for 40mn)
pizzaiolo has quit IRC (Ping timeout: 268 seconds) [00:41]
pizzaiolo has joined #archiveteam-bs [00:49]
.......... (idle for 45mn)
schbirid2 has joined #archiveteam-bs
username1 has quit IRC (Read error: Operation timed out)
[01:34]
..... (idle for 20mn)
pizzaiolo has quit IRC (Read error: Operation timed out) [01:58]
......... (idle for 41mn)
DFJustin has quit IRC (Remote host closed the connection)
DFJustin has joined #archiveteam-bs
swebb sets mode: +o DFJustin
[02:39]
......... (idle for 42mn)
hook54321I've noticed that some historically significant autism related stuff has seemingly disappeared and is no longer available to the public without a significant amount of effort and time, and that some content is likely going to have the same fate. I've started a discord server to coordinate, organize, and keep track of some autism related archiving projects. I chose discord over irc because of the organizational needs that will
likely be required. If you're interested in this, here's the link: https://discord.gg/d7WuhaH
[03:25]
.................. (idle for 1h25mn)
***Sk1d has quit IRC (Ping timeout: 194 seconds) [04:50]
Sk1d has joined #archiveteam-bs
th1x has quit IRC (Read error: Operation timed out)
[04:56]
j08nY has joined #archiveteam-bs [05:08]
mls_ is now known as mls [05:18]
...... (idle for 27mn)
j08nY has quit IRC (Read error: Operation timed out) [05:45]
............. (idle for 1h2mn)
Kalrothi wonder what techknown is doing right that everybody else is doing wrong http://tracker.archiveteam.org/imzy/ :)
techknow*
[06:47]
***icedice has joined #archiveteam-bs [06:55]
............ (idle for 58mn)
SHODAN_UI has joined #archiveteam-bs [07:53]
.... (idle for 16mn)
Honno has joined #archiveteam-bs [08:09]
j08nY has joined #archiveteam-bs [08:14]
Jonison has joined #archiveteam-bs [08:21]
.... (idle for 19mn)
icedice2 has joined #archiveteam-bs
icedice has quit IRC (Ping timeout: 245 seconds)
[08:40]
j08nY has quit IRC (Quit: Leaving)
username1 has joined #archiveteam-bs
schbirid2 has quit IRC (Read error: Operation timed out)
[08:47]
.... (idle for 17mn)
TheLovina has quit IRC (Read error: Operation timed out)
SHODAN_UI has quit IRC (Quit: zzz)
schbirid2 has joined #archiveteam-bs
username1 has quit IRC (Read error: Operation timed out)
[09:11]
JAAO.o 75575=200 https://www.imzy.com/api/accounts/profiles/thelizardqueen/comments?page=75526&per_page=25
75k pages of 25 comments each. How do you even post that much?
[09:22]
Kalrothyeah, i got a 63k user here :p [09:25]
***icedice2 has quit IRC (Quit: Leaving) [09:26]
JAAActually, that may be a bug.
Every page has the same contents.
diff -sq <(curl 'https://www.imzy.com/api/accounts/profiles/thelizardqueen/comments?page=75526&per_page=25') <(curl 'https://www.imzy.com/api/accounts/profiles/thelizardqueen/comments?page=175526&per_page=25')
arkiver: ^
[09:27]
Kalrothyeah, it is identical, you can replace page number with any random value
it would have been nice with a 404 if the page number is out of range
[09:40]
JAAOr an empty result. That's what imzy.lua checks for before advancing to the next page. [09:44]
jrwrbwhaha
ALL THE COMMENTS
[09:49]
JAAONE MILLION TIMES [09:50]
***username1 has joined #archiveteam-bs
schbirid2 has quit IRC (Read error: Operation timed out)
[09:58]
pizzaiolo has joined #archiveteam-bs [10:12]
............ (idle for 59mn)
th1x has joined #archiveteam-bs [11:11]
.... (idle for 19mn)
BlueMaxim has quit IRC (Read error: Operation timed out)
BlueMaxim has joined #archiveteam-bs
[11:30]
BlueMaxim has quit IRC (Quit: Leaving) [11:44]
.................. (idle for 1h28mn)
icedice has joined #archiveteam-bs
icedice has quit IRC (Client Quit)
[13:12]
..... (idle for 20mn)
arkiverJAA: strange
I paused imzy
I believe it did just send [] before
will recheck
[13:36]
.......... (idle for 47mn)
***Stiletto has quit IRC (Read error: Connection reset by peer)
Stilett0 has joined #archiveteam-bs
[14:24]
..... (idle for 24mn)
voltagexXBox E3 briefing on YouTube 1080P - 2.7GB. On Mixer (Beam) - 11GB. Anyone want the file? [14:49]
............ (idle for 55mn)
***SHODAN_UI has joined #archiveteam-bs [15:44]
JAALooks like the old OVH forums are all gone now. Well, at least I got .de, .co.uk, most of .com (French; still running), the dedicated Kimsufi/SoYouStart/Hubic ones, and some small ones (Senegal, Tunesia, and Marocco). I'll keep an eye on it, but with OVH I wouldn't be surprised if they just nuked it without an announcement.
Also, I'd be interested in explanations for why https://web.archive.org/web/20170613112823/https://forum.ovh.com/ is blocked by a 404ing robots.txt.
[15:54]
Oh, they're back up. So maybe they just moved them to another server, because the IP definitely changed. [16:04]
***SHODAN_UI has quit IRC (Remote host closed the connection) [16:08]
MrRadarLOL, one of my Imzy jobs was up to 165866 requests before I killed it due to that infinite comments page issue [16:09]
JAAYeah, I also have some other... interesting jobs. One has been requesting https://www.imzy.com/api/accounts/profiles/metaxu?check=true 2400 times, for example.
Same for a few other accounts.
Any thoughts on grabbing the OVH forums twice? My idea would be to first run a quick --no-offsite-links grab to make sure the content isn't lost, and then run it again without that option to also grab external links if time permits. Leads to some duplication though, obviously (if the servers stay up).
[16:13]
arkiververy strange
JAA: do you have a log?
[16:30]
***kristian_ has joined #archiveteam-bs [16:32]
JAAarkiver: Nothing meaningful. wget.log is just two lines, one for https://www.imzy.com/api/accounts/profiles/metaxu and one for https://images.imzy.com/prod/profiles/05tmjowq.jpg . The output on the pipeline is just countless lines of N=200 for that ?check=true URL.
Notably, there is no response record in the WARC for those 2k requests, only the requests.
[16:32]
arkiverwhat wget version? [16:36]
***j08nY has joined #archiveteam-bs [16:36]
JAAWget/1.14.lua.20160530-955376b [16:36]
klgthey were returning 206 with empty body
it's not wget issue
[16:36]
JAAklg: Shouldn't that appear in the WARC though? [16:36]
arkiverah 206 would make more sense [16:36]
JAAOh, yeah, it's 206.
Sorry, missed that on the pipeline.
Regarding OVH, I've decided I'll follow that double-archiving strategy. The forum archives are really small (.ie was only 5 MiB at over 5k threads), so it's not really a problem.
[16:37]
..... (idle for 21mn)
arkivernice
are they in wayback?
[17:01]
JAAAs mentioned above, at least forum.ovh.com is blocked in Wayback through robots.txt, although there is no robots.txt on the server (404). [17:03]
arkiverright [17:03]
JAAMaybe they're using the last 200 robots.txt?
Which would obviously be completely negate the purpose of removing a robots.txt.
s/be //
[17:03]
***fie has quit IRC (Read error: Operation timed out) [17:13]
JAAFor the record, I'm following the same strategy on WoT as with the OVH forums; first with --no-offsite-links, then possibly without. [17:13]
***JensRex has quit IRC (Remote host closed the connection)
JensRex has joined #archiveteam-bs
[17:14]
icedice has joined #archiveteam-bs
fie has joined #archiveteam-bs
[17:20]
pukkie has joined #archiveteam-bs [17:29]
pukkieDear Archive Team, I just checked my warrior and there's still an item for imzy doing "user:anonymous". It looks like it's archiving anonymous's comments, but imzy's server simply throws an 404 and the warrior just requests the next page. It's currently on page 779709. Should I kill and restart the warrior? I'm scared and afraid. Please help me! Thank you! [17:37]
xmcit should be safe to kill and restart :) [17:38]
pukkieThank you very much xmc! Have a nice day everyone! :) [17:43]
xmcthanks for your computer time, pukkie :) [17:44]
arkiveryeah, imzy is paused at the moment
has some serious problems
also with the 206
[17:47]
***pizzaiolo has quit IRC (Quit: pizzaiolo) [17:59]
.... (idle for 15mn)
jrwrarkiver: lol [18:14]
***SHODAN_UI has joined #archiveteam-bs [18:22]
........ (idle for 38mn)
ZexaronS has quit IRC (Read error: Connection reset by peer)
Ravenloft has quit IRC (Ping timeout: 260 seconds)
[19:00]
pukkie has quit IRC (Ping timeout: 260 seconds) [19:08]
Ravenloft has joined #archiveteam-bs [19:17]
GLaDOS has quit IRC (Ping timeout: 506 seconds)
GLaDOS has joined #archiveteam-bs
[19:24]
kristian_ has quit IRC (Quit: Leaving) [19:39]
Ravenloft has quit IRC (Ping timeout: 260 seconds)
Panasonic has joined #archiveteam-bs
icedice has quit IRC (Quit: Leaving)
BartoCH has quit IRC (Ping timeout: 260 seconds)
[19:46]
BartoCH has joined #archiveteam-bs
Stilett0 has quit IRC (Ping timeout: 246 seconds)
[19:57]
SketchCowI tried to hug Carl Malamud and ha ha ha ha he does not like hugs
NOTE FOR LATER
[20:02]
Panasonicwell, at least you tried [20:05]
jrwrSketchCow: Wiki fix please :)
Still cant upload files
[20:11]
SketchCowYeah, I'll see if I can look today [20:12]
jrwrI think its a permissions issue since its having issues omving from /tmp to main storage [20:12]
SketchCowIt
It's likely disk space
Warning: This account has reached its disk usage quota. If you need more disk space, contact your service provider.
[20:12]
jrwrLol
Oops, So where is it hosted
jrwr puts in his notes that if he sees SketchCow that he might like a hug
[20:13]
SketchCowShould work for now
I have to go ask for more space
[20:16]
jrwrNice, I always suggest linodes for mediawiki installs of this size
I've ran a few of them over the years, if you do upgrade the package i do suggest the new editor that mediawiki put out, its very nice
makes editing and format easy as pie
[20:16]
SketchCowBy the way, 120,000 visitors on average a month to archiveteam wiki [20:18]
jrwrNice [20:18]
JAAOn a related note: did anything ever happen regarding setting up TLS? I remember that there was some talk about that in here a few months ago. [20:19]
jrwrOn PCGamingWiki (the last big one I ran) we where getting 1-1.5 Million a month for the first three months
Reddit Frontpage is a server killer, but with all the cache, it helps a ton
gotta override the session cookies and just ignore them
unless the user has a username set in the cookies, just strip out the sessions for easy caching
got a 95% hitrate after that change
[20:19]
SketchCowI requested more disk space [20:20]
jrwrCool
If you ever need science done to the wiki, your welcome to ask
[20:20]
arkiverjrwr: we have a project to archive news, NewsGrabber or NewsBuddy
it can be found in #newsgrabber
[20:23]
jrwrCool [20:23]
arkiverthe project has been paused for quite some time due to a big update that needs to be done
and that will hopefully be done soon
[20:23]
***MrRadar has left
MrRadar has joined #archiveteam-bs
[20:23]
ZexaronS has joined #archiveteam-bs [20:33]
Stilett0 has joined #archiveteam-bs [20:38]
SketchCowYes please [20:39]
.... (idle for 17mn)
ArchiveTeam wiki being bumped from 2gb space to 10gb space.
I'm $50 poorer a year
[20:56]
MrRadarOh, SketchCow, while you're here: is there a recommended donation for the Ted Nelson Junk mail Archive Corps project?
How much archiving does a dollar get?
(I just notied the blog post today)
[20:59]
jrwrBEST JUNKMAIL [21:06]
xmcthe spreadsheet they posted a few days ago said it averages twelve cents a page
all-in
[21:06]
SketchCowProblem fixed [21:07]
JAA\o/ [21:07]
SketchCow(Disk space)
k@savetz.com paypal
[21:07]
jrwrif I was nearby to volunteer I could [21:07]
SketchCowCosts us $10/hr for scangrrl [21:07]
....... (idle for 30mn)
***th1x has quit IRC (Read error: Connection reset by peer)
Jonison has quit IRC (Read error: Connection reset by peer)
[21:37]
...... (idle for 25mn)
godanehttps://www.reddit.com/r/DnD/comments/6h3nv1/two_of_the_biggest_dd_boards_just_went_down/ [22:04]
..... (idle for 20mn)
***SHODAN_UI has quit IRC (Remote host closed the connection)
johnny5 has quit IRC (ircd.choopa.net hub.efnet.us)
wp494 has quit IRC (ircd.choopa.net hub.efnet.us)
PotcFdk has quit IRC (ircd.choopa.net hub.efnet.us)
rocode has quit IRC (ircd.choopa.net hub.efnet.us)
dboard has quit IRC (ircd.choopa.net hub.efnet.us)
luckcolor has quit IRC (ircd.choopa.net hub.efnet.us)
godane has quit IRC (ircd.choopa.net hub.efnet.us)
robogoat has quit IRC (ircd.choopa.net hub.efnet.us)
wabu has quit IRC (ircd.choopa.net hub.efnet.us)
trs80 has quit IRC (ircd.choopa.net hub.efnet.us)
SadDM has quit IRC (ircd.choopa.net hub.efnet.us)
jspiros has quit IRC (ircd.choopa.net hub.efnet.us)
Panasonic has quit IRC (ircd.choopa.net hub.efnet.us)
j08nY has quit IRC (ircd.choopa.net hub.efnet.us)
Odd0002 has quit IRC (ircd.choopa.net hub.efnet.us)
dashcloud has quit IRC (ircd.choopa.net hub.efnet.us)
antomati_ has quit IRC (ircd.choopa.net hub.efnet.us)
SilSte has quit IRC (ircd.choopa.net hub.efnet.us)
zerkalo has quit IRC (ircd.choopa.net hub.efnet.us)
RedType has quit IRC (ircd.choopa.net hub.efnet.us)
Nazca has quit IRC (ircd.choopa.net hub.efnet.us)
pikhq has quit IRC (ircd.choopa.net hub.efnet.us)
Xamayon has quit IRC (ircd.choopa.net hub.efnet.us)
mgrytbak has quit IRC (ircd.choopa.net hub.efnet.us)
acridAxid has quit IRC (ircd.choopa.net hub.efnet.us)
joepie91 has quit IRC (ircd.choopa.net hub.efnet.us)
cf has quit IRC (ircd.choopa.net hub.efnet.us)
chfoo has quit IRC (ircd.choopa.net hub.efnet.us)
eprillios has quit IRC (ircd.choopa.net hub.efnet.us)
tapedrive has quit IRC (ircd.choopa.net hub.efnet.us)
underscor has quit IRC (ircd.choopa.net hub.efnet.us)
espes__ has quit IRC (ircd.choopa.net hub.efnet.us)
kvieta has quit IRC (ircd.choopa.net hub.efnet.us)
klg has quit IRC (ircd.choopa.net hub.efnet.us)
username1 has quit IRC (ircd.choopa.net hub.efnet.us)
Honno has quit IRC (ircd.choopa.net hub.efnet.us)
brayden has quit IRC (ircd.choopa.net hub.efnet.us)
superkuh has quit IRC (ircd.choopa.net hub.efnet.us)
dcmorton has quit IRC (ircd.choopa.net hub.efnet.us)
odemg has quit IRC (ircd.choopa.net hub.efnet.us)
MrRadar has quit IRC (ircd.choopa.net hub.efnet.us)
zenguy has quit IRC (ircd.choopa.net hub.efnet.us)
xmc has quit IRC (ircd.choopa.net hub.efnet.us)
slyphic has quit IRC (ircd.choopa.net hub.efnet.us)
w0rp has quit IRC (ircd.choopa.net hub.efnet.us)
zino has quit IRC (ircd.choopa.net hub.efnet.us)
ranma_ has quit IRC (ircd.choopa.net hub.efnet.us)
Selavi has quit IRC (ircd.choopa.net hub.efnet.us)
Frogging has quit IRC (ircd.choopa.net hub.efnet.us)
htw has quit IRC (ircd.choopa.net hub.efnet.us)
dxrt has quit IRC (ircd.choopa.net hub.efnet.us)
twigfoot has quit IRC (ircd.choopa.net hub.efnet.us)
atlogbot has quit IRC (ircd.choopa.net hub.efnet.us)
chazchaz has quit IRC (ircd.choopa.net hub.efnet.us)
atomicthu has quit IRC (ircd.choopa.net hub.efnet.us)
TC01 has quit IRC (ircd.choopa.net hub.efnet.us)
swebb has quit IRC (ircd.choopa.net hub.efnet.us)
Darkstar has quit IRC (ircd.choopa.net hub.efnet.us)
Somebody2 has quit IRC (ircd.choopa.net hub.efnet.us)
Cameron_D has quit IRC (ircd.choopa.net hub.efnet.us)
arkiver has quit IRC (ircd.choopa.net hub.efnet.us)
Coderjo has quit IRC (ircd.choopa.net hub.efnet.us)
Jonimoose has quit IRC (ircd.choopa.net hub.efnet.us)
midas has quit IRC (ircd.choopa.net hub.efnet.us)
yipdw has quit IRC (ircd.choopa.net hub.efnet.us)
Baljem has quit IRC (ircd.choopa.net hub.efnet.us)
lainu has quit IRC (ircd.choopa.net hub.efnet.us)
[22:24]
..... (idle for 23mn)
bitBaron has joined #archiveteam-bs [22:48]
.... (idle for 18mn)
johnny5 has joined #archiveteam-bs
wp494 has joined #archiveteam-bs
PotcFdk has joined #archiveteam-bs
rocode has joined #archiveteam-bs
dboard has joined #archiveteam-bs
luckcolor has joined #archiveteam-bs
godane has joined #archiveteam-bs
robogoat has joined #archiveteam-bs
wabu has joined #archiveteam-bs
trs80 has joined #archiveteam-bs
SadDM has joined #archiveteam-bs
jspiros has joined #archiveteam-bs
irc.colosolutions.net sets mode: +o SadDM
[23:06]
.......... (idle for 47mn)
Odd0002 has joined #archiveteam-bs
ranma has quit IRC (Killed (ny.us.hub (Nick collision (new))))
MrRadar has joined #archiveteam-bs
username1 has joined #archiveteam-bs
brayden has joined #archiveteam-bs
superkuh has joined #archiveteam-bs
dcmorton has joined #archiveteam-bs
odemg has joined #archiveteam-bs
zenguy has joined #archiveteam-bs
twigfoot has joined #archiveteam-bs
xmc has joined #archiveteam-bs
slyphic has joined #archiveteam-bs
w0rp has joined #archiveteam-bs
ranma has joined #archiveteam-bs
Selavi has joined #archiveteam-bs
Frogging has joined #archiveteam-bs
htw has joined #archiveteam-bs
dxrt has joined #archiveteam-bs
atlogbot has joined #archiveteam-bs
chazchaz has joined #archiveteam-bs
atomicthu has joined #archiveteam-bs
TC01 has joined #archiveteam-bs
swebb has joined #archiveteam-bs
Darkstar has joined #archiveteam-bs
Somebody2 has joined #archiveteam-bs
Cameron_D has joined #archiveteam-bs
arkiver has joined #archiveteam-bs
irc.servercentral.net sets mode: +oooo brayden xmc swebb arkiver
Coderjo has joined #archiveteam-bs
Jonimoose has joined #archiveteam-bs
midas has joined #archiveteam-bs
yipdw has joined #archiveteam-bs
Baljem has joined #archiveteam-bs
lainu has joined #archiveteam-bs
irc.servercentral.net sets mode: +oo Jonimoose yipdw
swebb sets mode: +o SadDM
swebb sets mode: +o DFJustin
swebb sets mode: +o SketchCow
swebb sets mode: +o balrog
ranma_ has joined #archiveteam-bs
[23:53]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)