PoA Reliability

jesse said:
poa has a ton of valuable content that is linked to from various search engines.

That said...much of this bot activity these days is driven by AI training.
Click to expand...
I decided to give AI a shot trying an answer an aviation question the other day. It confidently spit out a convincing answer, but then I checked the references for each statement and something like 75% were from PoA.

I was like "I know how reliable the posts on that site are!" and worse, "I post on that site!"
 
Could make a static copy of the site to let bots crawl and update it once a month or so, and lock down the real site.
 
dmspilot said:
Could make a static copy of the site to let bots crawl and update it once a month or so, and lock down the real site.
Click to expand...
One could, but that would not be a good use of effort, since crawlers are not the problem.
 
flyingron said:
This site is wide open for browsing by those without logging in.
Click to expand...
So what the issue? If its not the pipe then is it the database? RAM? CPU?

I limit connections and sometimes my site is 'unavailable' (due to process limits is set in the config) and I really don't care. No one is paying me so they can hit refresh a few times.

Since the board isn't showing a 'at capacity' page I can only assume that it either can't or is not set up to.

You could/should be able to limit non-registered queries (aka make the non-users wait) and process the registered user requests first.

I don't know of this board is open source or commercial so you may or may nor be able to make a mod/plug in to do it.
 
jesse said:
So, one doesn't want to hold back the major search engines.
Click to expand...
If you pee off the 'regulars' your content suffers.

You really only need to allow google, deny all others. either robots.txt or ip based.
 
pfarber said:
If you pee off the 'regulars' your content suffers.

You really only need to allow google, deny all others. either robots.txt or ip based.
Click to expand...
Bing is commonly used over google. And Duck-Duck-go has a following. I use them all.
 
As somebody that's been doing IT for a long time, and has a lot of respect for anyone volunteering to help with anything - which I've done over the years in a few ways, too - I think you guys are doing great. Sincerely.

This site functions quite a bit better than my work portal, which is run by a big company in the top left conus state that starts with M, that I won't mention.
 
pfarber said:
If you pee off the 'regulars' your content suffers.

You really only need to allow google, deny all others. either robots.txt or ip based.
Click to expand...
The problem is the dango bots are not honoring robots.txt and we have software that attempts to note "bot-like" activity and thwart things. In addition GeorgeC spends a lot of time looking at individual problem days and manually blocking things.
 
flyingron said:
The problem is the dango bots are not honoring robots.txt and we have software that attempts to note "bot-like" activity and thwart things. In addition GeorgeC spends a lot of time looking at individual problem days and manually blocking things.
Click to expand...
Not so much, anymore.

GeorgeC,
whose tearless retina takes pictures that can prove
 
Much fewer guests right now (692) rather than the 5-10k present when I noted sluggishness
 
You must log in or register to reply here.
Back
Top