Is there an issue with the site hosting ?

[craigprice]

Last 3 morning from about 1000-1100 the site has become unworkable - connections time out at the server. I’ve confirmed it’s the server not accepting connections

Just noting to administrator attention please - feels like either there is a process running in the middle of the day that shouldn’t (disk backup etc )
Or there’s an automated site sweep happening that chews all resources (it shouldn’t be able to do so, and the hosting servers should access more cloud resources).

As to performance otherwise - generally ok although it does get slow in peak times, but acceptable.

[Tortoise]

Not sure if it's related or not, but around the time the site has been harder to access, it's been showing an extraordinary number of views in the Where-am-I game - over 3,600 views in 2 days, when it would be less than a tenth of that normally.

[Allchin09]

Yes, also finding it regularly out of action. I haven't noticed the time when this has been happening though.

[north-north-west]

I've only been able to get during short windows; been happening for the last three or four days.

[mountainhigh]

As I write this, on the main forum index page, I see 1,200 or 1,300 "guests" accessing the site. That number seems unlikely to be legit.

[johnw]

I've been unable to log in for days. Recently the site seems to be down/inaccessible most of the time.

[michael_p]

Not sure if this is relevant but AI bots have been scrapping sites for data to train their AI on. I've read about another site that became unusable due to an AI bot scrape. May be worth looking if this is happening here as well.

[wildwalks]

Hi All
Sorry for all the outages, I know it sucks.
It has been down far too much -- sorry.
It is my fault, as I have just not spent the time on the server it needs. I am trying to get to it.
Michael is right that we have seen massive spikes in traffic due to AI systems scraping data, not just for training but also now for real-time question answering. This is text and images, and is difficult to block. We are processing approximately 23 million page requests, sending around 1TB of data each month. This is not a consistent load, but happens in big spikes. The system is currently running through two different firewalls to reduce that traffic. This is a significant part of the issue. I have also resolved other issues along the way. As mountainhigh and Craig pointed out, we are seeing spikes in "guests" for over 1000 at any one time, these are not real users, but bots pretending to be.

I have been unwell for a number of years and have not given this as much time as it needs, but I will get there, again really sorry for the hassle. I know this past week has been particularly challenging, and I'm trying to put a few patches on to hold it over until I can dedicate more time to it.
Matt

[mountainhigh]

... we have seen massive spikes in traffic due to AI systems scraping data ...

Thanks for all of your work, Matt.

There is a great online community here, and it's a shame that bots are making the site unusable for regular participants.

When I logged in today, I noticed a Cloudflare Turnstile-style challenge screen, which I see increasingly deployed on sites with large data stores.

I'm sure I speak for most when I say thanks for all your efforts

[johnw]

... we have seen massive spikes in traffic due to AI systems scraping data ...

Thanks for all of your work, Matt.

There is a great online community here, and it's a shame that bots are making the site unusable for regular participants.

When I logged in today, I noticed a Cloudflare Turnstile-style challenge screen, which I see increasingly deployed on sites with large data stores.

I'm sure I speak for most when I say thanks for all your efforts

+1 Thank you Matt. And that solution is working very well the last few times I've logged in.
Matt 1, Bots Nil

[Son of a Beach]

Great work Matt. Dealing with spammers and bots on a forum has always been a challenge, and I can only guess how much worse it must be getting as the years go by.

[Turfa]

Yes, ..... a HUGE Thank You for all the work to keep the site up !!

[vagrom]

This particular thread "..... site hosting." doesn't appear on the thread list "Active Topics" unless I'm logged in. I only log in to post. I've never seen that before but I know there are certain things like Member details that require membership first.

[wildwalks]

Awww thanks team. Appreciate encouragement. I do think it is a good community and happy Todo my bit to keep it ticking.
Yeah the cloudflare verify will hopefully hold things over for a bit. It does seem to be doing the job well at the moment. Not a perfect solution but good enough for now.

Thanks Vagroom. Interesting. That will need to wait till next week. I suspect with all these server issues that were are half written database entries that might cause issues like that.
Thanks all
Matt