Australian Politics Forum

Welcome, Guest. Please Login or Register

Forum rules, Recent posts (with text), RSS, Search options, Browse all uploaded images
Home, Articles, Green Tax Shift, Evolution,

Australian Politics Forum › General Discussion › Feedback › bots, DDOS?

‹ Previous Topic | Next Topic ›

Pages: 1

bots, DDOS? (Read 143 times)

freediver Gold Member Offline www.ozpolitic.com Posts: 51451 At my desk.	bots, DDOS? Oct 13^th, 2025 at 4:37pm Lately there's been about 2500 'guests' active in the last 15 minutes, listed as separate IP addresses on the forum home page. The IP addresses are all different and unrelated. I am pretty sure that is why the forum has been slow. Any idea where that is coming from or how to block it?
Back to top	People who can't distinguish between etymology and entomology bug me in ways I cannot put into words. IP Logged

Setanta Gold Member Offline \/ Peace man! Posts: 17109 Northern NSW Gender:	Re: bots, DDOS? Reply #1 - Oct 13^th, 2025 at 5:16pm Something like cloudfare is the only way to really put the breaks on things like ddos, if that's what it is. That people can still somewhat use the site shows it's not a very determined ddos, if it is.
Back to top	IP Logged

freediver Gold Member Offline www.ozpolitic.com Posts: 51451 At my desk.	Re: bots, DDOS? Reply #2 - Oct 13^th, 2025 at 9:31pm Looks like it's bots, in particular these 3: Amazonbot PetalBot meta-externalagent/1.1 Anyone have any insight into them? I am tempted to just block all 3, or maybe try throttling them, but I don't want to harm any search engine rankings. As far as I can tell they are just harvesting data to train AI.
Back to top	People who can't distinguish between etymology and entomology bug me in ways I cannot put into words. IP Logged

Redmond Neck

Gold Member

Offline

OzPolitic

Posts: 22365
ACT
Gender: male

Re: bots, DDOS?
Reply #3 - Oct 14^th, 2025 at 2:18pm

freediver wrote on Oct 13^th, 2025 at 9:31pm:

Looks like it's bots, in particular these 3:

Amazonbot
PetalBot
meta-externalagent/1.1

Anyone have any insight into them? I am tempted to just block all 3, or maybe try throttling them, but I don't want to harm any search engine rankings. As far as I can tell they are just harvesting data to train AI.

I would block them temporarily and see what happens!

Its bloody terrible at the moment trying to waoit for the relly slow loading of postst!

BAN ALL THESE ABO SITES RECOGNITIONS.

ALL AUSTRALIA IS FOR ALL AUSTRALIANS!

IP Logged

freediver Gold Member Offline www.ozpolitic.com Posts: 51451 At my desk.	Re: bots, DDOS? Reply #4 - Oct 14^th, 2025 at 3:16pm I have blocked all 3, but not seen any improvement yet. I'll give it 24 hours, as I understand the bots might not check the robots.txt file regularly. If that doesn't fix it, it means something is pretending to be Amazonbot etc, which will be harder to deal with.
Back to top	People who can't distinguish between etymology and entomology bug me in ways I cannot put into words. IP Logged

Setanta Gold Member Offline \/ Peace man! Posts: 17109 Northern NSW Gender:	Re: bots, DDOS? Reply #5 - Oct 14^th, 2025 at 6:31pm If they are AI bots you could have a read.
Back to top	IP Logged

Setanta Gold Member Offline \/ Peace man! Posts: 17109 Northern NSW Gender:	Re: bots, DDOS? Reply #6 - Oct 14^th, 2025 at 6:49pm I'd try blocking every crawler in robots.txt then noting which ones do not honour the robots file and ban the lot, then allow the rest again.
Back to top	IP Logged

freediver

Gold Member

Offline

www.ozpolitic.com

Posts: 51451
At my desk.

Re: bots, DDOS?
Reply #7 - Today at 11:17am

Hi everyone, quick update. It looks like the site is being slowed down by bot traffic. These are "bad" bots that don't obey the rules and are fairly good at impersonating real traffic, so there is no cheap and easy way stop them. From what I can gather they are most likely gathering data for training AI.

I got a bit of a reprieve yesterday by rebooting the server, however the bots seem to have figured that one out as it does not work any more.

I still have a few more things I can try out, but won't get on to them in a hurry.

People who can't distinguish between etymology and entomology bug me in ways I cannot put into words.

IP Logged

Pages: 1

‹ Previous Topic | Next Topic ›

« Forum

‹ Board

Top of this page