to detect and block the
(1) hundreds of attempts daily to find hackable scripts / software on the site
(2) hundreds of attempts daily to send spam to or via the site
![[cursing]](./images/smilies/msp_cursing.gif "Cursing"){kind=small}
subscriber
more hours spent today setting up some software I have used in the past,
to detect and block the
(1) hundreds of attempts daily to find hackable scripts / software on the site
(2) hundreds of attempts daily to send spam to or via the site
to detect and block the
(1) hundreds of attempts daily to find hackable scripts / software on the site
(2) hundreds of attempts daily to send spam to or via the site
subscriber
Just to give you an idea, here's a map with the ~ 400 hack attempts against the email software
in the last 12 hours or so![[glare]](./images/smilies/msp_glare.gif "Glare")
(note: these are all from different sources, every attempt is blocked instantly)
(the map was created with amcharts)
in the last 12 hours or so
(note: these are all from different sources, every attempt is blocked instantly)
(the map was created with amcharts)
subscriber
How much has this changed in the last 10-20 years
i suppose defenses have hardened considerably
i suppose defenses have hardened considerably
subscriber
both offense and defense have increased significantlyfrederick wrote:How much has this changed in the last 10-20 years
i suppose defenses have hardened considerably
subscriber
more DDOS / AI crawler load, for example, over the past 5 days:
more than 130,000 requests for the forum FAQ page (!) from about 500 different computers.
below the map showing how many were from each country.
I've set something up so any computer visiting that page is automatically blocked (so don't try![[lol]](./images/smilies/msp_lol.gif "LOL")
)
more than 130,000 requests for the forum FAQ page (!) from about 500 different computers.
below the map showing how many were from each country.
I've set something up so any computer visiting that page is automatically blocked (so don't try
) subscriber
seems so, for this "run".flash wrote:Nothing from China?
no idea where all these PCs are being controlled from though, could be anywhere.
subscriber
You probably noticed there was another one on Sunday,
this time originating from Vietnam.
(it could very well be that this is simply a "botnet" of computers controlled from a different country).
This was (of course) another AI crawler, only getting forum content.
The rate was pretty crazy, easily 10 requests a second for hours on end.
I now blocked most of Vietnam I think![[bored]](./images/smilies/msp_bored.gif "Bored")
edit: and some more reading: https://techcrunch.com/2025/03/27/open- ... vengeance/
this time originating from Vietnam.
(it could very well be that this is simply a "botnet" of computers controlled from a different country).
This was (of course) another AI crawler, only getting forum content.
The rate was pretty crazy, easily 10 requests a second for hours on end.
I now blocked most of Vietnam I think
edit: and some more reading: https://techcrunch.com/2025/03/27/open- ... vengeance/
subscriber
Another update and some numbers.
Software that automatically detects mishaving AI crawlers / bots / scrapers has been active for a while,
and bans a source for 100 hours when detected.
At the moment a little under ten thousand such bans are active.
And even right now the site is under relatively heavy load because of an AI crawler from China that has
not been "caught" yet (and of course does not play by the rules![[mad]](./images/smilies/msp_mad.gif "Mad")
)(about 225000 requests in 4 days ![[blink]](./images/smilies/msp_blink.gif "Blink")
).
More reading on the subject: https://science.slashdot.org/story/25/0 ... d-journals
But of course this is all necessary, because everybody wants AI and everybody will get rich
Software that automatically detects mishaving AI crawlers / bots / scrapers has been active for a while,
and bans a source for 100 hours when detected.
At the moment a little under ten thousand such bans are active.
And even right now the site is under relatively heavy load because of an AI crawler from China that has
not been "caught" yet (and of course does not play by the rules
)(about 225000 requests in 4 days ).More reading on the subject: https://science.slashdot.org/story/25/0 ... d-journals
But of course this is all necessary, because everybody wants AI and everybody will get rich
subscriber
As you may have noticed, there was another site overload & crash, again because of an AI crawler from China.
It caused the database to crash, and the server load to be about 1000 times the normal value
So again _a lot_ of time spent in recovery, cleanup, log file checking, looking into "rate limiting" software, etc. etc..![[crying]](./images/smilies/msp_crying.gif "Crying")
It caused the database to crash, and the server load to be about 1000 times the normal value
So again _a lot_ of time spent in recovery, cleanup, log file checking, looking into "rate limiting" software, etc. etc..