https://developers.facebook.com/communi ... 100617448/Has anyone seen “Python/3.10 aiohttp/3.9.3” or similar hanging about and or found an explanation that is understandable in plain language? Plus, has anyone found a way to stop it without blanket denying it’s IP addresses?
Note: I have searched such things as “what is”, “how to stop” etc.‘til I’m blue in the face but all the results are basically gobbledygook. AI is becoming a proper pain. I’ve just read an article on how to create your own bot in ten minutes in python on the python site. They have a library on bot creation so I assume it’s not python as such it’s probably a dweeb buggering about.
https://www.reddit.com/r/webdev/comment ... http_does/
If it is from facebook, they supposedly honor the rate limit of robots.txt. Basically someone has shared your site and fb is going out to fetch your resources in order to show pretty things like an image of the page and grab meta data for link information. If it is one of their IP's, aiohttp is however the name of the library, so not necessarily FB. https://docs.aiohttp.org/en/stable/
Something like this htaccess entry(used to get example https://gist.github.com/dvlop/fca36213a ... e038a3bbc1)
Code:
# Start Bad Bot Prevention<IfModule mod_setenvif.c># SetEnvIfNoCase User-Agent ^$ bad_botSetEnvIfNoCase User-Agent "^aiohttp.*" bad_bot<Limit GET POST PUT> Order Allow,Deny Allow from all Deny from env=bad_bot</Limit></IfModule># End Bad Bot PreventionStatistics: Posted by bonelifer — Wed Jun 19, 2024 9:00 am