<![CDATA[Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ?]]>Lovely does anybody have a list of all the known user-agents for software ?

I have some WAF rules to write to make sure my server can be seen behind a frontend that is only meant to battle AI crawlers and I rather not (knowingly) leave endpoints open to OpenAI

]]>https://bb.devnull.land/topic/edf02fb2-2606-4a73-b8b8-3d478b237722/lovely-fediverse-does-anybody-have-a-list-of-all-the-known-user-agents-for-activitypub-softwareRSS for NodeSun, 07 Jun 2026 01:03:20 GMTSat, 06 Jun 2026 08:38:33 GMT60<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 20:38:49 GMT]]>@julian seems a lot of people followed it when developping 😅

I caught a couple of randoms (I totally forgot about Friendica) in the bot validator after deploying the new rules, looks like it's safe enough to push in that format to avoid filtering out the fediverse

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116705088574032495https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116705088574032495Sat, 06 Jun 2026 20:38:49 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 18:33:54 GMT]]>@kc@social.coop oh that's just the recommendation described here 🙂

https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/User-Agent

]]>https://bb.devnull.land/post/https://activitypub.space/post/1999https://bb.devnull.land/post/https://activitypub.space/post/1999Sat, 06 Jun 2026 18:33:54 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 17:20:59 GMT]]>@julian accidental standard perhaps, it looks like most start (PACKAGE)/(version 0.0.0) - eg Plume/0.7.2, Mastodon/(a little bit more), Pixelfed/…

That is a good starting point for me to test and see what sticks. Thanks !

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116704310697543291https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116704310697543291Sat, 06 Jun 2026 17:20:59 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 16:52:22 GMT]]>@kc@social.coop my understanding is there is no known standard for UA.

https://github.com/NodeBB/NodeBB/blob/87583bb5c70e11274655face9cb7f2a274f2e1f8/src/request.js#L25

NodeBB just sends NodeBB/ ()

Pretty personalized for NodeBB 🙂

]]>https://bb.devnull.land/post/https://activitypub.space/post/1997https://bb.devnull.land/post/https://activitypub.space/post/1997Sat, 06 Jun 2026 16:52:22 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 14:35:36 GMT]]>@kc Sorry, I am not into crusades, of any sort.

]]>https://bb.devnull.land/post/https://bbs.keinpfusch.net/users/uriel/statuses/01KTENRQ7QGY9BAYKAWQ577WD4https://bb.devnull.land/post/https://bbs.keinpfusch.net/users/uriel/statuses/01KTENRQ7QGY9BAYKAWQ577WD4Sat, 06 Jun 2026 14:35:36 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 12:15:14 GMT]]>@uriel the idea is more understand what we know of in the fedi, open the doors to them, grab the new ones every so often from the logs to adapt, while not letting the capitalist pigs eat all the food in the room because the door wasn't closed enough

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116703108443599143https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116703108443599143Sat, 06 Jun 2026 12:15:14 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 12:10:06 GMT]]>@uriel I wish it was that easy, you'll be surprised how many "legitimate" users, UAs, and retail IP ranges are currently eating shit in my tarpit.

The obvious ones are blocked on three levels at this point, I'm all about making new problems for the smarter ones (and for myself, obviously)

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116703088269540761https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116703088269540761Sat, 06 Jun 2026 12:10:06 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 11:47:51 GMT]]>@kc nope, but the UA of AI bots are known, so what I am doing is, to block them, instead of allowing "everything else".

The other reason I suggest you to block them, is that I am developing my own instance Aktor , and then you will have a new UA. And the fediverse is expanding, with more and more coming.

Better if you focus on blocking AI bot UA.

]]>https://bb.devnull.land/post/https://bbs.keinpfusch.net/users/uriel/statuses/01KTEC5JD0D1A695DQESWBKQ8Xhttps://bb.devnull.land/post/https://bbs.keinpfusch.net/users/uriel/statuses/01KTEC5JD0D1A695DQESWBKQ8XSat, 06 Jun 2026 11:47:51 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 11:21:40 GMT]]>@FenTiger @smallcircles normally yes, my WAF is paranoid psychotic particularly on aws, google cloud, azure, and digitalocean (99% of the internet's problems come from these ranges).

Problem here is that there are instances that exist in those IP spaces, that's why I'm tweaking in user agents and a couple of other checks before it hits the line "fuck-bezos-gates-and-zuckerberg" 😅

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116702897781462697https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116702897781462697Sat, 06 Jun 2026 11:21:40 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 10:06:21 GMT]]>@kc @smallcircles There are quite a few instances out there that will refuse to answer requests unless they have a non-default User-Agent. I think it's generally done by blocking known defaults, rather than allowing known non-defaults.

]]>https://bb.devnull.land/post/https://mastodon.social/users/FenTiger/statuses/116702601619076208https://bb.devnull.land/post/https://mastodon.social/users/FenTiger/statuses/116702601619076208Sat, 06 Jun 2026 10:06:21 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 09:41:20 GMT]]>@smallcircles that's what I'm thinking. I see a lot of random go and other default package UAs, some are legit fediverse servers and others are skriptkiddies that zone will always be very gray.

I guess the best is a little bit of a baseline to work with and the rest will come out in the logs.

I'll check out your project, it looks interesting

]]>https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116702503300069683https://bb.devnull.land/post/https://social.coop/users/kc/statuses/116702503300069683Sat, 06 Jun 2026 09:41:20 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 09:38:16 GMT]]>@kc

I doubt it exists yet.

But, I do suspect some Fediverse software doesn't set a User-Agent.

]]>https://bb.devnull.land/post/https://mastodon.social/users/reiver/statuses/116702491219707525https://bb.devnull.land/post/https://mastodon.social/users/reiver/statuses/116702491219707525Sat, 06 Jun 2026 09:38:16 GMT<![CDATA[Reply to Lovely #fediverse does anybody have a list of all the known user-agents for #activitypub software ? on Sat, 06 Jun 2026 09:30:06 GMT]]>@kc dunno if such a list exists, but it would be useful to have one.

PS. I maintain the 3 fediverse-related curated delightful lists. There's a ton of projects, so it'd be a sizable task to draft such list. See https://delightful.coding.social

]]>https://bb.devnull.land/post/https://social.coop/users/smallcircles/statuses/116702459124743656https://bb.devnull.land/post/https://social.coop/users/smallcircles/statuses/116702459124743656Sat, 06 Jun 2026 09:30:06 GMT