• 0 Posts
  • 63 Comments
Joined 11 months ago
cake
Cake day: January 5th, 2025

help-circle









  • If there was an actor behind a handful of accounts that are mostly run by LLMs (which mimic human input and interaction) it’d be easily viable for state-level or professional actors to pull such an operation off at scale and successfully manipulate a small platform like the fediverse - especially with some level of manual input or confirmation. Even taking believable selfies of real people that fit the profile is possible and can be anticipated if the actor or the organization behind them are resourceful.

    I’m not entirely against instance-level detection that attempts to understand user patterns and prevent or flag abuse to mods and admins, but I do believe that humanized input and interaction can already be effectively emulated and will only advance as time passes.

    I believe that increased scrutiny of users in a centralized manner is a privacy violation. I picked my instance intentionally and I give some level of trust to the instance owners, but I wouldn’t consent to them (or the software they choose to use) handing over my PII or usage patterns to a third-party group that suspects me (even through purely automated mechanisms). I would discontinue using the service in such a scenario.

    To support my point that bot detection is mostly futile on the fediverse, I’d like to draw your attention to a parallel to this situation in gaming with humanized aimbots - which are already incredibly viable and are implemented in a variety of ways.

    There are usually actual human actors guiding input to some degree, but the aimbot/etc. is designed to mimic human input to achieve believable results. I believe this technology could still advance quite a bit and there are new methods popping up as every day passes.

    The key difference between gaming and the fediverse, is that the fediverse is not software running on our computers at the kernel-level (as with most anti-cheat) - it’s a website running in a browser.

    Ultimately, I feel it boils down to just blocking instances that you disagree with the operation of to curate your experience - which is already available on Lemmy.