• NotSteve_@lemmy.ca
    link
    fedilink
    English
    arrow-up
    8
    ·
    18 hours ago

    What the hell would mouse movements even be useful for outside of things already better achieved by frameworks like Playwright? Are they planning to let AIs control desktop peripheral input? For it to be useful you’d need the AI to have full screen visibility and if you have that, why not just script the mouse movement to where you want it to go?

    • Meron35@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      15 hours ago

      Are they planning to let AIs control desktop peripheral input?

      Yes. Since 1-2 years ago there’s been an AI browser war, where tech companies are racing to have LLM agents browse the internet for you.

      For it to be useful you’d need the AI to have full screen visibility

      Exactly what they are pushing for, see Microsoft Recall, Claude Cowork, Perplexity Computer, etc.

    • stylusmobilus@aussie.zone
      link
      fedilink
      English
      arrow-up
      2
      ·
      16 hours ago

      It’s all good, just wait. He’ll drop 4 or 5 billion on something involving this and he’ll lose it.

      He’s had one good idea which he got lucky with, bought out others to monopolise. Everything else he’s done is shit, not just turned out to be shit but is genuine shit.