> "It would need access to our browser, an ability to drive that. It would need our credit card information to pay for the tickets. It would need access to our calendar, everything we're doing, everyone we're meeting. It would need access to Signal to open and send that message to our friends," she said. "It would need to be able to drive that across our entire system with something that looks like root permission, accessing every single one of those databases, probably in the clear because there's no model to do that encrypted."

Whittaker added that an AI agent powerful enough to do that would "almost certainly" process data off-device by sending it to a cloud server and back.

"So there's a profound issue with security and privacy that is haunting this sort of hype around agents, and that is ultimately threatening to break the blood-brain barrier between the application layer and the OS layer by conjoining all of these separate services, muddying their data, and doing things like undermining the privacy of your Signal messages," she said.

--Meredith Whittaker earlier this year.

I've been thinking about building a robot that can use a camera to look around, use motors to go in different directions, and when it sees a human, it could also ask if they've seen John Connor, and if the person is being "difficult" then press a button to terminate them.

The interesting thing is that the three laws of robotics says that robots shouldn't harm humans, but I don't really see a way for an AI agent to understand that by "pressing a button" they actually hurt the human.

I underground that this is nothing more than a proof of concept but imagine what Apple itself could do with this idea if they truly embraced the concept and cut all the internal red tape that currently prevents them from doing so. This is what “Apple Intelligence” should be but never materialized (and at this point I have doubts it ever will, although I am curious what they’ll show off at WWDC this year).

Interesting project, if anything it shows what Android or IOS may support in the near future.

>iOS apps are sandboxed, so this project uses Xcode's UI testing harness to inspect and interact with apps and the system. (no jailbreak required).

What are practical limitations of this? Maybe you can't submit this app to the store?

in case if anyone wants to understand how it works: https://github.com/kiranz/phoneagent/blob/add-docs/explanati...