Alibaba Built An AI That Can Use Your Phone For You

Alibaba just released an AI that can use your phone the way you do. Not through an app’s API, not through some special integration. It looks at the screen, sees the buttons and menus like a person would, and taps the right one.

It is called Qwen-UI-Agent, and the numbers are wild if they hold up. On a benchmark of real phone tasks, it got the job done correctly more than nine times out of ten. Book a ride, order food, fill out a form buried three menus deep, the kind of fiddly multi-step stuff that trips up most automation. Alibaba put the weights up on GitHub, so anyone can run it, not just Alibaba’s own apps.

This is the part of AI that still gets me, honestly. A model that reads a screen the same way your grandmother does and figures out where to tap next. That is a different kind of intelligence than writing an essay or solving a math problem. It is closer to how we actually live day to day, tapping through apps, filling out forms, doing the small annoying digital chores nobody enjoys.

I will be honest about the part that gives me pause too. An AI that can operate any app on your screen is also an AI you are trusting with your banking app, your messages, your photos. That is a lot of access to hand over, and the security question of what happens when someone points this at a screen it should not touch is not fully answered yet.

But strip away the caution for a second and look at what it points toward. A future where you do not learn an app, you just tell your phone what you need and it handles the clicking. For anyone who finds technology a little exhausting to navigate, that is not a small thing. That is the whole promise of this stuff finally showing up somewhere useful.

——

Follow: @Ali Demi
Book your free AI clarity call, NOW!
https://buff.ly/TpWy277

——

Sources:
https://tongyi-mai.github.io/Qwen-UI-Agent/
https://github.com/Tongyi-MAI/MAI-UI
https://pandaily.com/alibaba-qwen-ui-agent-gui-agent-foundation-model-screen-control-aug2026

Repost this. Thanks.