With the launch of ChatGPT, many industries have heard the news, and many bigwigs have said that under AI, many industries can be redone.
The integration of AI into mobile phones is also the consensus of the mobile phone industry, and many so-called end-side large model mobile phones, the concept of AI mobile phones emerges in an endless stream.
On the contrary, Apple is together, without too many actions, and many people think that Apple is completely backward in the AI era.
But judging from the current situation, Apple seems to have found a way to make AI phones after giving up building cars, and that is a new model called "Ferret UI".
Before talking about this model, let's talk about the so-called AI mobile phones of other manufacturers, the so-called AI of these mobile phones, mainly from two aspects, one is to shoehorn a large model into it, driven by cloud or local computing power, and Kimi assistant, GPT app is no essential difference.
The second is to empower AI capabilities in its pre-installed applications, at most to form magic retouching, SMS replies automatically generate these functions, but in fact, this function can be done without AI.
So to put it bluntly, the current AI mobile phone is actually more of a gimmick, with no practical significance, and everyone has not found the real AI road, and the AI large model capability is still only outside the mobile phone system
On the one hand, it can locate and recognize images, UI, etc., and users can have more in-depth conversations with the large model based on specific areas on the mobile phone screen.
Second, "Ferret UI" can recognize speech, text, etc., including detailed descriptions, perception/interactive dialogues, and functional reasoning.
In this way, this "Ferret UI" can be embedded in the iOS system, not only for text recognition, but also for recognition based on the pages and images displayed on the current mobile phone screen, and then interact with the user.
If embedded in Siri, users can use their voice to operate most of the functions in the mobile phone, even the functions in the APP, because it can recognize all the images in the screen, and can form a relatively complete understanding of the functions and operations of the mobile phone application.
In this way, users really don't need to do it themselves, just move their mouths, which is essentially different from the current so-called AI mobile phones.
If it goes well, this year's iPhone16, maybe we will be able to see Apple's AI phone, which can operate the phone based on the user's natural language interaction, and is no longer just an AI gimmick like other AI phones.
It is said that Google has also found the way to AI mobile phones, and domestic AI mobile phones install an AI large model into it, which is completely different, and will recognize the screen UI, semantics, etc., and is also embedded in the Android system, so next, the AI mobile phone competition may begin.