laitimes

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

Author | Yun Peng

Edit | Li Shuiqing

Zhidong reported on October 10 that today vivo officially released a new AI strategy "Blue Heart Intelligence" at the annual developer conference, and at the same time released an upgraded self-developed blue heart large model matrix, the original system 5 (OriginOS 5), Blue River operating system 2 (BlueOS 2) and many other new products and technology upgrades.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

Shi Yujian, senior vice president and chief technology officer of vivo, took the stage first, and he mentioned that in the past three years and the first three quarters of this year, vivo ranked first in domestic mobile phone sales.

Last year, vivo launched its own technology brand - "Blue Technology". Blue technology is from application innovation to underlying technology innovation, from hardware drive to the formation of software and hardware integration capabilities, which includes "blueprint image", "blue ocean battery life system", "blue crystal chip technology stack" and upgraded "blue heart model" and "blue river operating system".

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

1. vivo released a new AI strategy "Blue Heart Intelligence", which deeply integrates large model technology with mobile phone operating systems

At last year's developer conference, vivo released a self-developed blue heart model matrix composed of five language models in the order of one billion, ten billion, and 100 billion parameters. Shi Yujian said that vivo's positioning of the blue heart model is to make the blue heart model the most understanding of Chinese through the supply of rich Chinese data and knowledge.

As of today, vivo's AI capabilities cover more than 60 countries and regions around the world, serving more than 500 million mobile phone users, and the output of large model tokens exceeds 3 trillion.

At this conference, the vice president of vivo, the vice president of OS products, and the president of vivo AI Global Research Institute officially released vivo's new AI strategy - Blue Heart Intelligence.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

Blueheart Intelligence is a personal intelligence that deeply integrates large-scale model technology with mobile phone operating systems. According to the surrounding explanation, with the blue heart model as the technical base, Blue Heart Intelligence can understand the user's personal situation and preferences, and provide users with personalized and exclusive services; Through the deep integration of the system, we continue to build more natural and intuitive interactions for users, bringing a smarter and warmer experience.

In order to achieve this, vivo reconstructs the system experience with AI from three aspects. The first is to reconstruct the interaction experience between people and devices, so that the interaction is more natural and intuitive. With the blessing of the blue heart model, the mobile phone will have more powerful analysis capabilities, whether it is pressing the screen, circleing text or pictures, or dragging and dropping a piece of address information, the multi-modal model can deeply interpret your intentions, and then give you the feedback and services you need.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

Relying on the large text model, combined with self-supervised learning speech codec, multi-voice task learning and modal alignment and other technologies, Lanxin V further has a strong ability to understand and generate speech representations in addition to text capabilities, so that the mobile phone can naturally communicate with people, translate language, simulate human voices, and even understand emotions in conversations.

The second aspect is to reconstruct the service experience of people and the digital world, and make intelligence more personalized, that is, to build simple and efficient service acquisition capabilities and active service capabilities, so as to make mobile phones become intelligent and warm personal assistants.

vivo has upgraded the basic functions of the mobile phone based on the blue heart model. At the same time, vivo has built a framework and platform for third-party developers to connect services, so that people can find services while the services also actively match people's needs.

In addition, vivo has built a personal intelligence system framework, which establishes the common memory of people and devices through localized knowledge graphs and based on the capabilities of large models on the device side.

At the meeting, a new exploration made by vivo based on the blue heart large model technology was displayed, and the "PhoneGPT" mobile phone intelligent body was released.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

In the demonstration, Blue Heart V can not only recognize and operate the screen interface, but also take over the audio to conduct independent conversations to complete the tasks assigned by the user, such as helping us to order restaurants, order coffee, and so on.

The third aspect is to reconstruct the connection experience between people and the physical world, vivo uses multi-modal large models to make mobile phones the eyes of the visually impaired, helping them to safely walk to farther and unfamiliar places alone.

Second, the big model of the blue heart has been upgraded, and the voice, image, and multi-modality dominate the list

In order to further consolidate the foundation of AI capabilities, vivo released the upgraded self-developed blue heart large model matrix at this year's developer conference, upgraded the capabilities of language large models and device-side large models, and released vivo's self-developed speech large models, image large models and multi-modal large models.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

In terms of the language model, the 100-billion-level blue heart cloud model focuses on optimizing the ability of intent understanding and distribution, as well as task planning. Compared with last year, the overall ability has increased by 30%, ranking first in China on the SuperCLUE and C-EVAL lists.

This time, vivo officially released the new 3 billion parameter level blue heart end-side large model 3B. It is said that in terms of dialogue writing, summary summary, information extraction and other capabilities, Blueheart 3B can leapfrog the industry's 7B-9B model. Compared with the Blue Heart 7B, the peak performance of the Blue Heart 3B is increased by 300%, the power consumption is optimized by 46% in balanced mode, the fastest word output speed can reach 80 words/s, the system power consumption is 450mA, and the memory occupies 1.4GB.

In the evaluation of the comprehensive ability of small models of SuperCLUE and Equal Eval, Blue Heart 3B ranked first, and at the same time obtained the comprehensive capability certification of the device-side large model of Thiel Labs and the AIIA security capability certification.

In addition, vivo has also released a new self-developed blue heart speech model that can accurately understand natural semantics and simulate human voices, a blue heart image model that strengthens the fusion and generation ability of Chinese characteristics and oriental aesthetics, and a blue heart multimodal model that upgrades visual perception and understanding capabilities.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

3. OriginOS 5 was officially unveiled, reconstructing the system experience with AI

As the primary interface between the user and the mobile phone, the operating system directly determines the user's experience. This time, vivo focused on its own technical achievements in the fields of AI, battery life, and communication, as well as its thinking on the basic experience, design, and humanities of mobile phones, and released a new generation of operating system - OriginOS 5.

In the original system 5, based on the blue heart multi-modal large model technology, vivo launched the small V circle search function, on the basis of the existing text search, through the combination of image recognition and circle selection interaction, to achieve "one circle search".

The original system 5 has also upgraded the "atomic island" function, in addition to the notification function, it has the intention recognition ability of the blue heart V, constantly analyze and judge the current needs of users, and actively provide users with latter services.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

In addition, the original system5 has been upgraded to provide smart services in the form of desktop components"Little V suggestions"、Support simultaneous interpretation"Little V help"、Built-in"Little V writing"Vivo input method"Vivo input method"、Support one-click editing and AIThe customized lyrics and songs"Little V time silhouette"、Able to remember the little things that get along with users"Little V memory"function。

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

In terms of smoothness, the original system 5 has received more than 1,000 smooth experience optimizations. At the bottom level of the system, the unfair scheduling mechanism of the original system 5 has been upgraded to version 3.0, and the unfair scheduling mechanism of GPUs has been introduced for the first time, which improves the smoothness of front-end applications by intelligently allocating GPU resources.

At the memory level, the original system 5 introduces the first Ledger memory ledger mechanism in the Android field, which realizes the precise scheduling of memory resources at the system level, uniformly allocates and manages memory resources, and reduces the burden on applications.

Fourth, the second-generation self-developed Blue River operating system debuted, and the smart home ecosystem was connected to Matter

Following the first release of vivo's self-developed Blue River operating system (BlueOS) in November last year, Blue River Operating System 2 was officially released this year, which is equipped with a real-time operating system kernel written in Rust language - Blue River kernel, which has the characteristics of security, generality and high performance, can be compatible with different embedded platforms, and has complete system scheduling, memory management, file system, network and device management capabilities.

vivo's self-developed large model of the whole family barrel exploded, showing the PhoneGPT agent

Blue River OS 2 will also be the industry's first full-stack operating system written in Rust.

The bottom layer of Blue River OS 2 is the base of vivo's self-developed Blue Heart large model and VCAP inference computing acceleration platform. From the beginning of the design, Blue River has integrated the Blue Heart Large Model Matrix, which supports the flexible end-cloud deployment of the Blue Heart Large Model with different parameters, and supports a variety of AI algorithms such as vision and voice.

On top of this foundation, the new service engine includes data services, intent perception and decision services, etc., which provides capability support for the intent framework. Based on the user's behavior and usage habits, the intent framework can fully perceive the user's usage scenario, accurately understand the user's intent, and finally automatically plan and execute tasks.

In the scenario of interconnection of smart devices at home, vivo is deeply involved in the construction of the Matter ecosystem, and there are more than 1,200 SKUs in the alliance for adaptable and connectable categories. At the same time, vivo supports authoritative associations such as CCSA and has helped formulate more than 20 IoT industry standards.

Conclusion: All in AI, the self-developed large model has been upgraded, and vivo's technological innovation continues to dive

At today's developer conference, the upgrade of various large models and related new technologies are undoubtedly the protagonists, and when the battle of AI mobile phones is becoming more and more intense, vivo has made it clear that it will focus on the layout of AI's strategy, and various technological innovations are also carried out around AI.

From the first release of the self-developed blue heart large model last year, to the gradual enrichment of the large model family, and the frequent dominance of large model results, vivo's technical strength has been verified, and vivo's technological innovation has also continued to dive in the deep water area.

Read on