On May 23-24, 2024, the "Yangtze River Discussion and the 27th Intelligent Audiovisual and Technological Innovation Industry Forum" hosted by Streaming Media Network and co-organized by Hubei Changjiang Cloud New Media Group, Hubei Telecom, Hubei Mobile and Hubei Unicom was held in Wuhan, Hubei.
With the theme of "Insight into the New Pattern, Intelligent Change and New Audio-visual", this year's discussion focuses on the changes in the large-screen pattern and looks for a new path for audio-visual. On the afternoon of the 23rd, at the Zhiping Operation Theme Forum, Zhou Yunlong, CEO of Shanghai Shijiu Information Technology Co., Ltd., delivered a keynote speech entitled "New Ecology of Large Screen under New Quality Productivity", introducing the application prospects of JsView's core technology in the industry.
The following is the full text of the speech:
Experts, leaders, good afternoon, it is a great pleasure to gather in Wuhan again to exchange and share with you. The title of my speech today is "The New Ecology of Large Screens under the New Quality of Productivity".
First of all, a brief introduction to the basic situation of the company, Shijiu Technology Co., Ltd. was established in 2014 in Shanghai, so far there are more than 50 people, 70% of whom are R&D personnel.
The company's core team comes from Intel and Shanghai Jiaotong University, and has many years of experience in technology research and development in the browser and player industry, and the company has also been serving the large screen industry.
The picture above shows some of the honors won by the company - high-tech enterprises, specialized and special new enterprises and 20 invention patents.
So what is the new quality productivity of large screens? The new quality productivity is first guided by innovation, and then high-tech, high-quality, high-efficiency production, and can reduce costs and increase efficiency, giving new life to the terminal.
In addition, the way we test the new quality of productivity is still value-oriented, whether it is valuable to users and whether it is valuable to business, which is the core.
In fact, at present, the update iteration of IPTV and OTT is relatively slow and the cycle is relatively long, so how can we ensure that users can continue to get the services they deserve very smoothly on the terminals with a longer duration, so that the old boxes and old terminals have new life, and how to make the original services quickly land and provide services on the new terminals?
So next, I will introduce the company's core technical solutions and technical directions one by one.
JsView Browser Engine and JsvPlayer Player
Since its inception, the company has been engaged in browser-related business. In the past, we called it a light application, but now in order to make it easier for others to understand this concept, we call it a mini program, that is, it is based on the development and application of a small program on JsView.
In fact, in the field of large screens, the performance and configuration of many terminals are uneven, so how to make a light, small, and fast browser kernel/engine is very important.
At present, the company has made it light enough and fast enough. A browser, the installation package is only 3M, the memory is only 15M, and the frame rate is smooth at 50fps. At present, the experience brought to users is exactly the same as that of mainstream Internet TVs and high-configuration TVs, and basically the same performance indicators as the original.
We've also upgraded the JsView engine with new features to support advanced animation effects, including Spring Festival couplets, firecrackers, fireworks, 3D flipbook scene switching, water ripples, broken glass, and more.
For example, 3D flipbook-style scene switching. JsView is implemented by using a 3D engine, which is equivalent to GPU acceleration, and it can essentially do a lot of higher-end, advanced effects, and even 3D effects such as 3D flipbook scene switching. As long as we make the underlying capabilities, the development above can be as you like, as long as you want it, we can help you do it.
We allow independent development, independent deployment, and we provide customers with very large projects, so it is impossible to be completed by one team or a few people, many of them are divided into teams, division of labor, and all aspects are flexible. We have also introduced a modular approach to development, allowing for a division of labor for large projects.
Recently, a lot of function expansion has been made,Support remote control+Touch interaction integration,In the past, the large TV screen was still dominated by remote control,This is enough in the TV scene,But as the customer's business continues to expand outward,It will be expanded to audio、Middle screen、Car machine, etc.,Remote control is difficult to meet these business needs。 With our solution, you can automatically support touch and land end-to-end at the same time. Recently, the company has spent a lot of energy and time on touch work, and now the support is very complete, and many application customers have used it.
In addition, now applications are all about cloudification, and the leaders of the Guangzhou Academy of Sciences also talk about cloudification and cloud applications, so how can we achieve cloudification? We all know,The terminal of the large screen cloud can't stand the toss,Tossing and tossing may toss the terminal away,How do we toss the terminal as little as possible,And can operate efficiently、Efficient iteration of products,In response to this,The company has made a dynamic loading mechanism,Basically, after a base enters,Almost the original native ability expansion and introduction do not need to upgrade the base,Similar to Android's plug-in mechanism。
In the audio-visual industry and in the field of large screens, player updates have relatively high requirements, and the company's plug-in players can allow developers to flexibly load dynamically.
At the same time, we can also achieve a single process, multi-core, for example, we open Baidu and Sina on the browser, a version of an ordinary browser only corresponds to a kernel, and we can do each web page, applet, can use its own exclusive kernel. The reason why this can be done is because our kernel is small enough, only 1M, which is equivalent to three to four poster pictures, so it is very flexible, and each applet application can have its own APP. Moreover, development, maintenance, and iteration can be managed by yourself, without considering compatibility, which can greatly improve the product iteration cycle and efficiency.
JsvPlayer has been applied to many operators' services, and the protocol supports platforms such as Huawei and ZTE, as well as IGMP, RTSP, HLS and other protocols. In terms of compatibility and adaptability, the player should be the best in the industry.
At present, double speed is a very mainstream user demand,So how can this speed be used by users on the original terminal,In the past, Android 6.0 or above was supported,And now on Android4.0, you can support double speed function,Including green screen cutout、Picture-in-picture can be supported。 And the management cost is low, and there is no need to upgrade the system.
In the application scenario of JsvPlayer, it also supports IPTV live broadcast/on-demand and IPTV soft terminals. At present, the biggest problem of soft terminals is how to move IPTV video services to OTT. It turns out that the TV protocol is not so complete, and when we support the IPTV video service to move to OTT, OTT on demand, KSong/music are supported, and KSong can also divide audio tracks. In addition, through various technologies such as cutouts, we also support relatively high-end ads.
Industry AI model
Recently, we have been talking about large models and AIGC, and we, as a technology company, have been accumulating at the technical level. Now we are working on a large model of customizable AI in the industry.
Of course, the large model can't be completely pre-trained by itself, it must be done with the open source model, and after comparison, we finally chose the "Qianwen" model of Ali open source as the basis for us to make industry custom models, and the technology stack of the entire large model has been built.
To serve the whole scene well, the first is to pre-train, which can be customized and adjusted. We have adopted the most cutting-edge agent framework and developed in the direction of intelligent twins and general-purpose home assistants. We have also done a lot of research work on inference optimization, which makes the response speed faster and the inference cost greatly reduced.
The following introduces the next generation of AI home assistant, we hope that it can really be a companion and conversational home assistant at home, the interaction is full voice interaction, integrating the needs of film and television, entertainment, multimedia and other scenarios. Behind it is a general large model framework, with generative capabilities, which can accompany you to chat, and you can ask it about weather, calendar, and encyclopedia knowledge.
At present, the next-generation AI home assistant has been applied in our own terminal system and products, and all customers and users are eye-catching for this product.
A new ecology of Mini Programs
Based on the above core technologies, the cloud-based Mini Program ecosystem came into being. First of all, to build a cloud-based application ecosystem, you need to have a base, which is the foundation for carrying all Mini Programs.
Our base, first of all, it is based on the JsView browser to do it; Second, it supports plug-ins, flexible expansion of native capabilities, and multiple memory; Third, it is selected on demand, and each application does not interfere with each other; Fourth, the package body is extremely small, and the base is only 3M, but such a small base, it can support thousands of applications, which greatly liberates the restrictions on the terminal.
Our partners have many leading application developers in the industry, such as those who are familiar to everyone, such as Sing Bar, Himalaya and so on.
Our applet also supports the development of multi-terminal applications at one time, that is, it has developed not only landing applications on the large screen, but also can be expanded to many other screens, taking the singing bar as an example, it has been developed on the large screen, and the exact same version can be directly applied to the girlfriend machine, speakers with screens, car machine screens, etc.
In terms of ecology, we need to work with other partners in the industry, such as EPG development or applications, and we will provide new middleware such as browsers and players. We hope to have more partners in the future.
Welcome everyone to use JsView technology to build a new ecology of large screens!