XR technology + LED display, leading the new trend of virtual production

In the past two years, XR technology has begun to enter the public field of vision. More and more concerts, press conference sites, film shooting sites and TV programs and other scenes begin to use the high-tech and realistic sense of XR technology, so as to realize more possibilities for creation. With the blessing of 5g, the popularization of extended reality (XR) technology is the general trend. By constructing a virtual world and interacting with the real world, it finally realizes the perfect integration of virtual and reality.

 

What is XR technology?

XR (extended reality) is a term used to describe an environment or interaction that combines virtual and real elements. In addition to AR (augmented reality), VR (virtual reality) and MR (mixed reality), it also has a special meaning in film and television, broadcasting and live entertainment production. At present, XR has become the mainstream of virtual studio industry. In the industry description a few years ago, XR is more like the general description of AR and VR technology. It can be used to refer to the integrated system containing virtual and real world, and even equivalent to a specific motion capture technology, AR application or VR game. In the field of content production, it is specifically referred to as the workflow including LED display, camera tracking system and powerful graphics engine. It is a virtual production method that puts performers in the virtual world in real time without green screen and post production process.

 

The rise of XR technology combined with LED display makes virtual production shine in the film and television production industry

With the rapid development of LED display industry, innovative elements continue to emerge, there are many new opportunities for development, and the application field is also increasing. As a hot topic this year, XR technology will soon shine in the professional audio-visual field. In recent years, the major screen enterprises have entered the industry, causing a new wave of virtual production trend.

 

The reason why LED display screen is widely used in virtual production is not only because it is more compatible with the XR technology, but also because it has a good help to the performance of actors and the post production of video. In the production of XR video with LED display screen as the background, first of all, real-time rendering technology is used to restore the photo level dynamic digital scene on the LED display screen, build the shooting scene, output the composition through the media server, use the camera tracking system to locate the space and location information, and map the spatial relationship between the person and the scene in real time, Real time rendering and output of a virtual scene without dead angle, and in this real-time rendering of the shooting scene, actors can directly interact with the virtual visible scene. Compared with the traditional non physical performance, this kind of scene with physical reference can make actors experience a more realistic sense of the official performance environment, and enable actors to enter the scene quickly.

 

In the traditional green screen shooting environment, it often takes a lot of time to do fine matting and repair the problem of color overflow. Compared with the traditional green screen, the LED display solves this problem well. The shooting team can play interactively with the LED display in the created 3D environment. In this process, the shooting team can not only edit the content in real time, but also track the pixels accurately, and correct the perspective of the high-resolution rendered 3D image, After the accurate camera tracking system is added, the camera begins to move around the real and virtual elements which are seamlessly combined in the LED environment, so that the audience who observe through the camera perspective has the illusion of fusion immersion; Secondly, because the shooting scene is generated by LED display, it supports the import of conventional pictures, 360 ° panoramic pictures and videos, 3D models and external camera signals into the studio, realizing the free switching of scenes at any time. The LED display stage technology and playback technology greatly reduce the post production time and difficulty for the visual effects department, and reduce the time cost of video production The cost of shooting is also greatly reduced; Moreover, the LED stage combined with XR technology presents more accurate highlight, reflection and rebound on the film reflective clothing. Therefore, the use of LED display combined with XR technology can make the director directly feel the real-time picture on the scene, shorten the workflow, and greatly reduce the workload in the later stage, It not only improves the production efficiency, but also creates more magic scenes according to the needs of the director. In addition, virtual production solves the transportation cost and environmental waiting cost of location shooting. In short, the production team can make and modify the required environment at any time without waiting for rain or sunset.

 

The virtual film and television production technology of LED display combined with XR technology has changed the traditional way of film production and brought more possibilities and innovations for film production. With the rapid development of China's film industrialization process, the popularization of the working system of virtual space expansion to the film industry production line will be a thing in the near future. At that time, the market demand of LED display in this field will increase greatly.

 

The stumbling block in the promotion of XR Technology

There is no limit to the application prospect of XR technology. According to the data, the consumer market is the largest market for AR / VR spending. In the next two years, the XR market is expected to grow 8 times, and the market size will exceed US $209 billion by 2022. Manufacturing, retail and service industries are also important directions for this spending. It can be seen that XR has great development potential in entertainment, marketing, training, real estate, remote cooperation and so on. With the mature implementation of 5g network, the response speed and data processing ability of XR will be greatly improved, which is conducive to the rapid implementation and wide popularization of its technology application. Compared with the green screen, the virtual production technology of LED display combined with XR technology has many advantages, but the XR technology itself also has limitations. Can x r completely replace the green screen? It has been about five years since the birth of the X-R technology, and the related hardware and software still have a huge space to optimize. Green screen shooting has developed to a very mature stage in the nearly 90 years from 1933 to now, so in some cases, using green screen can achieve more ideal results.

In the process of popularization of XR, there are many obstacles and problems. Network attack, high implementation cost (software and hardware), scarcity of technology and maintenance, backward after-sales service and other factors are the resistance to the wide promotion of the application of XR technology, so the large-scale promotion of its technology application lags behind. Therefore, for LED screen enterprises, it is necessary to develop a technology that is not yet mature It's not wise for emerging markets, which are hard to expand. Moreover, compared with the traditional LED screen applications, the virtual LED screen has more stringent requirements for accurate color restoration, dynamic high refresh, dynamic high brightness, dynamic high contrast, wide perspective without color shift, etc., which is a competition between capital and strength for LED screen enterprises, and it may be doomed if they are not careful. Therefore, even if the virtual production of LED display combined with XR technology has a broad market prospect, the instability of the market still limits the consideration and progress of many LED screen enterprises in new application fields.

 

The development of XR technology has led to the development of LED display and opened up a new application market of LED display. The bright future of LED + XR virtual production has come to us. How to use more advanced display technology and XR solutions to boost the progress of virtual production industry and contribute to people's better audio-visual life will be an important condition for many LED screen enterprises to occupy a part of the world in this field, and also one of the important measures for LED screen enterprises to improve their core competitiveness.

 

more articles:

Technology | advantages, disadvantages and future of different packaging technologies for LED small pixel pitch products!  

Sunrise LED Display manufacturer