In recent years, the state of video production has changed drastically due to the evolution of AI technology. In particular, in K-pop and other MV productions, content utilizing AI is increasing, and higher quality and unique visuals are being pursued. In this article, I will introduce the process of video production using generative AI and its possibilities.

A virtual production verification video was produced in 2024/10 at the Daikanyama Metaverse Studio in collaboration between Shochiku Co., Ltd. and Kadinche Co., Ltd.

Our main business is software development and content production that runs on VR hardware, and I've been reading books related to cognitive science, psychology, and brain science because I wanted to know more about the people who receive them. I'd like to share those reading memos in this post.

The Apple Vision Pro, which went on sale in the US on 2024/2/2, went on sale in Japan on 2024/6/28 with a delay of about 5 months, and it arrived at our company today 2024/7/8. I tried using it for an hour and was impressed, so I wanted to write this essay.

About virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR)

Until now, we have been shooting virtual productions using a combination of the RedSpy camera tracking system and the Sony FX6 cinema camera. In the case of shooting with multiple cameras, it has been possible to create images in different patterns with a virtual camera within the UE or a fixed camera without tracking, but now we have verified the operation of the SONY FR7 swivel camera with interchangeable lenses.

Since InCameraVFX displays images rendered in real time on an LED according to the camera's angle of view, one camera is operated, but technology that enables simultaneous shooting with 2 or more cameras has begun to appear, and it is beginning to be used for shooting and distribution.

The HP Reverb G2 Omnicept Edition, which is a VR head-mounted display that can detect pupils, gaze, heart rate, and mouth movements, has arrived at us, so we first checked the operation of the characteristic features. I felt that the acquisition of this biological information could be effectively used for future user analysis in VR applications, medical applications, etc.

This is a memo I tried using Pixotope, a real-time compositing software used for virtual production.

The 3D interactive display zSpace Inspire will be available