Using multiple cameras in sports tournaments to have in-home 360-degree view using your remote.
Features
Robust object tracking technology using machine learning.
With object tracking techniques using machine learning, you can track balls robustly under various circumstances. Also, by improving the frame rate of the processed video, you can track balls with faster motion than ever before.
Camera calibration for multiple movable cameras
We developed a calibration technique for multiple movable cameras that can process with high accuracy and in real time. Through this, even when the camera and subjects move, accurate three-dimensional position calculation and CG synthesis can be done in real time.
Future plans
In addition to improving the performance of each elemental technology, [NHK] will proceed with verification in various competitions aiming for use at the Tokyo Olympics and Paralympic Games in 2020.
Interactive viewing of multi-view video using MPEG-DASH
MPEG-DASH is a technology that you can watch while switching the viewpoint smoothly by touch operation with PC web browser or smartphone. It is done by generating the camera image of each viewpoint by the MPEG-DASH method and efficiently distributing it according to user’s operation.
Utilization of image processing technology on the cloud
You can now watch content such as 360 degree video that requires advanced video processing even on terminals like CPU and memory with limitations on TV and memory [by using the cloud]. Execute video processing according to user’s operation on the server on the cloud and realize it by transmitting to the television by WebRTC.
Future plans
We are pursuing technological verification for practical application and R & D aiming for stable and comfortable net viewing.
- Translated from the original in Japanese on the NHK website: https://www.nhk.or.jp/strl/open2017/tenji/ display 4 and 5
I believe this technology is inevitable and shows new ways to watch and think about television. This adds a whole new level of interaction to TV and video viewing in general. I look forward to seeing if they succeed in time for the 2020 Olympic games.