Image synthesis
Assignee
Koninklijke Philips N.V.
Inventors
Christiaan Varekamp, Bart Kroon
Abstract
A first apparatus comprises a first receiver (301) receiving images of a scene captured and a second receiver (303) receives 3D spatial data for the scene A view synthesis neural network (307) generates view shifted images for the scene for different view poses from the images and the spatial data. A neural network trainer (309) trains the view synthesis neural network (307) based on images of the scene for different view poses. A generator (305) generates an audiovisual data stream comprising: image data for the images, scene data representing the three dimensional spatial data, and coefficient data describing coefficients of the view synthesis neural network (307) after training. A second apparatus receives the audio visual data stream and sets a local neural network (403) based on the coefficient data. The local neural network (403) is then used to generate images of the scene for different view poses.
CPC Classifications
Filing Date
2023-03-07
Application No.
18844210
Claims
24