← USPTO Patent Grants

Image synthesis

Grant US12587623B2 Kind: B2 Mar 24, 2026

Assignee

Koninklijke Philips N.V.

Inventors

Christiaan Varekamp, Bart Kroon

Abstract

A first apparatus comprises a first receiver (301) receiving images of a scene captured and a second receiver (303) receives 3D spatial data for the scene A view synthesis neural network (307) generates view shifted images for the scene for different view poses from the images and the spatial data. A neural network trainer (309) trains the view synthesis neural network (307) based on images of the scene for different view poses. A generator (305) generates an audiovisual data stream comprising: image data for the images, scene data representing the three dimensional spatial data, and coefficient data describing coefficients of the view synthesis neural network (307) after training. A second apparatus receives the audio visual data stream and sets a local neural network (403) based on the coefficient data. The local neural network (403) is then used to generate images of the scene for different view poses.

CPC Classifications

H04N 13/111 H04N 13/172 H04N 19/597 H04N 21/21805 H04N 21/44012 H04N 21/816 H04N 13/156 H04N 13/161 H04N 13/194 G06N 3/02 G06N 3/045 G06T 15/20 G06T 17/00 G06T 19/00

Filing Date

2023-03-07

Application No.

18844210

Claims

24