METHOD AND APPARATUS FOR GENERATING DIGITAL HUMAN VIDEO BASED ON LARGE MODEL, INTELLIGENT AGENT, ELECTRONIC DEVICE, AND STORAGE MEDIUM
Applicants
Beijing Baidu Netcom Science Technology Co., Ltd.
Inventors
WU,, Tian, WANG,, Haifeng, TIAN,, Hao, WU,, Wenquan, DAI,, Dai, LIU,, Simei, WANG,, Li, ZHOU,, Hang, GAO,, Cong, XIE,, Qunyi, HAO,, Qingchang
Abstract
The present disclosure provides a method and apparatus for generating a digital human video based on a large model, an intelligent agent, an electronic device, and a storage medium, which relate to a field of artificial intelligence technologies, in particular to technical fields such as deep learning, large models, computer vision and so on, and may be applied to scenarios such as video livestreaming, advertisement production, and e-commerce sales. The method for generating a digital human video based on a large model includes: acquiring a requirement information, where the requirement information includes an action description information for describing a specified action video segment, and the action video segment represents a specified action of a target object; processing the requirement information using a first large model to obtain a target script, where the target script includes a target speech segment text matching the action description information; and processing the target script and the action video segment using a second large model to obtain a target video for displaying a target digital human performing a speech delivery based on the target speech segment text while performing the specified action.
IPC Classifications
Designated States
AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LI, LT, LU, LV, MC, ME, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR