多媒体设计 ¥71.00
"wav2lip"中文使用指南(User guide in Chinese)
在首次启动应用程序时,需要耐心等待两分钟。因为当第一次启动软件时需要将四个模型复制到相关路径。
"wav2lip"应用程序的功能主要包括:(1)面部动作迁移;(2)根据音频动态地改变唇形。
应用程序对显卡显存的要求很低,在电脑的显卡显存仅2G的配置下,也能流畅运行。
1. 面部动作迁移 (适用于只有主播或数字人的一张照片但是没有视频的场景。面部动作迁移需要参考一个面部动作幅度较小的视频。)
(1) 点击下面的“选择面部图像文件”("SELECT A FACIAL IMAGE FILE")按钮,用于迁移面部动作。面部图像文件扩展名包括*.jpg、*.jpeg、*.png、*.bmp、*.tif、*.tiff、*.jfif和*.gif。
(2) 点击下面的“选择面部视频文件”("SELECT A FACIAL VIDEO FILE")按钮以迁移面部动作。视频文件扩展名包括*.mp4、*.mkv、*.rmvb、*.avi、*.wmv、*.flv、*.mpeg、*.mpg、*.rm、*.mov、*.vob、*.3gp、*.dat和*.asf。
(3) 点击下面的“选择输出文件夹”("SELECT AN OUTPUT FOLDER")按钮保存迁移的视频。保存迁移的视频文件后,将弹出“面部动作迁移”("Facial motion transfer")对话框,显示“迁移动作成功”("Transfer motion successfully!")。迁移后的视频文件名被保存为“初始视频文件名+时间戳”。
2. 根据音频动态改变唇形 (适用于有主播或数字人的一个视频的场景。)
(1)点击下面的“选择面部视频文件”("SELECT A FACIAL VIDEO FILE")按钮。视频文件扩展名包括*.mp4、*.mkv、*.rmvb、*.avi、*.wmv、*.flv、*.mpeg、*.mpg、*.rm、*.mov、*.vob、*.3gp、*.dat和*.asf。
(2)单击下面的“选择音频文件”("SELECT AN AUDIO FILE")按钮。音频文件扩展名包括*.mp3、*.wav、*.ogg、*.m4a、*.flac和*.ape。
(3) 点击下面的“选择输出文件夹”("SELECT AN OUTPUT FOLDER")按钮保存合成的视频文件,该文件会根据音频动态地改变嘴唇形状。当合成的视频文件被保存为“初始视频文件名+时间戳.mp4”(注意文件名会覆盖)时,将弹出“wav2lip”对话框,显示“成功地根据语音动态地改变唇形”("Dynamically change lip shape according to speech successfully!")。
注意:
(1)如果音频文件包含伴奏,则有必要将人声从音频分离。“分离音频”("separate audio" )应用程序可以将音频分为人声和伴奏:https://www.microsoft.com/store/apps/9PCPLT8JGXL6
(2)如果音频文件需要将文本转换为语音,建议选择"文本转语音"("txt2voice")应用程序,该应用程序使用 Microsoft Edge TTS 人工智能语音技术将多种语言的文本转换为高质量的音频,包括74种语言和300多名播音员的声音:https://www.microsoft.com/store/apps/9NGZQ2WPQCCV
User guide for "wav2lip"
When launching the app for the first time, it is necessary to wait patiently for 2 minutes. Because four models need to be copied to the relevant paths during the first launch.
The functions of "wav2lip" app mainly include: (1) Facial motion transfer; (2) Dynamically change lip shape according to audio.
This app has very low requirements for graphics card memory and can run smoothly on a computer with only 2GB of graphics card memory.
1. Facial motion transfer (Suitable for scenarios where there is only a photo of the anchor or digital person but no video. Facial motion transfer needs to refer to a video with a smaller amplitude of facial movement.)
(1) Click "SELECT A FACIAL IMAGE FILE" button below to be used to transfer motion. The facial image filename extension includes *.jpg, *.jpeg, *.png, *.bmp, *.tif, *.tiff, *.jfif and *.gif.
(2) Click "SELECT A FACIAL VIDEO FILE" button below to transfer motion. The video filename extension includes *.mp4, *.mkv, *.rmvb, *.avi, *.wmv, *.flv, *.mpeg, *.mpg, *.rm, *.mov, *.vob, *.3gp, *.dat, and *.asf.
(3) Click "SELECT AN OUTPUT FOLDER" button below to save transferred video. When the transferred video file is saved, a "Facial motion transfer" dialog box will pop up, displaying "Transfer motion successfully!". The transferred video filename is saved as "original video filename + timestamp.mp4".
2. Dynamically change lip shape according to audio(Suitable for scenarios where there is a video of the anchor or digital person.)
(1) Click "SELECT A FACIAL VIDEO FILE" button below. The video filename extension includes *.mp4, *.mkv, *.rmvb, *.avi, *.wmv, *.flv, *.mpeg, *.mpg, *.rm, *.mov, *.vob, *.3gp, *.dat, and *.asf.
(2) Click "SELECT AN AUDIO FILE" button below. The audio filename extension includes *.mp3, *.wav, *.ogg, *.m4a, *.flac and *.ape.
(3) Click "SELECT AN OUTPUT FOLDER" button below to save a synthesized video file, which dynamically changes lip shape according to audio. When the synthesized video file is saved as "original video filename + timestamp.mp4", a "wav2lip" dialog box will pop up, displaying "Dynamically change lip shape according to speech successfully!".
Note:
(1) If the audio file contains accompaniment, it is necessary to separate the vocals from the audio. "separate audio" app can separate audio into vocals and accompaniment: https://www.microsoft.com/store/apps/9PCPLT8JGXL6
(2) If the audio file need to convert text to speech, it is recommended to choose the "txt2voice" app, which uses Microsoft Edge TTS artificial intelligence speech technology to convert text in multiple languages into high-quality audio, including 74 languages and the voices of over 300 announcers: https://www.microsoft.com/store/apps/9NGZQ2WPQCCV
0.0 0+