camenduru / text-to-video-synthesis-colab

Text To Video Synthesis Colab

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

zeroscope doesnt work

Uemuet opened this issue · comments

when i want to generate something i always get

/content/Text-To-Video-Finetuning
seed is 834037899790305933
Loading pipeline components...: 0% 0/5 [00:00<?, ?it/s]2024-01-26 10:00:10.608979: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-01-26 10:00:10.609030: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-01-26 10:00:10.610281: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-01-26 10:00:11.660957: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Loading pipeline components...: 100% 5/5 [00:02<00:00, 2.24it/s]
100% 50/50 [05:50<00:00, 7.02s/it]
Traceback (most recent call last):
File "/content/Text-To-Video-Finetuning/inference.py", line 232, in
export_to_video(video, f"{out_stem} {str(uuid4())[:8]}.mp4", fps)
File "/content/Text-To-Video-Finetuning/train.py", line 118, in export_to_video
img = cv2.cvtColor(video_frames[i], cv2.COLOR_RGB2GRAY)
cv2.error: OpenCV(4.8.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:92: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<1>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'

Invalid number of channels in input image:
'VScn::contains(scn)'
where
'scn' is 40

is there a way to fix that

thanks for the info ❤ please try again

eed is 2629834275745367308
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling transformers.utils.move_cache().
0it [00:00, ?it/s]
/usr/local/lib/python3.10/dist-packages/diffusers/models/transformer_temporal.py:24: FutureWarning: TransformerTemporalModelOutput is deprecated and will be removed in version 0.29. Importing TransformerTemporalModelOutput from diffusers.models.transformer_temporal is deprecated and this will be removed in a future version. Please use from diffusers.models.transformers.tranformer_temporal import TransformerTemporalModelOutput, instead.
deprecate("TransformerTemporalModelOutput", "0.29", deprecation_message)
/usr/local/lib/python3.10/dist-packages/diffusers/models/transformer_temporal.py:29: FutureWarning: TransformerTemporalModel is deprecated and will be removed in version 0.29. Importing TransformerTemporalModel from diffusers.models.transformer_temporal is deprecated and this will be removed in a future version. Please use from diffusers.models.transformers.tranformer_temporal import TransformerTemporalModel, instead.
deprecate("TransformerTemporalModel", "0.29", deprecation_message)
/usr/local/lib/python3.10/dist-packages/diffusers/models/transformer_temporal.py:34: FutureWarning: TransformerTemporalModelOutput is deprecated and will be removed in version 0.29. Importing TransformerSpatioTemporalModel from diffusers.models.transformer_temporal is deprecated and this will be removed in a future version. Please use from diffusers.models.transformers.tranformer_temporal import TransformerSpatioTemporalModel, instead.
deprecate("TransformerTemporalModelOutput", "0.29", deprecation_message)
/usr/local/lib/python3.10/dist-packages/diffusers/models/transformer_2d.py:20: FutureWarning: Transformer2DModelOutput is deprecated and will be removed in version 0.29. Importing Transformer2DModelOutput from diffusers.models.transformer_2d is deprecated and this will be removed in a future version. Please use from diffusers.models.transformers.transformer_2d import Transformer2DModelOutput, instead.
deprecate("Transformer2DModelOutput", "0.29", deprecation_message)
/usr/local/lib/python3.10/dist-packages/diffusers/models/transformer_2d.py:25: FutureWarning: Transformer2DModel is deprecated and will be removed in version 0.29. Importing Transformer2DModel from diffusers.models.transformer_2d is deprecated and this will be removed in a future version. Please use from diffusers.models.transformers.transformer_2d import Transformer2DModel, instead.
deprecate("Transformer2DModel", "0.29", deprecation_message)
Loading pipeline components...: 0% 0/5 [00:00<?, ?it/s]2024-01-30 20:29:01.373400: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-01-30 20:29:01.405383: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-01-30 20:29:01.553697: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-01-30 20:29:04.513037: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
Loading pipeline components...: 100% 5/5 [00:08<00:00, 1.76s/it]
100% 25/25 [02:57<00:00, 7.11s/it]
Traceback (most recent call last):
File "/content/Text-To-Video-Finetuning/inference.py", line 232, in
export_to_video(video, f"{out_stem} {str(uuid4())[:8]}.mp4", fps)
File "/content/Text-To-Video-Finetuning/train.py", line 118, in export_to_video
img = cv2.cvtColor(video_frames[i], cv2.COLOR_RGB2BGR)
cv2.error: OpenCV(4.8.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:92: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'

Invalid number of channels in input image:
'VScn::contains(scn)'
where
'scn' is 40

STILL GETTING THIS ON EVERY NOTEBOOK