使用PaddleVideo训练stgcn模型问题:
【paddle版本为develop版本】
报错信息如下:
[08/31 21:47:28] model_name : STGCN
W0831 21:47:29.443328 4185452 gpu_resources.cc:119] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.6, Runtime API Version: 11.6
W0831 21:47:29.455291 4185452 gpu_resources.cc:149] device: 0, cuDNN Version: 8.6.
[08/31 21:47:29] Loading data, it will take some moment...
[08/31 21:47:29] Data Loaded!
[08/31 21:47:29] Loading data, it will take some moment...
[08/31 21:47:30] Data Loaded!
[08/31 21:47:30] Training in fp32 mode.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 10. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 11. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 21. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 23. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 22. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 26. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 13. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Error: ../paddle/phi/kernels/gpu/cross_entropy_kernel.cu:1010 Assertion false failed. The value of label expected >= 0 and < 10, or == -100, but got 19. Please check label value.
Traceback (most recent call last):
File "main.py", line 143, in
main()
File "main.py", line 139, in main
profiler_options=args.profiler_options)
File "PaddleVideo/paddlevideo/tasks/train.py", line 237, in train_model
outputs = model(data, mode='train')
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/nn/layer/layers.py", line 1240, in call
return self.forward(*inputs, **kwargs)
File "PaddleVideo/paddlevideo/modeling/framework/recognizers/base.py", line 49, in forward
return self.train_step(data_batch)
File "PaddleVideo/paddlevideo/modeling/framework/recognizers/recognizer_gcn.py", line 54, in train_step
loss_metrics = self.head.loss(cls_score, label, if_top5=self.if_top5)
File "/media/dp504/36675aac-be99-45b0-abf0-9c74c037c1b7/PycharmProjects/swf/PaddleVideo/paddlevideo/modeling/heads/base.py", line 85, in loss
loss = self.loss_func(scores, labels, **kwargs)
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/nn/layer/layers.py", line 1240, in call
return self.forward(*inputs, **kwargs)
File "PaddleVideo/paddlevideo/modeling/losses/base.py", line 49, in forward
return self._forward(*args, **kwargs) * self.loss_weight
File "PaddleVideo/paddlevideo/modeling/losses/cross_entropy_loss.py", line 35, in _forward
loss = F.cross_entropy(score, labels, **kwargs)
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/nn/functional/loss.py", line 2788, in cross_entropy
if paddle.count_nonzero(is_ignore) > 0: # ignore label
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/dygraph/tensor_patch_methods.py", line 681, in bool
return self.nonzero()
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/dygraph/tensor_patch_methods.py", line 678, in nonzero
return bool(np.array(self) > 0)
File "/home/dp504/miniconda3/envs/paddle/lib/python3.7/site-packages/paddle/fluid/dygraph/tensor_patch_methods.py", line 704, in array
array = self.numpy(False)
OSError: (External) CUDA error(719), unspecified launch failure.
[Hint: 'cudaErrorLaunchFailure'. An exception occurred on the device while executing a kernel. Common causes include dereferencing an invalid device pointerand accessing out of bounds shared memory. Less common cases can be system specific - more information about these cases canbe found in the system specific user guide. This leaves the process in an inconsistent state and any further CUDA work willreturn the same error. To continue using CUDA, the process must be terminated and relaunched.] (at ../paddle/phi/backends/gpu/cuda/cuda_info.cc:272)
[1]+ Killed python
【以下回答由 GPT 生成】
这个报错是由于标签值超出了范围所引起的。根据报错信息,标签的值应该在0到9之间,或者等于-100,但是实际得到的值是22。造成这个问题的原因可能是数据预处理环节出现了错误,或者训练过程中的某些参数设置不正确。
解决方法如下:
检查数据预处理过程:查看数据预处理的代码,确保标签值处理的逻辑正确,标签值没有超出范围。
检查标签数据:检查输入数据中的标签值,确保标签值在0到9之间,或者等于-100。
检查训练参数设置:检查训练过程中的参数设置,确保没有设置错误的标签值相关的参数。可以根据报错信息,查找相关的标签设置的代码,并检查是否有错误。
检查模型配置:检查模型配置文件,确保模型的标签输出层设置正确。
如果以上方法都没有解决问题,可能需要深入分析代码,查找更具体的错误原因。
你把报错复制到记事本发过来