腾版改GPU训练出现loss为inf和nan.只改了device_target=GPU。这两个警告是什么原因呀?[mindspore/ccsrc/backend/kernel_compiler/gpu/gpu_kernel_factory.cc:94] ReducePrecision] Kernel [StandardNormal] does not support int64, cast input 0 to int32.和
[mindspore/ccsrc/backend/optimizer/gpu/reduce_precision_fusion.cc:75] Run] Reduce precision for [StandardNormal] input 0

Model is created.
[WARNING] KERNEL(10779,7f42e20ab740,python):2021-11-23-15:53:51.578.912 [mindspore/ccsrc/backend/kernel_compiler/gpu/gpu_kernel_factory.cc:94] ReducePrecision] Kernel [StandardNormal] does not support int64, cast input 0 to int32.
[WARNING] PRE_ACT(10779,7f42e20ab740,python):2021-11-23-15:53:51.579.223 [mindspore/ccsrc/backend/optimizer/gpu/reduce_precision_fusion.cc:75] Run] Reduce precision for [StandardNormal] input 0
epoch: 1 step: 1, loss is inf
[WARNING] KERNEL(10779,7f42e20ab740,python):2021-11-23-15:54:01.999.772 [mindspore/ccsrc/backend/kernel_compiler/gpu/gpu_kernel_factory.cc:94] ReducePrecision] Kernel [StandardNormal] does not support int64, cast input 0 to int32.
[WARNING] PRE_ACT(10779,7f42e20ab740,python):2021-11-23-15:54:01.999.912 [mindspore/ccsrc/backend/optimizer/gpu/reduce_precision_fusion.cc:75] Run] Reduce precision for [StandardNormal] input 0
epoch: 1 step: 2, loss is inf
epoch: 1 step: 3, loss is inf
epoch: 1 step: 4, loss is inf
epoch: 1 step: 5, loss is inf

解答:

warning提示是使用StandardNormal时输入的张量不支持int64。API的说明是只允许常量值

 

Logo

昇腾计算产业是基于昇腾系列(HUAWEI Ascend)处理器和基础软件构建的全栈 AI计算基础设施、行业应用及服务,包括昇腾系列处理器、系列硬件、CANN、AI计算框架、应用使能、开发工具链、管理运维工具、行业应用及服务等全产业链

更多推荐