stochdepth_rate in NFNets

[wang yilan]

thanks for this great job, and I have a question, the block_stochdepth_rate in nfnets is:
block_stochdepth_rate = stochdepth_rate * index / num_blocks
but the index is set to 0 in

deepmind-research/nfnets/nf_resnet.py

Line 64 in f5de0ed

 index = 0  # Overall block index 

So the block_stochdepth_rate is always 0, isn't it?
thanks!

[wang yilan]

I find the correct computational way, so close this issue
https://github.com/google-deepmind/deepmind-research/blob/f5de0ede8430809180254ee957abf36ed62579ef/nfnets/nf_resnet.py#L83C9-L83C19