nnstreamer / nntrainer

NNtrainer is Software Framework for Training Neural Network Models on Devices.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[blas/neon] Support various data types for `scopy`

djeong20 opened this issue · comments

Currently, scopy is limited to copying certain data types (float, fp16). Since the tensor data type has been extended to int4 and int8, scopy should also support these data types (e.g., scopy from int4 to fp32 and int8 to fp16.

Additionally, scopy from int4 to fp16 has been newly implemented and is currently being used. It takes uint8_t as a parameter and parses it into two int4 values. However, the problem is that the current scopy not only takes int4 but also takes int8 as an input. In other words, it cannot differentiate whether the data is int4 or int8 by a function argument since both use uint8_t.

Therefore, there need to be additional scopy functions that support copying int4 and int8 to fp16 and fp32, and the current scopy of int4 to fp16 should be revised.

:octocat: cibot: Thank you for posting issue #2332. The person in charge will reply soon.

Please review #2345 for this issue.

#2345 is merged. I think we can close this issue.
@djeong20

Resolved in #2345 and #2357.