Giters

Rishit-dagli / Transformer-in-Transformer

An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches

Home Page:https://pypi.org/project/tnt-tensorflow

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Create a FeedForward layer

Rishit-dagli opened this issue · comments

commented

Verify shapes:

import tensorflow as tf
FeedForward(dim=512)(tf.random.normal((32, 512)))

# shape=(32, 512)