Transformer Model with Knowledge Distillation

Motor imagery research has a long history, and most of it points at the hands. You imagine gripping something, a classifier tries to figure out which hand you meant, and there are entire competition datasets built around exactly that setup.…