rwightman/pytorch-image-models: v0.1-attn-weights
- Ross Wightman
- Aman Arora
- Chris Ha
- Alexander Soare
- Mike
- contrastive
- Mohammed Rizin
- mrT23
- Csaba Kertész
- Dushyant Mehta
- Guillem Cucurull
- Kushajveer Singh
- Andrew Lavin
- Juntang Zhuang
- Matthijs Hollemans
- Sepehr Sameni
- Vyacheslav Shults
- Yusuke Uchida
- Zhun Zhong
- Comar
- Kim, Taehoon
- Alexey Chernov
- Greg Dongyoon Han
- Eli Uriegas
- Jasha10
- Marcin Kardas
- Michael Monashev
- Mike
- Minqin Chen
- Mohamed Rashad
Publication date
September 2021
DOIAbstract
A collection of weights I've trained comparing various types of SE-like (SE, ECA, GC, etc), self-attention (bottleneck, halo, lambda) blocks, and related non-attn baselines
Add to ORKG