RATS! Patches Talk Through Registers: Emergent Parts in Register Attention Transformers
Introducing RATS (Register Attention Transformers), which self-supervisedly discovers part-level structures with N learnable registers, achieving +12 mIoU on five segmentation benchmarks.
Timing Yang, Predrag Neskovic, Jansen Seheult et al.