Scalable Pre-Training of Large Autoregressive Image Models (Aim by Apple) (github.com)

"Interestingly, even at this scale, we observe no sign of saturation in performance, suggesting that AIM potentially represents a new frontier for training large-scale vision models."