Safari's Private Relay Sidesteps Little Snitch (vandersecurity.com)

It's also worth noting that this isn't the first time something like this has happened. A few OS versions ago they whitelisted some first-party apps despite firewall rules blocking them.