@joeyh - yes, several DNS online checker didn't find any issues, everything was ok, but still Google refused to accept the mails.
Sometimes I had the impression that Google tries to resolve the maildomain, not the domain of the smarthost. However, this works fine when delivered via IPv4.
@ij so you also have correct IPV6 reverse DNS and get these bounces?