I am alos using Google as Mail Provider with a custom domain. I never had the problem getting through SPAM filters. I see two possible differences:
a) My SPF settings are different from yours: “v=spf1 include:_spf.google.com ~all”
b) You are using a still rare top level domain.
While b) is difficult to evaluate, a) should be easy.