When trying to test validations shoulda kept throwing me
Expected block to return true value even though the validations were present in the model. Turns out that I was missing a locale translation. After adding the missing translation the tests ran fine.
Hopefully this might save someone a few hours.