Are demographically invariant models and representations in medical imaging fair?