Diversity Is Not Diverse Enough