A trend that appears in several groups of data reverses when the groups are combined.
Treatment A beats B in Group 1 AND Group 2. But combined, B appears better! The trick: Treatment A is disproportionately given to the easy group, inflating its combined rate relative to B which tackles the hard group.
Real example: UC Berkeley 1973 admissions seemed to favor men overall, but department-by-department, women were admitted at equal or higher rates.