We present the first systematic study of the filling constraints to realize a
`trivial' insulator symmetric under magnetic space group M. The
filling ν must be an integer multiple of mM to avoid
spontaneous symmetry breaking or fractionalization in gapped phases. We improve
the value of mM in the literature and prove the tightness of the
constraint for the majority of magnetic space groups. The result may shed light
on the material search of exotic magnets with fractionalization.Comment: 5 page, 2 figure; the version to appear in PRB (Editors' Suggestion