Main-sequence, fully convective M dwarfs in eclipsing binaries are observed to be larger than stellar evolutionary models predict by as much as 10%–15%. A proposed explanation for this discrepancy involves effects from strong magnetic fields, induced by rapid rotation via the dynamo process. Although, a handful of single, slowly rotating M dwarfs with radius measurements from interferometry also appear to be larger than models predict, suggesting that rotation or binarity specifically may not be the sole cause of the discrepancy. We test whether single, rapidly rotating, fully convective stars are also larger than expected by measuring their Rsini distribution. We combine photometric rotation periods from the literature with rotational broadening (vsini) measurements reported in this work for a sample of 88 rapidly rotating M dwarf stars. Using a Bayesian framework, we find that stellar evolutionary models underestimate the radii by 10 \% \mbox{--}15{ \% }_{-2.5}^{+3}, but that at higher masses (0.18 < M < 0.4 M Sun), the discrepancy is only about 6% and comparable to results from interferometry and eclipsing binaries. At the lowest masses (0.08 < M < 0.18 M Sun), we find that the discrepancy between observations and theory is 13%–18%, and we argue that the discrepancy is unlikely to be due to effects from age. Furthermore, we find no statistically significant radius discrepancy between our sample and the handful of M dwarfs with interferometric radii. We conclude that neither rotation nor binarity are responsible for the inflated radii of fully convective M dwarfs, and that all fully convective M dwarfs are larger than models predict.The authors would like to thank the referee for the thoughtful report, which greatly improved the manuscript. The authors would also like to thank Lisa Prato and Larissa Nofi for IGRINS training, and Heidi Larson, Jason Sanborn, and Andrew Hayslip for operating the DCT during our observations. We would also like to thank Jen Winters, Jonathan Irwin, Paul Dalba, Mark Veyette, Eunkyu Han, and Andrew Vanderburg for useful discussions and helpful comments on this work. Some of this work was supported by the NASA Exoplanet Research Program (XRP) under grant No. NNX15AG08G issued through the Science Mission Directorate.These results made use of the Lowell Observatory's Discovery Channel Telescope, supported by Discovery Communications, Inc., Boston University, the University of Maryland, the University of Toledo and Northern Arizona University; the Immersion Grating Infrared Spectrograph (IGRINS) that was developed under a collaboration between the University of Texas at Austin and the Korea Astronomy and Space Science Institute (KASI) with the financial support of the US National Science Foundation under grant AST-1229522, of the University of Texas at Austin, and of the Korean GMT Project of KASI; data taken at The McDonald Observatory of The University of Texas at Austin; and data products from the Two Micron All Sky Survey, which is a joint project of the University of Massachusetts and the Infrared Processing and Analysis Center/California Institute of Technology, funded by NASA and the NSF. (NNX15AG08G - NASA Exoplanet Research Program (XRP); Discovery Communications, Inc.; Boston University; University of Maryland; University of Toledo; Northern Arizona University; AST-1229522 - US National Science Foundation; University of Texas at Austin; Korean GMT Project of KASI; NASA; NSF