We use observations of ultrafaint dwarf (UFD) galaxies to constrain the particle mass of ultralight dark matter. Potential fluctuations created by wave interference in virialized ``fuzzy'' dark matter (FDM) halos dynamically heat stellar orbits in UFDs, some of which exhibit velocity dispersions of $\ensuremath{\lesssim}3\text{ }\text{ }\mathrm{km}/\mathrm{s}$ and sizes $\ensuremath{\lesssim}40\text{ }\text{ }\mathrm{pc}$. Using simulations of FDM halos, and existing measurements of sizes and stellar radial velocities in Segue 1 and Segue 2 UFDs, we derive a lower limit on the dark matter particle mass of ${m}_{\mathrm{FDM}}>3\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}19}\text{ }\text{ }\mathrm{eV}$ at 99% confidence, marginalized over host halo circular velocity. This constraint is conservative as it is derived under the assumption that soliton heating is negligible, and that no other sources of non-FDM dynamical heating of stars operate to increase velocity dispersion. It can potentially be strengthened by future spectroscopic observations of additional stars in ultrafaint galaxies and by tightening theoretical constraints on the soliton size-halo mass relation. However, even the current conservative lower limit on the ultralight dark matter mass makes it indistinguishable from cold dark matter at the scales probed by existing astronomical observations.