We perform a joint Bayesian inference of neutron-star mass and radius constraints based on GW170817, observations of quiescent low-mass x-ray binaries (QLMXBs), photospheric radius expansion x-ray bursting sources, and x-ray timing observations of $\mathrm{J}0030+0451$. With this dataset, the form of the prior distribution still has an impact on the posterior mass-radius curves and equation of state (EOS), but this impact is smaller than recently obtained when considering QLMXBs alone. We analyze the consistency of the electromagnetic data by including an ``intrinsic scattering'' contribution to the uncertainties, and find only a slight broadening of the posteriors. This suggests that the gravitational-wave and electromagnetic observations of neutron-star structure are providing a consistent picture of the neutron-star mass-radius curve and the EOS.