Yes, but the point is nobody is assuming they are perfect. Rather, the possibility is that either General Relativity is wrong or there is Dark (i.e. non-photon emitting) Matter. When this was investigated via observation (i.e. not assuming, but checking), the observational evidence seems to...