Without them you can’t have Polluxes.
Sorry. More seriously, I wanna say that castors probably aren’t as strong as normal wheels, so I KINDA wanna say that they won’t support as much weight from the vehicle. That said, that may not be something that’s actually implemented, but if it isn’t, I imagine it will be eventually.