Fairly sure you can charge them with regular batteries as well; unless that’s changed in a previous update.
Just highlight the frame with the battery and hit f while having batteries in your inventory.
Alternatively, take a vehicle battery with charge and install it onto your vehicle. You can remove the old one to make room.