If you have a kitchen unit and an empty container, you can use the food crafting option to make clean water. It’ll make the water hot from cooking it, but it’ll be drinkable and also clean to prevent any food poisoning. If you have other ingredients on hand, you can alternatively make tea or juices.
If none of the above are options for you, during the day the temps normally get warm enough for it to turn liquid for a while at least. Drink your fill then and try to drink as much as you can again just as the sun sets, before it refreezes… That should at least get you through til it thaws again the next day.
