Your tankless water heater will feel cold to the touch when the heater unit and pumps are in the rest state and not heating water. There’s nothing to worry about. As long as everything is working properly (e.g. you have hot water on demand), there is no cause for concern.