If you crank it all the way the power steering pump will make a light humming noise that you can feel in the steering column, but that's perfectly normal on every car and doesn't sound like what you're experiencing. So it doesn't make this noise at all if it's say, 60 deg outside? Has it repeated itself throughout seasons, or did it start this winter? Just trying to make sure you don't draw a causal relationship between cold and the noise prematurely.
E88 N54 Alpinweiss/Coral Red/Motiv HTA 3586r Tial .82AR/Motiv Port Fuel/Meisterschaft Race/Berk Resonated/ER CP/Synapse/VRSF FMIC/Rob Beck PCV Valve + Cap/ST Coilovers/M3 FCA + Tension Rods/M3 Subframe Bushings/M3 FSB/AA Strutbrace/DINAN Camber Plates/Apex ARC-8/Project Kics/VAC Hubs/Rogue Transmission Mounts/Alpina TCU Flash/Icarbon/Kerscher/BMW Performance