To express the difficulty within a certain area of specificity, it is, in a word, nippy

It's cold today! It's so cold that I've been virtually forced to curl my fingers around a cup of hot coffee! I've retreated to the bed, turned the heater on, and wrapped the dressing gown around me. It's still cold! I've even (shudder) gone so far as doing the washing in an attempt to keep my fingers warm - and there was hardly  any washing to do!

If things get any worse I might have to consider retreating to bed while reading Dante's inferno and cooking hot cross buns while doing even more of the non-existent washing up in a bath full of chilli peppers.