How do I tell my partner I won't wear the jumper he made me?

My partner held up a bright orange jumper and said, "I finally finished it." He'd taught himself to knit and spent evenings working on it. I hugged him, put it on and said it was lovely. I meant the effort. I didn't mean that I wanted to wear that colour outside the flat.

Two weeks later, he asked why I hadn't worn it to meet our friends. I said I was saving it. Now he has sent me a pattern for another one and asked which colour I want.

I usually dress in plain dark colours. He knows that, but orange is his favourite, and I think he pictured me looking cheerful in it. I don't want to treat his first knitted gift like a failed order. I also don't want to keep inventing occasions that never seem suitable.

Do I explain my taste now and risk making the original thank-you sound false? Or is wearing it occasionally a small thing to do for someone who made me something with such care?