Central Park Hoodie Swatches

I did a guage swatch! I did two actually. First I did one with a 5mm needles which is what the pattern called for but it gave me 16.5 x 24 instead of 17 x24. So I did it again with 4.5mm needles and I got 17 x 26. So neither one gives me guage but I think stitch guage is more important than row guage. Opinions? My reasoning is that it's easier to add an extra row to get the right length than it is to add extra stitches to the pattern. Right? Or maybe 16.5 is close enough to 17? I find that my 4.5 mm swatch is stiffer than my 5mm swatch. I would prefer a nicely draped sweater so perhaps I should go with the 5 mm needles and just make the smaller pattern. Silk tends to stretch when you wear it though doesn't it. This is the debate going on in my head. This has turned into a blog rather than a note so I think I will post it on my blog instead. I have to confess that I have never actually done a swatch before so I find myself in new territory.