This is a difficult situation for sure! I bought an unrestored '57 Chevrolet that still had original paint, but needed an interior. So the original plan was to keep that unmolested exterior appearance, but just redo the interior, make it mechanically sound, and drive it. Well, 3 years later, I'd done a complete rotisserie restoration every nut, bolt, wire, and piece of rubber! It's hard to draw the line because, as you say, the fresh areas will make the unrestored areas look worse, potentially.