Have you ever seen a blacksmith? The arm they swing the hammer with is build like an oak tree. The arm they do the precise work is an order of magnitude smaller.
What is the point of lifting weights to work out the off arm? Just looks? A strong off arm isn't needed, so why do it?