I think if you are giving him a ring, then you should probably have him put your ring back on you in the ceremony. It will look nice, and it's such an integral part of wedding tradition that if you skip part of it; your ceremony may feel like it's 'missing a piece'.
If you are not going to give him a ring, then you might want to omit the ring part of the ceremony, and instead have a unity candle or blending of sand or some other tradition that binds you together.