I do not think it needs to be punished, unless of course it's an indoor public area where it's strictly prohibited, for obvious reasons. I don't think smoking should be banned either, because, what's next? And we should have the personal choice to consume a product.
It comes down to decency, and manners. Here in Ohio there are laws, can't smoke in front of a store -I hate having to go into Walmart, and in front they're puffing away. Can't handle the smell, it sticks with me for hours.
I have smoked for 22 years myself, I stopped about some 12 years ago. I detest the smell now. As a smoker I always considered people around me. If you have the slightest of self-awareness and manners, this would not be an issue. But I am fiercely against banning it. Personal choice, so long as you don't affect another person.