Is there something wrong with innocent flirting with someone who is married?

No. If there are boundaries, there are boundaries.. Just because two people of the opposite sex like being with each other, doesn't mean they are going to have sex/makeout/kiss, etc..