I am married with kids and have a wife that understands that my love of U2 is part of the package. I can't say that she "hates" U2, but she definetly not a fan beyond the slight casual level.
Does every big holiday involve U2? Do you break from holidays when U2 break and then holiday when the band tour? If you say that you only go to Europe with the wife when U2 tours Europe, then I'd say that she has a legitimate complaint. Once to a few times, maybe a holiday with combined U2 tour can be special and she has obviously compromised to now to accept it to a point. The arguement being made here is that you can only make time for her if it involves U2 and you can can only make an effort to plan a holiday with her if it involves U2.
I am making a big assumption here that your wife and you have only been to certain places because U2 were there. I apologise if I am way off here.
The problem might not be the fact that you love this band. It might be that she sees you only seem to make a serious effort to experience the globe with your wife and U2. Have you done a lot of travelling with the wife that didn't involve U2?
If your wife says that she "hates" U2 and, yet, attends more U2 concerts than most U2 fans, then she has definetly done her duty to be supportive of your U2 love. Could you see yourself travelling the globe following your wife's interest and that interest being something you couldn't really care about?
I don't know you at all and I don't want you to think that I'm siding with your wife. I'm just throwing this stuff out there.
All the best to you. And do work it out.