Am I being unreasonable?
Yes... .
With the information presented... .I think this is way too soon. There are lots of aspects of your relationship to work through.

I'm glad you have found us, because we can help you work through those issues. We won't make a choice for you, but can help you examine the different perspectives.
Can you describe what it looks and sounds like when you try to fill the emotional void? Lots of details there can help us point you in the right direction.
Agreeing to go to therapy is a big step. I would recommend you leave this alone for a while. Let your wife sort our her issues... .you can sort out yours.
FF