Then all of a sudden he reappeared yesterday, asking me for a bunch of favors - since he's an expat here and he can't speak the language I've been helping with him a lot of stuff, this time it was his banking problem - and an advice for he and his new bf's date. But he seemed much less affectionate albeit not being standoffish. Then he asked me out for lunch and I accepted it.
To me, this seems like a triangulation and your role is the helper. Are you really the only person in your ex's circle who can speak the language of the country you live in and reasonably help? (I'm not against helping an immigrant, I lived as an immigrant myself but this is something that gets exploited a lot in relationships. Your ex is a mature and capable adult who made all the way from one country to a developed country which has many voluntary organizations as well. What would he do if he didn't have you? I think you should help only if you want to help (ethical reasons, political reasons, who you are as a person etc) but not because they don't have anyone except you (moral, personal obligation). He probably has a lot of friends from his culture that speak your language. I don't want to appear cruel here or anything, I was an immigrant. Again of course, my opinions bind me and you don't have to agree or anything.)
Personally, I think any relationship where I'm thinking about how I should act, what message it would give to others is not a comfortable relationship. I would find it stressful and think that I'm not ready, yet. Some time in the future maybe. I'd say, sorry, busy that day and wouldn't feel obliged to make any more personal explanations.
If you go, I hope it goes well for you.