Would most men consider this a sign of interest? And does he sound interested?

Okay, that first lunch was a date. Yes, I think he will interpret your message about going to lunch again as you being interested. Especially if you're not meeting him to talk about work.