That doesn't sound good...but rather than snooping into his personal business, let him know that it bothers you and what it makes you think when he acts so secretive.
If he doesn't give you a satisfactory response, then dump him because he can't be trusted. I think you two need to have a face to face conversation about the phone problem.