You have nothing to lose, so I'd just level with him. I wouldn't have any hopes of trying to change the situation though, and I'd not entertain attempts to get you to go back. Small social clubs are like dating, you have to try a lot of them to find one that really works for you. Then when they stop