If you're really into him I'd maybe have one more discussion about it (especially if he got better after the first one and then slid back into old habits), but tbh it sounds like he is just not comfortable with or used to the level of affection you need and imo that probably won't really get better over time.