It sounds like there’s a general sense of insecurity pervading here. This can sometimes result from experiences in childhood, what your parents’ relationship was like and also your own experiences with earlier relationships. What’s good is that you’ve at least realised that this is a problem you’re facing.
Nobody enjoys being controlled and often, this would result in creating a stifling feeling that makes the other party want to break free. However, this is the exact opposite of what you want, thus reinforcing the fear and insecurity you already have. Take some time to determine the real issues; sort out where your problem lies. You may then want to be open about these issues with your partner once the relationship is more settled.
Keeping communication channels open is an important part in any relationship and helps to keep the over-controlling part of you at bay. It would also be helpful to put yourself in your partner’s shoes when an urge to become jealous or controlling strikes. Sometimes you may find that it’s not as easy to sort some of these problems out on your own and seeing a trained counsellor may be advisable in such a situation.