Daddy issues

Hi, my OH and I have an 11 week old little girl - first time parents. He has never had much time at home as he is self employed. Near enough every time he picks her up she starts crying. If she is already crying and he picks her up to comfort her it only seems to aggravate her and she cries hysterically! He is getting really upset thinking she doesn't like him and is not wanting to pick her up not to make her cry. I am also getting a little desperate as it is horrible to witness all the crying and very difficult to get her to calm down afterwards. Any ideas/suggestions on how to get her to love daddy's cuddles please?