Many dads don't bond right away with a newbie, especially if mom is bfing and there is N older child. However, it sounds like you see yourself as the primary comfort for the baby, which helps push dad away.
I agree with the pp that if dad is able to take care of the older daughter, then he should also get to take care of the baby, which he WANTS to do. Frankly, I'd be really angry in his shoes.
Many things to many people.