Does a non custodial parent have to have a court order for visitation rights?

[shay]

If there is no court order - both parents have equal rights - which means the non custodial parent also withholds the "right" to keep the child away. Neither parent can force the other to return the child without a court order.
However - Keeping a parent away from a child without a good and substantial reason, will be unfavorable for the parent keeping the distance.

So if the father signed a paternity affidavit and the birth certificate - which obviously he did, or he wouldnt be paying child support - unless there is abuse or neglect, or the father is mentally unstable, in jail, or using drugs, then he is entitled to see the child and keeping them apart could cause you problems should he take it to court.

If you and him are having problems, and not getting along - thats not a good reason.