Jason Patric talks about the access issues he faces as an unmarried father to his young son