Is it possible to add security to restrict access to a URL or port on the Load Balancer?

Yes, you can restrict the use of a TCP port or HTTP URL via ACLS. Find more information here.