Need to allow ports to be open for some servers, but they still aren't showing as being open

We have made a firewall rule for some Sharepoint servers that need certain ports open. I can see the new policy is being pushed down the clients but when we test the servers to see if the port is open they are showing up as being closed. Is there anything that we are missing? Endpoint Manager and Client versions are 12.1.1101.401. 

Any help is greatly appreaciated.