latency in the network

[jctonka]

I have configured my gear, latency is good,  while having a session with another user who has good latency on their set up we seem to have an overall connection latency , i can hear an echo for every note I play.  

Is there some other settings we need to make on our routers?