Are you using the NQNFS extensions?  This is known to cause
significant delays in some cases, waiting for a lease to time out.

Other than that, I'd suggest that perhaps your bridge is not
forwarding the packets.  You can analyze this with tcpdump.