The maximum jitter allowed by the IEEE specifications is 1.4 ns for 100-megabit Ethernet and 300 ps for Gigabit Ethernet. The bit time for a 48 kHz audio signal is ~20 000 ns. It is absolutely impossible that you can hear the Ethernet jitter.