RC7611 Performance Issue

have you tried with USB interface to isolate uart issue?
Have you tried with FTP client download to see if problem only exists in TCP server?
You can also establish data channel for a PC through USB port and see if problem exists in TCP server setup in PC.