Polycom VVX450 - Call transfer via Conference feature causes 3-second delay

When using the conference feature, there's a 3-second delay when speaking, regardless of the number of participants. How can we fix this? This issue doesn't occur with simple transfers but always happens during conferencing, causing people to talk over each other.