I have answered my own question based on some other posts…
Essentially FCM runs with application priority. i.e. events will only fire when the application has a chance to fire them and therefore not real time as with interrupts (access the UART directly for this).
I was hogging the relevant context for something else and have since freed up the processor allowing much faster response.
Thanks,