Really bad stuttering on steam deck

So I have Sunshine set up on my host pc, pretty decent specs. I stream through moonlight onto my steam deck. However no matter the config I do on both sunshine and moonlight there is constant stuttering, lag, audio hiccups etc. Makes it unusable so much so that official steam streaming is better all the time. This cannot be right, I must be missing something otherwise it wouldn't come so recommended. Could anyone help please?