Hi everyone,
Thanks so much for all of the replies. I have been away so I only just had a chance to read through them. I have managed to narrow things down and it is a weird one. The burners have a little piezoelectric lighter that attaches to the burner via a little flame capture box. If you look at this image:
https://goo.gl/photos/kdmaELyMuJd2X34H6 (its not a very good picture) you can see that the air hole on the right is less open than the one on the left. I *think* that that is what is causing the problem but I haven't had time to test that theory yet. I can say that the issue happens when that box is attached to the underside of the burner, but does not happen when it not attached and I light the thing with a lighter.
I have spoke to CB about this and they have been helpful (although unsuccessful at diagnosing the problem) and they replaced both the regulator/hose assembly and then the burner assembly, and neither fixed the issue. I also tried the technique suggested by tomcrete1 to open up the regulator, and that didn't work. I borrowed a friend's gas bottle too and tried with that to see if some problem (like overfilling suggested by muebe), that didn't work, the problem persisted. I never for a moment thought it could be the little lighter system, but that seems to be what it is.
I will try to bend the little prong on the right so it is as open as the one on the left and see if that fixes it. CB is also sending me a whole new piezoelectic lighter and flame capture box, so hopefully that will also fix it.
I will report back here once it is fully functional to let you know how it went!
Thanks again everyone, lots of helpful advice :-)