Well, I'm going to make en effort to pat Elf first as well. I'll also be taking their food bowls away after 20min, so that there's no "grazing" happening, which is when the problem of Smudge taking Elf's food occurs.

Hopefully these two measures will soon fix the problem!