It works for favourite games too, if you have 6 or less.
Does it stop working if you have more than six??
If you have enough friends on you friends list, it's also possible to click the 'view all' link, and then click the 'delete' next to his name. Sometimes there are glitches, though, and you may need to do it twice. Not hard, still.