under gtk3 with the floating window of the listbox inside
the color floating window if the toplevel window is dismissed
the focus doesn't remain locked to its parent, but skips to
the grandparent

so grab and ungrab only once elements in the hierarchy

Change-Id: I14b1b8888671634c0c01c6416493f912e4abd2f9