No you don't have do manually convert your strings in utf8. PyGTK will do this for you.

    label.set_text(u'abc')

So the above is indeed valid and not only to labels but to any widget.