I don't think you should anybody, especially an utter rotter, to prevent you from attending conferences if you enjoy them.