The conversion makes them part of the regular bones, so they can’t be switched off that way. However, they will still have a unique material zone so you can turn their opacity down to zero in the Surfaces pane (Window>Panes(Tabs)>Surfaces, Tools>Surface selection tool, click on the handles, in the Edit tab of Surfaces find Opacity and set it to 0).