That feature installed a file in the folder /Setup/ProviderConfig/indexbuilders
that file plugs it into the search index and removing that file will unplug it and stop the error that happens whenever indexing is done.
I don't know the name of the file but hopefully it is named according to the feature name
Hope that helps,
Joe