A GIS Data layer can be deleted by right-clicking on the layer folder in the Project Explorer and selecting the Delete command.
Related Topics: Add Data Add Shapefile Data Project Explorer Window