For me, I will never import my images into the Catalog, because I have my own directory setup I like. When I import images, the choice is always import at the current location. This is my annoyance I am seeing: the creation of the "Originals" folder. When I delete it, it comes back the next time I open the catalog. Is that normal and proper software protocol?
There is no need to delete the Originals folder and serves no benefit to do so. It is there as it is possible to move images to be stored inside the catalog and back out again. This is beneficial (if you like myself) you often travel and wish to take some raw files 'on the road' with you.