I don’t no why you can’t select and delete it, but I highly suspect that it is not a stray vertex, but part of the (hidden) chest.
Un-hide everything to see where it belongs to. Do not delete. As you can see in the UV Editor, it is connected to something.
