You cannot remove the currently selected folder. First, select your Darktable RAW Files folder (or home, or pictures).
See: Deleting a "place" - #3 by kofa