To explore (verb) is to investigate or travel to a new area in order to discover things. Exploration is neutral:
To exploit (verb) is to take advantage of something, usually in a selfish or unethical way. Exploitation is bad:
To complicate matters, the word exploit can also be a noun – referring to significant actions or achievements. This word is neutral.