If you click the gear icon next to the title of your contact form it will take you to the Feature Instance Settings. There is a checkbox there "Enable SPAM Blocking", uncheck that and the captcha will go away.
The settings in Site Settigns just determine which captcha is used when captcha is enabled.
Hope it helps,
Joe