Yes, you put the full url and it knows which site it is by the host name, you can test the url in the browser and verify it only has the correct urls for the site.
http://yoursiteroot/SiteMap.ashx
view the source of the rendered page to see the xml.
Hope it helps,
Joe