Hi Andrew,
Existing pages will have the .aspx extension until you manually change each page. When you change a page's url, an entry will be added to the 301 Redirect table which will allow old links to work.
New pages will not have extension.
HTH,
Joe D.