This feature is disabled by default.
Are you sure your site is configured for 2.0 ASP.NET not 1.1?
In any case its safe to delete any siteoffice dlls from the /bin folder, its safe to delete the siteoffice folder, and its safe to delete the /Services/PopToJson.ashx file.
Hope it helps,
Joe