I have users who can only edit a single area of the site, they are in the Turn Admins On group and have ownership of their own pages.

By default, navigation is editable by group Turn Admin On. I have changed this to just Admins because I don't want everyone editing the navigation. 

However, these users still see Edit buttons against every navigation object, unlike every other asset. Pressing this button shows a Permission Denied screen.