I chose to opt out after seeing that Telstra and other 3rd party IT businesses already had access.

Imagine my surprise when I tried to opt out and the screen said "You can't opt out as you already have created a record".

No, I hadn't. Apparently anyone living in North Queensland have already had their records created, so I had to go through MyGov to delete it.