Like they now hand over all your contacts, your location, calendar entries, microphone access, camera access. If you choose to do so.

Nothing holds them from having designed this as an API that others can use where the user has permission toggles of what data they want to share with the LLM provider.