Currently you cannot access customer environments via CSP delegation using the Azure Management API (management.azure.com) the same way you can with Graph; the only option seems to be to add the integration for each tenant. I'm optimistic that this is possible because the ability exists to access customers' Azure environments via Partner Center and view subscriptions/resources/etc.