This article to create mail-enabled Azure AD security group using PowerShell:
A mail-enabled security group can be used to distribute messages as well as to grant access permissions to Azure AD and SharePoint resources. Since this group is being used for dual purposes, the Security part is controlled by Azure AD, and the Message distribution part is controlled by Exchange Online