If you are the admin of a group or your group is a public group then you can simply send invites to the members.
But if you want to invite users from the admin panel then follow some steps:
go to WordPress dashboard >> select groups >> then choose group name you want to add members in >> now go down to Add New Members
Simply search the name of the new member and add it to the group.