If you’re just renaming the server groups or app segments, then these are just labels (descriptions). There would be no impact to policy/access.
If you’re creating new server groups and then “swapping” existing server group to app segment group, then that is different - but provided the server group contains the same app connector groups, it should also have zero impact (but path selection would also need to restart and add minor latency).