When set to "Create a new application and don't modify previously created applications" i have noticed that the Supersedence tab is not populated.
This means that as an example if i have made Docker 2.2.0.0 available to all users that as i roll out the newer Docker 2.2.0.3 to the test groups that all users will see both versions of Docker rather than the latest one which is targeted to them.
I believe it would make sense to do this automatically as it will improve the user experience in seeing only the latest application version which is available to them.