Custom rules doesn't work with alert integration on 2022.4.1

While creating a custom rule and checking "Send a Log Rule Fired event to Orion Alerting" with "Create a new alert that fires whenever this rule triggers" it does create rule and alert definition but do not link to rule.

When accessing new alert definition form prompt I'm forwarded to page where informed that alert definition is no longer available. 

But this alert definition is created and stored in database table AlertConfigurations:

Any ideas how to fix this?