Enhancement: Improve Generic Config Updater (GCU) performance

[bhouse-nexthop]

Is it platform specific

generic

Importance or Severity

Critical

Description of the enhancement

Generic Configuration Updater is woefully slow, so much so that it is basically unusable in a lot of situations.

Current Behavior

In a configuration I have, it takes about 15 minutes to apply.

See PRs for detailed information. This ticket was created to aid in visibility.

Proposed Behavior

It would be expected this to take no more than a minute or two.

Implementation

• sonic-yang-mgmt: Generic Config Updater - performance dependencies #22254
• Generic Configuration Updater (GCU) performance enhancements sonic-utilities#3831

Also a bug was discovered during the implementation that still needs to be addressed which would improve performance even further.

• Bug: Generic Config Updater - Race Condition #22255

[prgeor]

@qiluo-msft is review the PRs

[bhouse-nexthop]

I guess this autoclosed, but there is still sonic-net/sonic-utilities#3831 open

[johndexter1]

@bhouse-nexthop are you planning to backport this to 202405? This branch has the same issue

[bhouse-nexthop]

@bhouse-nexthop are you planning to backport this to 202405? This branch has the same issue

I haven't tried to see how much effort it would be to backport to 202405. Last I attempted it was a pretty clean cherry-pick back to 202411.