Add sequential test method execution and support for HZ_LICENSEKEY env variable [CTT-1276]#2336
Merged
Merged
Conversation
gareth-johnston
approved these changes
Jul 20, 2026
celenmelike
approved these changes
Jul 20, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds sequential, round-robin test operations execution (see readme) and support for
HZ_LICENSEKEYenvironment variable inperftest runIn some cases difference between sequential and random execution can be meaningful. For example
IMap.deleteis cheaper when the entry does not exist. This was demonstrated in the below example benchmark usingdeleteNewCurrentandsetCurrentmethods. The only difference between runs wassequentialsetting. The absolute numbers do not matter (the environment was quite weak 2 members) but the difference in latency (especially lower percentiles) and throughput is clearly visible.