Skip to content

Added core profiling module and used across data-package scripts#1672

Open
JBorrow wants to merge 2 commits into
masterfrom
data-package/refactor-profiling
Open

Added core profiling module and used across data-package scripts#1672
JBorrow wants to merge 2 commits into
masterfrom
data-package/refactor-profiling

Conversation

@JBorrow

@JBorrow JBorrow commented Jun 22, 2026

Copy link
Copy Markdown
Member

This PR adds a new profiling utility module inside the site_pipeline module that can allow for easy profiling of data packaging and pipeline scripts that use the main() signature. This works within Prefect. Documentation is included.

@mmccrackan

Copy link
Copy Markdown
Contributor

Do you think there is any utility in moving this to a lower level of sotodlib (like core/util.py maybe) so it can be used in other parts of the codebase? Seems like it might be useful to have that. I had started doing something like that in a much older PR when looking into preprocessing performance but didn't really intend on merging that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants