Skip to content

Add docker image to use hermetic llvm and sysroot#782

Open
hsharsha wants to merge 5 commits into
amd-mainfrom
hhs/add_docker_for_jax_xla
Open

Add docker image to use hermetic llvm and sysroot#782
hsharsha wants to merge 5 commits into
amd-mainfrom
hhs/add_docker_for_jax_xla

Conversation

@hsharsha
Copy link
Copy Markdown

Add docker image to build and test JAX and XLA using hermetic llvm and sysroot based on ub22 image used for ml-build images

@hsharsha
Copy link
Copy Markdown
Author

@mminutoli should we keep docker files here now that rocm-jax would be depricated. Or do we still want to keep all the infra related files there?

Comment thread .github/workflows/build_docker.yml Outdated
Comment on lines +56 to +57
run: |
working-directory: ./build/rocm/docker/
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably a typo, it needs to be its own line. As it is now, the script will fail

Comment thread build/rocm/docker/setup.rocm.sh Outdated
# - jammy
# - el7
# - el8
set -x
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
set -x
set -euo pipefail
set -x

Comment thread .github/workflows/build_docker.yml Outdated

jobs:
build-docker:
runs-on: ${{ fromJSON(inputs.runner-label) }}
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
runs-on: ${{ fromJSON(inputs.runner-label) }}
runs-on: ${{ inputs.runner-label }}

Comment thread .github/workflows/build_docker.yml Outdated
required: false
default: 'plugin_wheels'
type: string
extra-cr-tag:
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Defined, but never used

Comment thread .github/workflows/build_docker.yml Outdated
df -h
rocm-smi -a || true
rocminfo | grep gfx || true
- uses: actions/checkout@v4
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should be using v6+ on actions/checkou or pinned hashes

Comment thread .github/workflows/build_docker.yml Outdated
rocminfo | grep gfx || true
- uses: actions/checkout@v4
- name: Download wheel artifacts
uses: actions/download-artifact@v4
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same. Needs a relevant version and pinned hash

Comment thread build/rocm/docker/setup.rocm.sh Outdated
ROCM_DEB_REPO=${ROCM_DEB_REPO_HOME}${ROCM_VERS}/
AMDGPU_DEB_REPO=${AMDGPU_DEB_REPO_HOME}${AMDGPU_REPO_VERS}/

DEBIAN_FRONTEND=noninteractive apt-get --allow-unauthenticated update
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

git diff --check says there's a trailing whitspace

@i-chaochen
Copy link
Copy Markdown

do we need to put this to jax upstream? not sure what's sync policy in rocm/jax?

@hsharsha hsharsha changed the title Hhs/add docker for jax xla Add docker image to use hermetic llvm and sysroot Jun 1, 2026
@mminutoli
Copy link
Copy Markdown

mminutoli commented Jun 1, 2026

We keep our infra in another repository. So maybe we should close this PR and open one there.

Nevertheless, the right approach seems to have hermetic root in the build, right @alekstheod ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants