Skip to content

Added Glue Catalog sync demo for Iceberg tables#266

Merged
kesarwam merged 2 commits into
mainfrom
iceberg-glue-sync-demo-v1.0
Dec 8, 2025
Merged

Added Glue Catalog sync demo for Iceberg tables#266
kesarwam merged 2 commits into
mainfrom
iceberg-glue-sync-demo-v1.0

Conversation

@kesarwam

@kesarwam kesarwam commented Dec 2, 2025

Copy link
Copy Markdown
Contributor

No description provided.

@kesarwam kesarwam requested a review from iddoavn December 2, 2025 21:50

@iddoavn iddoavn left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We said we might want to change 2 things:

  1. glue_database = "lakefs_demo_iceberg_glue_sync" - enough to put it once and use the same vairable.
  2. Define the access ket / access and region as parameters. catalog = RestCatalog(
    name = "my_catalog",
    **{
    'prefix': 'lakefs',
    'uri': f'{lakefsEndPoint}/iceberg/api',
    'oauth2-server-uri': f'{lakefsEndPoint}/iceberg/api/v1/oauth/tokens',
    'credential': f'{lakefsAccessKey}:{lakefsSecretKey}',
    's3.access-key-id': 'XXX',
    's3.secret-access-key': 'XXX',
    's3.region': 'us-east-1'
    })

@kesarwam kesarwam merged commit 8a1c9e8 into main Dec 8, 2025
1 check failed
@kesarwam kesarwam deleted the iceberg-glue-sync-demo-v1.0 branch December 8, 2025 19:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants