From 9a840a9f550027ae9c8b63ada30180bf139c807c Mon Sep 17 00:00:00 2001 From: patchwork01 <110390516+patchwork01@users.noreply.github.com> Date: Mon, 3 Aug 2026 11:36:49 +0000 Subject: [PATCH 1/3] 7829 Changelog for 0.37.4 --- CHANGELOG.md | 33 +++++++++++++++++++++++++++++++-- 1 file changed, 31 insertions(+), 2 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index cb8aaf33930..4ff764a4e57 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -6,6 +6,35 @@ are available [here](docs/development/system-tests.md#performance-benchmarks). A available [here](docs/development/roadmap.md). +## Version 0.37.4 + +### 4th August 2026 + +This includes improvements to bulk import on EKS, and fixes to SQL query filtering, Athena and the Python client. + +Bulk import: +- Bulk import on EKS is now limited to a certain number of bulk import jobs running in EKS at once, with `sleeper.bulk.import.eks.job.concurrency.level`. +- Bulk import on EKS Auto Mode is now limited to a certain number of CPUs, with `sleeper.bulk.import.eks.automode.nodepool.cpu.limit`. +- EC2 instance types for bulk import on EKS Auto Mode can be configured with `sleeper.bulk.import.eks.automode.nodepool.instance.types`. + +Athena: +- Added support for map type fields. +- There are no longer multiple options for the Athena connector in `sleeper.athena.handler.classes`. + +Python: +- SQL filters can be set on queries run via Python. + +Documentation: +- Documented the REST API to add a Sleeper table. +- New configuration example for a lighter instance with less data. + +Bugfixes: +- SQL filtering is now accepted in queries with `scripts/utility/query.sh`. +- SQL query filtering now works for tables with a sort key. +- Fixed queries in Athena. +- Python client now reads region from `AWS_REGION` environment variable, and allows region to be set explicitly. + + ## Version 0.37.3 ### 29th July 2026 @@ -13,8 +42,8 @@ available [here](docs/development/roadmap.md). This release includes fixes to the alignment of build numbers caused by previously missed error in update script. General issues: - - Change Rust builder to use Trixie over Bookworm - - New VPC interface endpoints for ECR for environment deployment + - Change Rust builder to use Trixie over Bookworm. + - New VPC interface endpoints for ECR for environment deployment. ## Version 0.37.2 From c508766fc2b39d25e949aae77ab360c0ad148a16 Mon Sep 17 00:00:00 2001 From: patchwork01 <110390516+patchwork01@users.noreply.github.com> Date: Mon, 3 Aug 2026 11:37:50 +0000 Subject: [PATCH 2/3] 7829 Adjust spacing between versions --- CHANGELOG.md | 1 + 1 file changed, 1 insertion(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 4ff764a4e57..1c4f8f9d62f 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -45,6 +45,7 @@ General issues: - Change Rust builder to use Trixie over Bookworm. - New VPC interface endpoints for ECR for environment deployment. + ## Version 0.37.2 ### 27th July, 2026 From e0b42726cda1825afb29814eb243dba18f114ad1 Mon Sep 17 00:00:00 2001 From: patchwork01 <110390516+patchwork01@users.noreply.github.com> Date: Thu, 6 Aug 2026 12:56:49 +0000 Subject: [PATCH 3/3] 7829 Update changelog --- CHANGELOG.md | 19 +++++++++++++------ 1 file changed, 13 insertions(+), 6 deletions(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 1c4f8f9d62f..882d7ca7415 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -8,31 +8,38 @@ available [here](docs/development/roadmap.md). ## Version 0.37.4 -### 4th August 2026 +### 7th August 2026 This includes improvements to bulk import on EKS, and fixes to SQL query filtering, Athena and the Python client. Bulk import: +- Bulk import on EKS now uses the AWS EMR on EKS Docker image as a base. - Bulk import on EKS is now limited to a certain number of bulk import jobs running in EKS at once, with `sleeper.bulk.import.eks.job.concurrency.level`. -- Bulk import on EKS Auto Mode is now limited to a certain number of CPUs, with `sleeper.bulk.import.eks.automode.nodepool.cpu.limit`. -- EC2 instance types for bulk import on EKS Auto Mode can be configured with `sleeper.bulk.import.eks.automode.nodepool.instance.types`. +- Bulk import on EKS Auto Mode can now configure a node pool for EC2 instances to run in the cluster. This is currently experimental. + - Enable node pool configuration with `sleeper.bulk.import.eks.automode.nodepool.enabled`. + - Set the maximum number of CPUs with `sleeper.bulk.import.eks.automode.nodepool.cpu.limit`. + - Set EC2 instance types with `sleeper.bulk.import.eks.automode.nodepool.instance.types`. +- Bulk import job definitions are now retained in S3 for a period configured with `sleeper.bulk.import.job.file.retention.days`. Athena: - Added support for map type fields. -- There are no longer multiple options for the Athena connector in `sleeper.athena.handler.classes`. +- Added an Athena connector using the DataFusion data engine, see `sleeper.athena.handler.classes`. +- Removed the simple Athena connector as its purpose was unclear and there was no equivalent in the other query paths. Python: - SQL filters can be set on queries run via Python. Documentation: +- Documented SQL query filtering. - Documented the REST API to add a Sleeper table. -- New configuration example for a lighter instance with less data. +- New configuration example for a lighter instance with less data, at `example/light`. Bugfixes: -- SQL filtering is now accepted in queries with `scripts/utility/query.sh`. +- When you enter an SQL filter with `scripts/utility/query.sh`, the query no longer fails, and runs with a row retriever that supports SQL. - SQL query filtering now works for tables with a sort key. - Fixed queries in Athena. - Python client now reads region from `AWS_REGION` environment variable, and allows region to be set explicitly. +- Deleting a Sleeper instance will no longer fail due to writing query results to S3 during the tear down. ## Version 0.37.3