3.0.59

What's Changed

• Guard workflow_settings.yaml and dataform.json require with existence check by @rafal-hawrylak in #2178
• Refactor CompileChildProcess to use BaseWorker by @rafal-hawrylak in #2179
• Rename worker timeout error to "Compilation timed out" by @rafal-hawrylak in #2186
• Extract task creation into executionSql helpers by @rafal-hawrylak in #2180
• Add JiT compilation support for assertion actions by @rafal-hawrylak in #2193
• Fix caller-file error (#2177) and enforce Core/CLI version match by @rafal-hawrylak in #2191
• Raise default compile timeout to 60s and improve timeout error message by @rafal-hawrylak in #2192
• Bump DF_VERSION from 3.0.58 to 3.0.59 by @rafal-hawrylak in #2194

Fixes

• Addresses a compilation failure ("Error: Unable to find valid caller file") that occurred when using @dataform/cli 3.0.57 or 3.0.58 with @dataform/core 3.0.56 or earlier (Issue #2177). This fix ensures @dataform/cli 3.0.59 and later is now compatible with older @dataform/core versions (3.0.56 and earlier), and also improves version mismatch handling. (Implemented in #2191)

Full Changelog: 3.0.58...3.0.59

3.0.58

What's Changed

• Support onSchemaChange for incremental tables by @SuchodolskiEdvin in #2101
• feat: implement .jitCode() support for Assertion actions by @rafal-hawrylak in #2170
• fix: Resolve presubmit failure introduced by PR #2101 by @SuchodolskiEdvin in #2175
• Bump DF_VERSION from 3.0.57 to 3.0.58 by @rafal-hawrylak in #2176

New Contributors

• @SuchodolskiEdvin made their first contribution in #2101

Full Changelog: 3.0.57...3.0.58

3.0.57

🚨 Compatibility Issue - Compilation Failure 🚨

• This release introduced a compatibility issue when using @dataform/cli version 3.0.57 or 3.0.58 with @dataform/core version 3.0.56 (or earlier).
• Symptoms: Users with this version mismatch will see dataform compile fail with the error: "Error: Unable to find valid caller file; please report this issue.", as reported in issue #2177. Compilation halts, reporting "Compiled 0 action(s)".
• Cause: This is due to changes in how file paths are handled, related to the vm2 sandbox library update in the CLI, which requires a corresponding @dataform/core update.
• Workarounds:
  • Recommended: Ensure your project's dataformCoreVersion in workflow_settings.yaml is aligned with the installed @dataform/cli version (e.g., both are 3.0.57 or later).
  • Alternatively, downgrade the CLI to match your Core version: npm install -g @dataform/cli@3.0.56
• Resolution: This compatibility requirement is more strictly enforced in version 3.0.59 to prevent this issue. Upgrading both @dataform/cli and your project's dataformCoreVersion to 3.0.59 or later is recommended. Also starting from version 3.0.59 you can safely use it with @dataform/core 3.0.56 or earlier.

What's Changed

• Add compilation error when trying to add unit tests for unsupported actions by @fernst in #2154
• Upgrade the affected packages to the latest by @Tuseeq1 in #2115
• JiT Worker in CLI and RPC infrastructure by @rafal-hawrylak in #2109
• Bump vm2 from 3.10.2 to 3.11.3 by @dependabot[bot] in #2168
• Bump DF_VERSION from 3.0.56 to 3.0.57 by @rafal-hawrylak in #2173

Full Changelog: 3.0.56...3.0.57

3.0.56

What's Changed

• Bump @google-cloud/bigquery 8.2.0 -> 8.3.0 by @apilaskowski in #2152
• Bump DF_VERSION from 3.0.55 to 3.0.56 by @apilaskowski in #2159

Full Changelog: 3.0.55...3.0.56

3.0.55

What's Changed

• Populate new unit test properties and add flag to include unit tests in compiled graph by @fernst in #2063
• Revert "feat: add getContents() for reading external markdown files into table descriptions (#2138)" by @kolina in #2155
• release new Dataform core version with GCP compilation fix by @kolina in #2156

Full Changelog: 3.0.54...3.0.55

3.0.54

What's Changed

• Bump @google-cloud/bigquery to 8.2.0 by @apilaskowski in #2151
• Bump protobufjs from 7.2.5 to 7.5.5 by @dependabot[bot] in #2144
• Publishing Dataform security patches by @dataform-team in #2153

Full Changelog: 3.0.53...3.0.54

3.0.53

What's Changed

• Bump lodash from 4.17.23 to 4.18.1 by @dependabot[bot] in #2135
• Support generic compilation options by @rafal-hawrylak in #2145
• feat: add getContents() for reading external markdown files into table descriptions by @AmmanuelT in #2138
• Bump follow-redirects from 1.15.6 to 1.16.0 by @dependabot[bot] in #2141
• Move extension options by @rafal-hawrylak in #2147
• Added support for JSON output for test results by @fernst in #2140
• Release Dataform 3.0.53. by @piotrwrotniak in #2148

Full Changelog: 3.0.52...3.0.53

3.0.52

What's Changed

• Introduce tags to Dataform declarations by @rafal-hawrylak in #2130
• fix: error messages when compiling tests for incremental tables by @ashish10alex in #2118
• adding dot option to compile command by @AmmanuelT in #2116
• JiT context - Add Running execution metadata by @ikholopov-omni in #2132
• Bump handlebars from 4.7.8 to 4.7.9 by @dependabot[bot] in #2129
• Publishing Dataform security patches by @dataform-team in #2133
• Bump picomatch from 2.1.1 to 2.3.2 by @dependabot[bot] in #2136
• update BQ test credentials to fix integration tests by @kolina in #2139
• Clear notebook metadata during compilation by @mfiglus in #2137
• Extend list of supported BQ types by @ikholopov-omni in #2134
• Fix cloud build npm package paths by @mfiglus in #2142
• Allow arbitrary JSON in google.protobuf.Struct fields during validation by @SkyrimL in #2119
• Updating NPM package version to 3.0.52 by @SkyrimL in #2143

New Contributors

• @AmmanuelT made their first contribution in #2116
• @SkyrimL made their first contribution in #2119

Full Changelog: 3.0.50...3.0.52

3.0.50

What's Changed

• Add missing extension.proto to build output. by @piotrwrotniak in #2127
• Release Dataform 3.0.50 by @piotrwrotniak in #2128

Full Changelog: 3.0.49...3.0.50

3.0.49

What's Changed

• Bump webpack from 5.94.0 to 5.104.1 by @dependabot[bot] in #2084
• Bump rollup from 2.79.2 to 2.80.0 by @dependabot[bot] in #2097
• Bump underscore from 1.13.1 to 1.13.8 by @dependabot[bot] in #2102
• feat: add --verbose flag to expose stateless installation steps of Dataform Core and identify bottlenecks by @ashish10alex in #2100
• Add BigQuery reservation configuration by @max-ostapenko in #2096
• Modify the test runner to accept additional arguments by @rafal-hawrylak in #2105
• Refactor monolithic CLI index_test into specialized files by @rafal-hawrylak in #2106
• JiT context - decode data by @ikholopov-omni in #2111
• fix: update internal import linter rule and reorganize imports by @rafal-hawrylak in #2112
• JiT: protos update to enable execution in CLI by @rafal-hawrylak in #2107
• Support extension in workflow_settings.yml by @apilaskowski in #2122
• Extend ExecuteResponse to contain schema fields. by @piotrwrotniak in #2125
• Release Dataform 3.0.49 by @piotrwrotniak in #2126

New Contributors

• @max-ostapenko made their first contribution in #2096
• @rafal-hawrylak made their first contribution in #2105
• @piotrwrotniak made their first contribution in #2125

Full Changelog: 3.0.48...3.0.49