Skip to content

Releases: capitalone/datacompy

v1.0.2

Choose a tag to compare

@fdosani fdosani released this 12 Jun 20:17
464c840

What's Changed

  • chore: relax polars top pin by @fdosani in #527
  • fix: handle empty Arrow-backed join keys to prevent merge crashes by @fdosani in #526

Full Changelog: v1.0.1...v1.0.2

v1.0.1

Choose a tag to compare

@fdosani fdosani released this 05 Jun 20:32
5a6132f

What's Changed

  • docs: datacompy update release instructions by @fdosani in #518
  • fix: SparkSQLCompare unq_rows have clean column names (#288) by @star11293 in #517
  • fix: make Spark backend compatible with spark.sql.ansi.enabled=true (Spark 4.x default) by @fdosani in #519
  • bump v1.0.1 by @fdosani in #522
  • fix: update Spark versions and add ANSI mode tests for pytest by @fdosani in #524

New Contributors

Full Changelog: v1.0.0...v1.0.1

v1.0.0

Choose a tag to compare

@fdosani fdosani released this 25 May 21:18
377c876

What's Changed

Full Changelog: v0.19.5...v1.0.0

Summary

This is the v1.0.0 general availability release of DataComPy, a major version bump from 0.19.x. It introduces a new comparator architecture, sensitive column handling, and several quality-of-life improvements across all backends.

Breaking Changes

  • Comparator subpackage (datacompy/comparator/): New strategy-pattern architecture for column comparison logic. Numeric, string, and array comparators are now backend-specific classes (PandasNumericComparator, SparkStringComparator, etc.) rather than inline logic. Custom comparators can be injected into any backend compare class.
  • validate_tolerance_parameter is now a public API (renamed from _validate_tolerance_parameter).
  • Fugue integration removed.
  • Python minimum is now 3.12 (CI/tooling); PySpark dependency split by Python version.
  • Snowflake: snowflake-snowpark-python minimum bumped to 1.37.

New Features

  • Sensitive column masking across all four backends (Pandas, Polars, Spark, Snowflake) — columns can be hidden or hashed without modifying the original DataFrames.
  • Custom comparators — pass a comparator instance per column to any backend for fully custom comparison logic.
  • cols_with_mismatches method — programmatic access to the set of mismatching column names.
  • cache_intermediates option for SparkSQLCompare — controls intermediate DataFrame caching to tune Spark job performance.
  • Pandas 3 support.
  • Per-column tolerance as a dict in addition to a global float.

Fixes

  • SparkSQLCompare: forbid case-sensitive join columns.
  • Snowflake: max_diff now correctly defaults to 0 when None.
  • Join columns None handling fixed.

Other

  • Jinja2 template-based report rendering.
  • Copyright year updated to 2026.
  • CLAUDE.md added.
  • Dependency ranges updated across all backends.

v1.0.0b4

v1.0.0b4 Pre-release
Pre-release

Choose a tag to compare

@fdosani fdosani released this 20 May 14:14
a45d058

What's Changed

  • Update pandas version constraint in pyproject.toml by @fdosani in #513

Full Changelog: v1.0.0b3...v1.0.0b4

v1.0.0b3

v1.0.0b3 Pre-release
Pre-release

Choose a tag to compare

@fdosani fdosani released this 11 May 19:16
6217ef1

What's Changed

  • feat: hide sensitive columns in PandasCompare without modifying original dfs by @sh13m in #494
  • Create CLAUDE.md by @fdosani in #504
  • chore: v1 bump snowflake-snowpark-python minimum to 1.37 by @sh13m in #505
  • fix: SparkSQLCompare forbid case sensitive columns by @sh13m in #508
  • feat: hide sensitive columns in PolarsCompare by @sh13m in #502
  • feat: hide sensitive columns in SparkSQLCompare by @sh13m in #510
  • feat: hide sensitive columns in SnowflakeCompare by @sh13m in #511
  • chore: bump version to 1.0.0b3 and update dependencies/maintainers by @fdosani in #512

Full Changelog: v1.0.0b2...v1.0.0b3

v0.19.5

Choose a tag to compare

@fdosani fdosani released this 09 Apr 04:00
fd1cb13

What's Changed

  • chore: v0.19 pin snowflake-snowpark-python>=1.37,<=1.47 by @sh13m in #507
  • Release v0.19.5 by @fdosani in #509

Full Changelog: v0.19.4...v0.19.5

v1.0.0b2

v1.0.0b2 Pre-release
Pre-release

Choose a tag to compare

@fdosani fdosani released this 13 Mar 17:27
ceaeb7d

What's Changed

  • fix: Snowflake compare when max_diff is None set to 0. by @fdosani in #501

Full Changelog: v1.0.0b1...v1.0.0b2

v0.19.4

Choose a tag to compare

@fdosani fdosani released this 12 Mar 22:49
2bd2088

What's Changed

Full Changelog: v0.19.3...v0.19.4

v1.0.0b1

v1.0.0b1 Pre-release
Pre-release

Choose a tag to compare

@fdosani fdosani released this 11 Mar 14:24

What's Changed

Full Changelog: v1.0.0a5...v1.0.0b1

v0.19.3

Choose a tag to compare

@fdosani fdosani released this 11 Mar 14:08
6240871

What's Changed

Full Changelog: v0.19.2...v0.19.3