Skip to content

Changelog

0.18.0 (2026-05-21)

Features

  • allow customization through [tool.kedro-databricks] in pyproject.toml (82860a7)
  • write default config to pyproject.toml on init (2457d44)

Bug Fixes

  • init inputs should influence config written to pyproject.toml (bc0bdf0)

Documentation

  • fix readthedocs build and remove dependency-group (16a8b21)
  • migrate to zensical docs (74e537d)
  • remove coverage from contributing (154374e)
  • small changes (e344659)

0.17.0 (2026-04-27)

Features

  • allows reinitializing (8c88105)
  • allows users to use regexes to apply task overrides (3d8d59c)

Bug Fixes

  • do not add to gitignore if already present (8abaff8)
  • skip regex and default overrides (ccfa5f3)

0.16.1 (2026-04-27)

Bug Fixes

  • email_notifications are a list of strings (22da170)
  • preserve user specified ordering (1dadd44)

0.16.0 (2026-04-26)

Features

  • check for MemoryDataset when bundling resources (5cfa6a1)

Bug Fixes

  • file path substitution on multiline strings (e52721e)
  • handle old versions of kedro (08cc70d)
  • parameters and params: are special case inputs (4c2b8f9)
  • replacing urls cause APIDataset to fail (534ac40)

0.15.1 (2026-04-20)

Bug Fixes

  • adds deterministic ordering of object fields (ddb96d6)

0.15.0 (2026-04-15)

Features

  • allows users to use regexes to apply overrides to multiple resources (ecadf2c)
  • replace custom merging logic with fuso (d9d3e0f)

Bug Fixes

  • a single resource might have its own default task (c6d9d31)
  • only apply overrides to real resources (b21075a)
  • package name should not be prefixed when using --pipeline (b62184c)
  • regex overrides trumphs defaults (45ac07a)
  • types has been fixed downstream (8b18f8c)

Documentation

  • add docstrings to common (c4fc48e)
  • we no longer have gen_changelog (4fdac03)

0.14.1 (2025-12-11)

Fix

  • 2256163: there is no tomlkit>0.14

Ci

  • a68c44f: always try to publish when pushed to main

Other Changes

  • dbb82ea: update uv lock to latest

0.14.0 (2025-12-11)

Feat

  • f0310e9: generated resources are now environment specific
  • 34fb869: add support for Databricks Free Edition

Fix

  • 985c4b2: DEFAULT_TARGET volume resource should be named with variable
  • 5cc8ead: create a user-specific volume for dev targets
  • 93b6916: add cli options for catalog and schema in kedro databricks init
  • c382f51: forwarded arguments to the databricks cli should be passed following '--'
  • a12f3a3: run default pipeline when no pipeline is specified in kedro databricks run

Refactor

  • 42f6421: discover commands from files to avoid duplicating command options
  • 04dfe5d: encapsulate calls to the databricks cli in a single class

Docs

  • 4f5a592: we now add the target environment to the name of generated files

Ci

  • 1b52276: fix codecov coverage report + we are only concerned with project coverage

Other Changes

  • 85dcea8: remove junit coverage file
  • 1be6f84: ignore all coverage files
  • 2f87864: add type-checking pre-commit hook
  • 40167ce: add comment on argument parsing in kedro databricks run

0.13.1 (2025-11-19)

Fix

  • a1ff65a: update Deployment status check logic
  • 4dc98ad: raise exception when databricks cli deployment fails

Other Changes

  • fbcb793: update relevant strings in tests
  • f1e6ec0: all inputs should be documented
  • 6a9a30a: commitizen require fetch-depth 0
  • 92fd7f0: only post version bump if applicable
  • 5cfbfc0: keep xml extension
  • 06c39e3: i called the env var PR_NBR
  • 3d69940: coverage action requires junit-xml
  • 019f102: Update event file path in post_comment.yml
  • c8487f9: fix syntax for gh env vars
  • b65dc05: there are actions for adding a pr comment
  • 41af4af: there are actions for downloading from a workflow run
  • 1e91a8a: external contributors are not allowed to post PR comment in gh actions

0.13.0 (2025-09-25)

Feat

  • 3b2dc61: Add resource generator resolver and custom generator support in documentation
  • d7c931d: Implement resource generators for Databricks asset bundling

Fix

  • 1bc880e: update create_pipeline_task to handle databricks run_script
  • 413425d: you cannot concatenate tuples and lists with +
  • 7af1164: destroy command

Other Changes

  • cfe72c1: Update documentation for Databricks resource generators and enhance code comments
  • 1b1fcba: allows you to pass arguments to dev commands
  • 9489dfa: upgrade uv dependency
  • 2b51b7c: improve dev experience

0.12.4 (2025-08-15)

Pull Requests

Fix

Other Changes

0.12.3 (2025-07-17)

Pull Requests

Fix

  • 48bc560: properly parse Kedro version

0.12.2 (2025-07-02)

Pull Requests

Fix

  • 7630ae3: task keys must satisfy ^[\w\-_]+$ and be less than 100 characters
  • 9c1c237: use default with local storage on aws

0.12.1 (2025-06-17)

Pull Requests

Fix

Other Changes

  • ce6f5ce: we already have one toml dependency
  • 71d516c: remove unused parameter
  • ac6ac8f: assert are removed when compiling to byte code
  • 51cb272: improve devex when working in dev
  • afb269b: add badges to home
  • cb824b1: CHANGELOG author is broken
  • 452ae78: make changelog look nicer
  • b8bf4d5: no need for multiple menu levels
  • b2a1472: use hightlighted rows to keep syntax colors
  • f40ac2d: reduce complexity
  • 9ad2d59: reduce complexity
  • 8573777: use hightlighted rows to keep syntax colors

0.12.0 (2025-06-14)

Pull Requests

Feat

  • 6caad62: remove python 3.9 support due to EOL in October 2025. (Jens Peder Meldgaard)

Other Changes

  • 32c88b5: add changelog and ability to control navigation (Jens Peder Meldgaard)
  • c6b707d: use uv for deploying docs (JenspederM)
  • d142760: use uv for deploying docs (Jens Peder Meldgaard)
  • 6a2f8a1: update readme (Jens Peder Meldgaard)
  • 7f2681c: add workflow to publish docs (Jens Peder Meldgaard)
  • aa97ad2: make stuff look nice (Jens Peder Meldgaard)
  • d6d9bf8: reduce complexity (Jens Peder Meldgaard)
  • 7e0f078: adds diff to example result (Jens Peder Meldgaard)
  • e27a3bb: add readme to examples (Jens Peder Meldgaard)
  • 3006320: update docstrings (Jens Peder Meldgaard)
  • ebc0178: generate markdown for examples (Jens Peder Meldgaard)
  • a94fbb4: setup mkdocs (Jens Peder Meldgaard)

0.11.0 (2025-06-13)

Pull Requests

Feat

  • 12c5a31: extend parameters instead of overriding (Jens Peder Meldgaard)

Other Changes

  • 9bd385a: switch to uv build (Jens Peder Meldgaard)

0.10.1 (2025-06-12)

Pull Requests

Fix

  • 3b92a9d: ${workspace.file_path} is not resolved correctly regardless of what Databricks says (JenspederM)
  • c53c540: ${workspace.file_path} is not resolved correctly regardless of what Databricks says (Jens Peder Meldgaard)

0.10.0 (2025-04-25)

Pull Requests

Feat

  • 5cfc257: adds run and destroy wrappers (Jens Peder Meldgaard)

Fix

  • f52bd2a: get everything working again (Jens Peder Meldgaard)
  • 3e47572: make default deployment work for databricks-iris starter (Jens Peder Meldgaard)
  • 4c0d8ba: databricks does not support spark config overrides at runtime (Jens Peder Meldgaard)

Refactor

  • 7ff0f10: switch from classes to functions (Jens Peder Meldgaard)

Other Changes

  • b50f923: run integration tests when changed (Jens Peder Meldgaard)
  • 6fdda33: no need to test run separately (Jens Peder Meldgaard)
  • dcbeb71: integration tests run on azure (Jens Peder Meldgaard)
  • 2764eaa: no need to have two (Jens Peder Meldgaard)
  • 1bafd40: reset init between functions (Jens Peder Meldgaard)
  • 114bf9f: edits name (Jens Peder Meldgaard)
  • 27936ef: we only want to run one copy of databricks-iris (Jens Peder Meldgaard)
  • 24949b5: we dont need kedro jupyter (Jens Peder Meldgaard)
  • 8d5f675: remove kedro version check (Jens Peder Meldgaard)
  • ef787d2: add kedro first (Jens Peder Meldgaard)
  • be4c405: unit tests do not require the test group (Jens Peder Meldgaard)
  • a98b849: allow prerelease (Jens Peder Meldgaard)
  • 2fe11bb: install frozen (Jens Peder Meldgaard)
  • 15daf62: install all groups (Jens Peder Meldgaard)

0.9.1 (2025-03-22)

Pull Requests

Fix

  • 1ba4e26: implement example for all fields in databricks jobs api 2.2 (Jens Peder Meldgaard)
  • 03e3d74: access_control_list has multiple lookup keys (Jens Peder Meldgaard)
  • 06aa2d1: add ability to ignore keyed overrides for specific fields (Jens Peder Meldgaard)
  • d9f2210: there is no element called on_duration_failure_threshold_exceeded (Jens Peder Meldgaard)
  • 083d81c: if element is not a dict override the whole list (Jens Peder Meldgaard)

Other Changes

  • 124dcbc: add missing field to email notifications (Jens Peder Meldgaard)

0.9.0 (2025-03-20)

Pull Requests

Fix

  • f298b78: rename params and conf-source according to kedro (Jens Peder Meldgaard)
  • 93eb34d: add support for custom task libraries (Jens Peder Meldgaard)
  • c1bb870: add support for job parameters (Jens Peder Meldgaard)
  • 6c78de3: add support for health rule overrides (Jens Peder Meldgaard)

Refactor

  • 39b4250: achieve the same with way less code (Jens Peder Meldgaard)
  • f3cebca: move utils only used for bundling to separate module (Jens Peder Meldgaard)
  • d17d2d5: move examples path resolution to where it's used (Jens Peder Meldgaard)
  • 71d7ded: move remove_nulls to separate module (Jens Peder Meldgaard)
  • e54500b: use help from kedro where possible (Jens Peder Meldgaard)

Other Changes

  • 773e175: type error (Jens Peder Meldgaard)
  • c79aa98: yaml lint pre-commit (Jens Peder Meldgaard)
  • 782652e: check-otml and fix line endings (Jens Peder Meldgaard)
  • 402d461: add no cover (Jens Peder Meldgaard)
  • e762534: add example for task level webhook notifications (Jens Peder Meldgaard)
  • 63aa628: move to webhook_notifications (Jens Peder Meldgaard)

0.8.1 (2025-03-15)

Pull Requests

Fix

  • 14eb8b3: webhook overrides are keyed (JenspederM)
  • 1fabb55: webhook overrides are keyed (Jens Peder Meldgaard)

0.8.0 (2025-03-09)

Pull Requests

Feat

  • 04e5526: create target specific configurations (Jens Peder Meldgaard)
  • b88e18c: let asset bundle handle file sync (Jens Peder Meldgaard)
  • d239944: kedro_databricks is now type safe (Jens Peder Meldgaard)
  • e2f6fed: pass args to databricks cli directly (Jens Peder Meldgaard)

Fix

  • f48039b: update gitignore (Jens Peder Meldgaard)
  • 1daf1b7: deploy to env by default (Jens Peder Meldgaard)
  • cdfaa2f: elements are popped from overrides (Jens Peder Meldgaard)
  • 8b27f63: make bundling work (Jens Peder Meldgaard)
  • 099c08c: get target from databricks args (Jens Peder Meldgaard)
  • 6ed196b: check if user is using databricks cli version (Jens Peder Meldgaard)
  • 9384a30: real time forward stdout from commands (Jens Peder Meldgaard)
  • 0af3989: ensures that unit tests can run locally (Jens Peder Meldgaard)

Other Changes

  • eaa344a: add environements lookup key to OVERRIDE_KEY_MAP (Jens Peder Meldgaard)
  • 7745c1a: use named function arguments (Jens Peder Meldgaard)
  • c82ff22: reduce complexity (Jens Peder Meldgaard)
  • 35be554: reduce complexity (Jens Peder Meldgaard)
  • 3a97597: Workspace paths are now automatically prefixed with /Workspace (Jens Peder Meldgaard)
  • 406b4c9: fix type hints (Jens Peder Meldgaard)
  • 69c83d5: unit tests now require databricks cli (Jens Peder Meldgaard)
  • b2ebb86: update uv (Jens Peder Meldgaard)
  • 86473d5: reduce code complexity (Jens Peder Meldgaard)
  • 0221c6a: default should be a unity catalog enabled cluster (Jens Peder Meldgaard)

0.7.4 (2025-02-13)

Pull Requests

Fix

  • bdd9283: v2 is deprecated (Jens Peder Meldgaard)

Other Changes

  • 00d6cac: import docstring (JenspederM)
  • 4472bd5: use non deprecated download (JenspederM)
  • 53af87b: import docstring (Jens Peder Meldgaard)

0.7.3 (2025-02-13)

Pull Requests

Fix

  • 0ff9154: refactor databricks success check (JenspederM)
  • 4a96da1: refactor databricks success check (Jens Peder Meldgaard)
  • dd66576: upload changelog when checking version (JenspederM)

0.7.2 (2025-02-13)

Pull Requests

Fix

  • d10ba47: upload changelog when checking version (Jens Peder Meldgaard)
  • cb00b23: make success check a variable (Jens Peder Meldgaard)

Other Changes

  • 7050621: update bagde (Jens Peder Meldgaard)
  • d8b5066: pull tag based on version check (Jens Peder Meldgaard)

0.7.1 (2025-02-13)

Pull Requests

Fix

  • 4cee54e: avoid nesting conf dir (Jens Peder Meldgaard)

Other Changes

  • ccb7d33: Command should have a sensible default msg (Jens Peder Meldgaard)
  • c51dae6: Command should use self.msg when logging (Jens Peder Meldgaard)
  • 4fa05ee: contents: write should allow contributors to make a PR comment (Jens Peder Meldgaard)
  • b884920: only publish on changes to src or tests (Jens Peder Meldgaard)
  • 5728861: print new veersion (JenspederM)
  • a5c8b72: print new veersion (Jens Peder Meldgaard)
  • 110a78c: print new veersion (JenspederM)
  • 8d3cfee: print new veersion (Jens Peder Meldgaard)

0.7.0 (2025-01-03)

Pull Requests

Feat

  • 4b852b3: check for version (Jens Peder Meldgaard)
  • 4b852b3: check for version before publish (Jens Peder Meldgaard)
  • 4b852b3: check for version before publish (Jens Peder Meldgaard)

Other Changes

  • 49dcb65: forgot checkout (JenspederM)
  • 4158dfb: forgot checkout (Jens Peder Meldgaard)
  • 79fd818: change comment author (Jens Peder Meldgaard)
  • b6cad81: add reusable action for checking version (Jens Peder Meldgaard)
  • 4ed8b0a: add linting (Jens Peder Meldgaard)
  • 4b852b3: display version on pr (Jens Peder Meldgaard)
  • 4b852b3: echo new version (Jens Peder Meldgaard)
  • 169e88f: migrate to uv (Jens Peder Meldgaard)
  • 169e88f: migrate to uv (Jens Peder Meldgaard)
  • 169e88f: add permissions (Jens Peder Meldgaard)
  • 169e88f: run unit tests with correct python version (Jens Peder Meldgaard)
  • 1affa8f: remove comment (Jens Peder Meldgaard)
  • aaebf2c: remove whitespace (Jens Peder Meldgaard)
  • a2f0846: pass secrets to workflow (Jens Peder Meldgaard)

0.6.7 (2024-12-28)

Pull Requests

Fix

  • 1045bad: allow usage of environment variables to configure workspace client (JenspederM)
  • 743c7f0: allow usage of environment variables to configure workspace client (Jens Peder Meldgaard)
  • 1813f31: command should return CompletedProcess (Jens Peder Meldgaard)
  • e5a0252: tarfile fitler was implemented in python 3.12 (Jens Peder Meldgaard)
  • 86a24c8: completion logging was unreachable (Jens Peder Meldgaard)

Refactor

  • 5149662: command run (Jens Peder Meldgaard)

Other Changes

  • d2c528c: add sanity check (JenspederM)
  • c062c9a: add sanity check (Jens Peder Meldgaard)
  • 517f3b7: add sanity check (Jens Peder Meldgaard)

0.6.6 (2024-11-28)

Pull Requests

Fix

  • 5a24a9d: add support for vars (JenspederM)
  • fbaf166: it's var not vars (Jens Peder Meldgaard)
  • 5bcb934: add support for vars (Jens Peder Meldgaard)

Refactor

  • 0f2180c: improve run command (Jens Peder Meldgaard)

0.6.5 (2024-11-24)

Pull Requests

Fix

  • 3bfef43: log deployed jobs to user (Jens Peder Meldgaard)

Refactor

  • 8b7feb0: make _gather_jobs easier to test (Jens Peder Meldgaard)
  • 791df6d: add types to deploy methods (Jens Peder Meldgaard)
  • 3f6979a: simplify log_deployed_resources (Jens Peder Meldgaard)
  • b4da364: return jobs after logging (Jens Peder Meldgaard)
  • 5af7a97: handle errors in init (Jens Peder Meldgaard)
  • a999604: fix args in make_workflow_name (Jens Peder Meldgaard)
  • 2987fdd: move make_workflow_name to utils (Jens Peder Meldgaard)

Other Changes

  • d5a1fa4: remove main (Jens Peder Meldgaard)
  • 3ad6675: use uv for dev builds (Jens Peder Meldgaard)
  • bc322f3: add databricks-sdk as dependency (Jens Peder Meldgaard)

0.6.4 (2024-11-06)

Pull Requests

Refactor

  • 4ab7698: simplify generate_resources (Jens Peder Meldgaard)
  • 3d7dca6: make deploy a controller (Jens Peder Meldgaard)

Other Changes

  • 4c1f3d6: update dependencies and remove unused dev dependencies (Jens Peder Meldgaard)
  • c09cd83: update pre-commits (Jens Peder Meldgaard)

0.6.3 (2024-11-06)

Pull Requests

0.6.2 (2024-11-02)

Pull Requests

Fix

  • 151adf6: pass init args to bundle controller in deploy (JenspederM)
  • 5c7cd55: make overwrite arg a flag (Jens Peder Meldgaard)
  • 4413554: pass init args to bundle controller in deploy (Jens Peder Meldgaard)

Refactor

  • ef03f5c: make bundle a controller (Jens Peder Meldgaard)

Other Changes

  • 1ae98c4: update kedro (Jens Peder Meldgaard)
  • d045018: satisfy lint (Jens Peder Meldgaard)
  • ba197b5: update dependencies (Jens Peder Meldgaard)
  • 15122e6: remove black from pre-commit (Jens Peder Meldgaard)

0.6.1 (2024-10-26)

Pull Requests

Refactor

  • c8e9a15: add utility to check if user has databricks CLI (JensPederM)
  • 0be5a5c: move init templates to separate folder (JensPederM)
  • 1045577: make init a class to reduce duplicated code (JensPederM)

Other Changes

  • 9807739: add increment changelog to release body (JenspederM)
  • 4eea65f: add increment changelog to release body (Jens Peder Meldgaard)

0.6.0 (2024-10-20)

Pull Requests

0.5.0 (2024-10-17)

Pull Requests

0.4.0 (2024-10-05)

Pull Requests

Fix

  • d0f6ef9: adds support for another conf path# (JenspederM)
  • 7396a08: adds support for another conf path# (JensPederM)

Other Changes

  • 4bfcbc7: separate tests in unit and integration (JensPederM)
  • 3b7465d: update kedro dependency (JensPederM)
  • 6f90db2: update pre-commits and disable too-many-arguments (JensPederM)

0.3.0 (2024-09-14)

Pull Requests

Fix

  • 11226b0: entry_point is separated by hyphens (Jens Peder Meldgaard)

Other Changes

  • cec3bc8: add select to ruff lint (Jens Peder Meldgaard)
  • 1ea5c6e: update dependencies (Jens Peder Meldgaard)

0.2.1 (2024-09-02)

Pull Requests

Feat

  • 0540b00: Make changes necessary to utilize run in kedro>=0.19.8 (JensPederM)

Fix

  • 1271feb: project must be build to be listed (JenspederM)
  • 8937bb1: project must be build to be listed (Jens Peder Meldgaard)
  • eac1098: project must be build to be listed (Jens Peder Meldgaard)
  • 3451c8e: log target path when uploading config (JensPederM)
  • 0540b00: use main when kedro > 0.19.8 (JensPederM)

Other Changes

  • 5619a7f: add commitizen to publish pipeline (Jens Peder Meldgaard)
  • 9bacb23: update dependencies (JensPederM)