v1.40.0

New Features and Improvements

• Added enable_predictive_optimization parameter for databricks_catalog and databricks_schema resources. (#3416).
• Added deployment field to the databricks_pipeline resource (#3428).
• Added lookup by name or region to databricks_metastore data source (#3419).
• Added zone_id to gcp_attributes of databricks_instance_pool (#3426).
• Added support for SQL Notebooks execution in databricks_job (#3420).
• Support adding and removing columns in databricks_sql_table (#3381).
• Fixed databricks_entitlement Update & Delete (#3434).
• Fixed databricks_mws_private_access_settings creation (#3439).
• Fixed databricks_user and databricks_service_principal integration tests (#3469).
• Fixed suppress_diff for webhook notifications at the task level in databricks_job (#3441).
• Only suppress diff for run_if when it is ALL_SUCCESS (#3454).
• Used Account client in the databricks_aws_crossaccount_policy data source (#3423).
• Added data sources databricks_external_locations and databricks_external_location (#3464).
• Added environment and environment_key to job settings (#3461).
• Added managed properties (#3465).

Documentation Changes

• Use correct provider alias in AWS E2 provisioning guide (#3425).
• Document pricing_tier of databricks_mws_workspaces resource (#3433).
• Updated documentation for Delta Sharing resources; refactoring relevant resources & data sources (#3466).
• Added description for new fields in databricks_lakehouse_monitor
• Update about using Databricks-managed service principals in all clouds (#3482)

Exporter

• Decrease a need for get-status calls for directories when listing workspace objects (#3470).
• Don't emit permissions and grants if object is going to be ignored (#3417).
• Don't generate references to ignored resources (#3418).
• Generate resource data from the object status obtained during the listing operation (#3460).
• Improve emitting of directories (#3462).
• Skip listing of jobs deployed with DABs (#3445).

Internal Changes

• Migrated databricks_cluster resource to Go SDK (#3376).
• Used ClusterSpec in databricks_cluster resource (#3459).
• Bump Go SDK to v0.38.0 (#3458).
• Bump golang.org/x/mod from 0.16.0 to 0.17.0 (#3435).
• Clean up integration tests and expose helper functions for identifying cloud (#3438).
• Fix integration tests for databricks_entitlements (#3467).
• Switch to use structs from Go SDK for databricks_recipient resource (#3400).
• Make libraries in resource_job slice instead of set (#3398).
• Fixed TestUcAccJobRunAsMutations
• Ensure tests are only run in the selected environment (#3476)
• Use fixture cluster for databricks_sql_permissions integration test (#3483)
• Improve integration tests for databricks_model_serving (#3479)

v1.39.0

New Features and Improvements

• Add databricks_online_table resource (#3352).
• Add resource provider registry (#3347).
• Add support for Vector Search Indexes (#3266).
• Add table update trigger in terraform API (#3401).
• Added owner attribute to databricks_registered_model (#3366).
• Added support for case insensitivity for id fields in UC resources (#3164).
• Allow changes to display_name of databricks_group resource without recreating a group (#3334).
• Delete Vector Search Endpoint when we get an error while waiting for creation (#3348).
• Fix Read operation in databricks_catalog_workspace_binding so we can perform import (#3276).
• Fix sending scale_to_zero_enabled for served_entities in databricks_model_serving resource (#3387).
• Support persisting empty fields (#3362).
• [MLOPS-596] Add Lakehouse Monitor Resource (#3238).
• Update databricks_model_serving resource to match latest API spec/SDK (#3093).

Documentation Changes

• Clarify disable as user deletion (#3360).
• Add MODEL to documentation about data_object_type in databricks_share resource (#3380).
• Fix broken links in metastore-related docs (#3356).
• Update documentation about databricks-managed service principals (#3350).
• Fix code example for databricks_storage_credentials data source (#3327).
• Fix storage credential doc guide (#3340).
• Improve description of depends_on block (#3390).
• Improve job library documentation (#3399).
• [DOCS] change master to main & GH image raw links (#3358).
• [DOC] Removing NOTEBOOK_FILE from databricks_share (#3353).
• [MLOPS-717] Rename Amazon Bedrock (#3403).

Exporter

• Don't generate resources with empty names (#3345).
• Remove too aggressive omitting for volume_type attribute of databricks_volume resource (#3328).
• Add an option for exporting secret values into terraform.tfvars (#3372).
• Add support for generation of dependencies between resources (#3377).
• Change listing behavior for metastore and storage credentials (#3367).
• Modify grants for some UC objects to allow handling of other owners (#3357).

Internal Changes

• Add integration test for ForEachTask (#3283).
• Bump github.com/hashicorp/hcl/v2 from 2.20.0 to 2.20.1 (#3405).
• Bump github.com/zclconf/go-cty from 1.14.3 to 1.14.4 (#3393).
• Bump go-sdk version to 0.36.0 (#3391).
• Bump go-sdk version to 0.37.0 (#3410).
• Bump golang.org/x/mod from 0.15.0 to 0.16.0 (#3329).
• Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#3368).
• Disable Lakehouse Monitoring integration tests on GCP (#3355).
• Increase default timeout for databricks_vector_search_endpoint (#3332).
• Make StructToSchema work for recursive data types (#3302).
• Port databricks_secret_scope, databricks_secret and databricks_secret_acl to Go SDK (#3373).
• SCIM patch to remove resources must not contain a value field (#3374).
• Update Aliases function for ResourceProvider to handle recursive structures more gracefully (#3338).
• Update Go SDK to latest + Fix backwards incompatible change (#3333).
• Update master to main in diff schema (#3331).
• improve databricks_aws_crossaccount_policy data source (#3343).
• lock metastore assignment test (#3386).
• Added support for updating columns in databricks_sql_table resource (#3359).
• Fix integration test for sql column update (#3384).

v1.38.0

New Features and Improvements

• Use workspace-level default for enable_serverless_compute if not specified in databricks_sql_global_config (#3279). Previously, this resource would disable serverless unless you set the deprecated enable_serverless_compute attribute to true. From this release, this resource will not modify enable_serverless_compute, leaving it as its default value (enabled) if unspecified.
• Fixed webhook_notifications diff suppression for databricks_job (#3309).
• Perform case-insensitive error message checking when using force in databricks_user (#3295).
• Use stable IDs for settings resources (#3314).

Documentation Changes

• Improved documentation for INTERNAL and INTERNAL_AND_EXTERNAL delta sharing scope in terraform (#3287).
• Added user guide for new behaviours with UC by default (#3318).
• Expanded the note about private link in the troubleshooting guide (#3319).
• Document storage_location attribute of the databricks_registered_model (#3249).
• Various documentation improvements (#3288).
• Changed accounts_id to required (#3244).

Exporter

• Improved support for Unity Catalog (#3281).
• Added generation of import blocks for easier importing existing resources in Terraform 1.5+ (#3293).
• Added support for databricks_file resource (#3301).

Internal Changes

• Set Computed field to true for common.Resource account_id attribute (#3310).
• Removed unnecessary alias from cluster resource (#3298).
• Bump Go SDK (#3296).
• Bump github.com/hashicorp/hcl/v2 from 2.19.1 to 2.20.0 (#3317).
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.32.0 to 2.33.0 (#3300).
• Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 (#3323).
• Bump github.com/zclconf/go-cty from 1.14.2 to 1.14.3 (#3322).

v1.37.1

New Features and Improvements

• Removed CustomizeDiff and Client Side Validation for databricks_grants (#3290).
• Added terraform support for restrict ws admins setting (#3243).

Internal Changes

• Migrated databricks_global_init_script to Go SDK (#2036).
• Bump github.com/hashicorp/terraform-plugin-sdk/v2 from 2.31.0 to 2.32.0 (#3177).

v1.37.0

1.37.0

New Features and Improvements

• Add databricks_file resource (#3265).
• Add databricks_storage_credential and databricks_storage_credentials data sources (#3254).
• Add source attribute to dbt_task and sql_task.file tasks to support files from workspace (#3208).
• Add computed volume_path attribute to databricks_volume resource (#3272).
• Add support for Vector Search Endpoints (#3191).
• [JOBS-16324] Terraform support for Foreach tasks (private preview) (#3252).
• fix: properly propagate auth_type to the databricks client (#3273).

Documentation Changes

• Fix images and add note on setting multiple authorizations for workspace setup (#3259).
• Remove data_object_type=TABLE only restriction in databricks_share (#3108).
• Remove legacy guides (#3282).
• Update for_each_task docs. (#3271).

Exporter

• Support for some Unity Catalog resources (#3242).
• Rework handling of listings and interactive prompting (#3241).
• UC exporter databricks storage credential feature (#3219).

Internal Changes

• Add CustomDiffFunc for health in sql_endpoint resources (#3227).
• Bump github.com/databricks/databricks-sdk-go 0.33.0 (#3275).
• Suppress diff on whitespace change for resources that often use HERE-docs (#3251).

v1.36.3

New Features and Improvements

• Explicitly set securable field when reading databricks_grants or databricks_grant (#3246).

Documentation Changes

• Added information on id and other exposed attributes where appropriate (#3237).
• Fixed docs in metastore databricks_grants example (#3239).

Exporter

• Detect & handle deleted workspace objects (notebooks/files/directories) when running in incremental mode (#3225).

Internal Changes

• Make IterFields take in aliases (#3207).

v1.36.2

1.36.2

New Features and Improvements

• Added databricks_aws_unity_catalog_policy data source (#2483).
• Removed omitempty in destination fields in clustes_api.go (#3232), to address (#3231)

Exporter

• Omitted git_provider only for well-known Git URLs (#3216).

Internal Changes

• Bumped github.com/zclconf/go-cty from 1.14.1 to 1.14.2 (#3144).
• Bumped golang.org/x/mod from 0.14.0 to 0.15.0 (#3229).

v1.36.1

1.36.1

New Features and Improvements

• Fixed create storage credentials with owner for account (#3184).

Documentation Changes

• Removed AWS-only note for databricks_service_principal_secret resource (#3213).

Internal Changes

• Fixed test: TestUcAccResourceSqlTable_Managed (#3226).

v1.36.0

New Features and Improvements

• Added databricks_volumes as data source (#3150).
• Fixed updating owners for UC resources (#3189).
• Validated metastore id for databricks_grant and databricks_grants resources (#3159).
• Fixed databricks_connection regression when creating without owner (#3186).
• Allow using empty strings as job parameters (#3158).
• Changed type of value field of JobsHealthRule to int64 (#3215).

Documentation Changes

• Various documentation updates (#3198).
• Fixed typo in docs (#3166).

Exporter

• Timestamps are now added to log entries (#3146).
• Add retries for Search, ReadContext and Import operations when importing the resource (#3202).
• Performance improvements for big workspaces (#3167).
• Fix generation of cluster policy resources (#3185).
• Skip emitting of clusters that come from more cluster sources (#3161).

Internal Changes

• Migrated cluster schema to use the go-sdk struct (#3076).
• Updated actions/setup-go to v5 (#3154).
• Changed default branch from master to main (#3174).
• Added .codegen.json configuration (#3180).
• Used common.Resource consistently throughout the provider (#3193).
• Fixed unit test (#3201).
• Added test code for job task order (#3183).
• Added unit test for customizable_schema.go (#3192).
• Extended customizable schema with AtLeastOneOf, ExactlyOneOf, RequiredWith (#3182).
• Fixed notebook parameters in acceptance test (#3205).
• Introduced Generic Settings Resource (#2997).
• Suppress diff should apply to new fields added in the same chained call to CustomizableSchema (#3200).

v1.35.0

Changelog

New Features and Improvements:

• Allow custom tags on AWS customer managed VPC workspaces (#3114).
• Allow disabling serverless and photon for databricks_sql_warehouse (#3128).
• Allow updating owner of databricks_connection (#3080).
• Fix public_access_enabled property for mws_private_access_settings (#3132).

Documentation Changes:

• Reference OpenTofu support in TF Readme (#3141).

Exporter:

• Better handling of ignored objects (#3055).
• Don't omit source for notebook tasks from workspace when there is a Git configuration (#3120).
• Improvements in jobs, DLT pipelines and policies (#3140).
• Small refactoring (#3115).

Internal Changes:

• Add Self-Assume Capability to the Identity-Bound policy for IAM roles provisioned by TF (#3124).
• Bump TF provider to go 1.21 (#3129).
• Bump github.com/cloudflare/circl from 1.3.6 to 1.3.7 (#3088).
• Migrate databricks_mws_private_access_settings to Go SDK (#3135).
• Refactor catalog/resource_grants to use Go SDK (#3090).
• Remove Authenticate call from TF Configure (#3100).
• Remove debug binary (#3107).
• Support Go SDK Mocking Library in Terraform Unit Tests (#3121).
• Update go SDK to 0.30.0 (#3145).
• Use double quotes with filters in SCIM (#3136).