Skip to main content
New Introducing Orchestrator Learn more
Data Warehouse integration

Databricks + Conversion

Build segments and workflow triggers on lakehouse tables, synced from Databricks on the schedule you set.

Databricks
Into Conversion
Conversion

How Conversion works with Databricks

Conversion connects to Databricks through a SQL warehouse, signing in as an OAuth service principal, and runs the queries you write on a schedule you choose. Lakehouse tables in the schemas you grant can land as contacts, as custom objects tied to contacts, or as events that start workflows. Syncs are scheduled rather than real time, and Conversion never writes to your workspace.

What syncs

Data Direction Details
Contacts Into Conversion Upserted by userId, or by email when the query returns no userId. Column aliases decide which fields each value fills.
Custom objects Into Conversion Any custom object type you define in Conversion, related to contacts through relationshipFields built with named_struct.
Events Into Conversion Each row becomes an event on a contact's timeline. Include an eventId so a row synced twice is recorded once.

How to connect Databricks

  1. 1 Create a service principal for Conversion in your Databricks workspace settings and generate an OAuth secret. Save the client ID and secret, since the secret is shown only once.
  2. 2 Grant the service principal USE CATALOG, USE SCHEMA, and SELECT on the data you want to sync, plus Can use on the SQL warehouse.
  3. 3 If your workspace uses IP access lists, allow Conversion's IP addresses.
  4. 4 Add a Databricks connection in Conversion settings with the warehouse's server hostname, port, and HTTP path, your catalog and schema, and the OAuth credentials. Then create your syncs.

See Conversion with Databricks

Book a demo and we'll walk through the Databricks integration on a stack that looks like yours.