Skip to content

Chen Hirsh's Data Engineering Blog

  • Home
  • About Me
  • Contact Me

Chen Hirsh's Data Engineering Blog

  • Home
  • About Me
  • Contact Me

Tagged: Workflow

Data Engineering / Databricks / Python

March 9, 2025

Databricks job clusters are stricter than interactive clusters

While converting a list to a dataframe, I got a type error, but only on a job cluster, not on an interactive cluster. How to get around that and why does it happen?

Follow:

Recent Posts

  • Lakehouse spring cleaning – Vacuum your Delta tables
  • Databricks job clusters are stricter than interactive clusters
  • Think Twice Before Deleting a User: Avoiding Ownership Chaos in Databricks
  • Write data to one CSV file in Databricks
  • The Databricks Debugger

Recent Comments

  1. Debugging in Databricks – Curated SQL on The Databricks Debugger
  2. Trying out the Databricks For-Each Task – Curated SQL on Databricks workflows for-each – not quite there yet
  3. Cloning Tables in Databricks – Curated SQL on Instant data replication with Databricks table cloning
  4. Working with Excel Files in Databricks – Curated SQL on Working with Excel files in Databricks
  5. Chen on Welcome to Databricks video series

More

Categories

  • Azure Data Factory (1)
  • Data Engineering (8)
  • Databricks (14)
  • Delta Tables (1)
  • Fabric (2)
  • PowerBI (1)
  • Python (7)
  • SQL (2)
  • SQL Server (2)

Chen Hirsh's Data Engineering Blog © 2025. All Rights Reserved.

Powered by  - Designed with the Hueman theme