Exploring the Databricks Debugger: Writing flawless code on the first try is a dream, but debugging is a reality for most developers. In this post, I dive into the new Databricks code cell debugger, sharing my first impressions and tips for getting started with this powerful tool.
Data Engineering / Databricks / Fabric / Python / SQL
Cleaning data is a very common task for data professionals. In this post, I demonstrate a few common data cleaning task with spark Python and SQL.
As Data Engineers we need to monitor usage and costs of our data solutions. Databricks lately released tools to help use do that: the Account Usage Dashboard and Budgets. Both based on the “Billing” system schema.
Databricks recently added a for-each task to their workflow capability. How does it work and what are its limitations?
Cloning tables in Databricks is a fast way to create replicated data for test proposes, or archiving. Explore the different types of table cloning, each with its pros and cons.
Excel is one of the most common data file formats, and, as data engineers, we are required to read data from it on almost every project. Working in Databricks, you can read and write Excel files, but you need to pay attention to some pitfalls.
A Python variable has vanished! Can you help the confused Data Engineer find out why?
Google Analytics is a popular tool to measure your website traffic. In the post I will show how to read data from Google Analytics into Databricks to be used in your own reports or Data warehouse
A series of sessions in Hebrew I conducted in January 2024 about the Databricks platform
Databricks is a full data platform hosted in the cloud in either Azure, AWS or GCP. Here is a list of posts about Databricks I wrote on Madeira’s blog
More
