Hi there 👋

Hey there, DataBricks enthusiasts! Have you ever found yourself tangled in the web of development environments, wishing for that one-stop solution for all your Azure DataBricks workflows? Well, if you haven’t met Masonry yet, prepare to be amazed. And if you’re already a fan, I’ve got some delightful news for you. Introducing: Masonry’s Latest Release 🎉 It’s here, it’s fresh, and it’s geared up to supercharge your Azure DataBricks experience! ...

Introducing Masonry Masonry is not just another development tool; it’s a complete development environment tailored specifically for Azure DataBricks workflows. For those who work extensively with python-based DataBrick workflows, Masonry offers a seamless and robust experience. The beauty of Masonry lies in its all-inclusive container that comes packed with every tool you’d need to connect, test, and deploy your python-based DataBrick workflows. Getting Started with Masonry Download the Relevant Release: First things first, head over to the release section and pick the one that matches the DataBricks runtime of your cluster. As an example, if you’re working with Runtime 10.4 LTS, you’d opt for Masonry v0.0.*-10.4-LTS. ...

Change is often a breath of fresh air, and that’s precisely what’s happening here. The site you’ve come to know is undergoing a little transformation. With evolving tastes and a clearer vision of what I want this space to represent, I’ve decided it’s time for a design refresh. The new theme is a blend of simplicity and elegance, crafted with the intention of making your reading experience as enjoyable as possible. Clean layouts, fresh color palettes, and intuitive navigation will be at the forefront. ...

Testing with Molecule Download all the Source and Templates here Most of my colleagues will attest that I have a strong passion for ensuring the reliability of the code that I write. I have a borderline obsession with testing! Whenever I can, I look to increase the test coverage. I recently contributed to a solution that required the use of multiple Virtual Machines (VMs) to build custom images of different Operating Systems (OS). This solution was making heavy use of Infrastructure as Code (IaC), like many other projects out there. As the IaC grew, I started to see the need for automated testing of the installation and setup code written. The project used Ansible as the provisioner (with some help from Packer). My idea was that we should find a way to test each step or, at the very least, the final output of the Ansible playbooks. The search for a solution led me to find Molecule. Taken from the Molecule site, Molecule provides support for testing with multiple instances, operating systems and distributions, virtualization providers, test frameworks, and testing scenarios. ...