Introducing Masonry

Masonry is not just another development tool; it’s a complete development environment tailored specifically for Azure DataBricks workflows. For those who work extensively with python-based DataBrick workflows, Masonry offers a seamless and robust experience.

The beauty of Masonry lies in its all-inclusive container that comes packed with every tool you’d need to connect, test, and deploy your python-based DataBrick workflows.

Getting Started with Masonry

  1. Download the Relevant Release: First things first, head over to the release section and pick the one that matches the DataBricks runtime of your cluster. As an example, if you’re working with Runtime 10.4 LTS, you’d opt for Masonry v0.0.*-10.4-LTS.

    • Quick Tip: If you notice the term ‘LITE’ in versions, understand that it refers to versions which employ an exposed requirements.txt file to set up the environment.

  2. Install Prerequisites: Before diving deep, it’s essential to install all the prerequisites. This ensures a smooth setup of your local environment.

  3. Configure the Cluster: Now, it’s time to get your hands dirty! Start by configuring the Azure DataBricks cluster to establish a connection.

  4. Obtain Cluster Information: For the tool to function seamlessly, obtaining relevant cluster information is pivotal.

  5. Kickstart the Dev Environment: Now that everything’s set, just follow the steps in the using the dev container documentation and get the development environment up and running.

  • Building Python Libraries: For guidance on constructing Python libraries, refer to the Building Python Library Guide.

  • Running Unit Tests: To validate code functionality, consult the Unit Testing Guide.

  • Local Linting Procedure: Before submitting a pull request, it’s essential to confirm that your code conforms to established standards and is correctly formatted. Refer to the local linting guide for a detailed procedure on executing a comprehensive code base linting solution.

Keeping Up with Developments

To stay updated with what’s next for Masonry, keep an eye on the Project Roadmap. It will keep you informed about the ongoing and upcoming enhancements.

Explore Further

To gain a comprehensive insight into how all the components seamlessly integrate, consider exploring the masonry workflow guide. This resource offers an overview of the workflow process.

In conclusion, Masonry offers a robust solution for those seeking an integrated development experience with Azure DataBricks workflows. Whether you’re a beginner or a seasoned developer, Masonry’s intuitive design and extensive documentation ensure a smooth sail. Happy coding!