➡️ Apply here: Senior Databricks/Azure Platform Engineer
🔔 Monitor #devops #data_engineer jobs
👩💼 Want to stand out? Improve your resume to appeal to recruiters, hiring managers, and Applicant Tracking Systems. ➡️ Improve your resume
Senior Databricks/Azure Platform Engineer
Olmait is working on innovative and challenging projects and building teams in data science, data-related software, and cloud infrastructures for startups worldwide. Among our industries and fields of expertise are healthcare, cybersecurity, e-commerce, and more. With offices in Israel and Georgia, we have one of the most powerful development teams in the region. With us, you’ll find a pleasant work environment and exceptional career development opportunities.
About the Project
We are seeking a highly specialized Senior Databricks/Azure Platform Engineer to partner with a leading German insurance firm and help build, guide, and scale their next-generation Data & Machine Learning Platform.
This role offers a unique and impactful opportunity, requiring a combination of deep DevOps expertise and hands-on experience with the Databricks platform on Azure. You will be critical in shaping the architectural direction, establishing best practices, and implementing the core infrastructure that drives the company’s data intelligence and predictive modeling capabilities.
You will champion Infrastructure-as-Code (IaC), leveraging Terraform to provision and manage a unified data ecosystem that adheres to the stringent compliance and security standards of the financial and insurance sectors. Your success will be measured by the stability, scalability, and efficiency of the production-grade data platform you help create.
Key Responsibilities
Architect, Build, and Automate: Design, build, and automate the end-to-end Databricks infrastructure (workspaces, clusters, jobs, services) using Terraform for reliable, repeatable, and scalable deployments.
Develop CI/CD Workflows: Implement and maintain robust CI/CD pipelines (Azure DevOps or GitHub Actions) to enable continuous integration and delivery for all data and ML code, ensuring stability in a production environment.
Platform Guidance: Provide senior-level guidance on the platform’s architecture, security, and governance strategy, specifically concerning Azure/Databricks integration and data compliance requirements.
MLOps Implementation: Deploy and manage environments for model training, versioning, and serving, utilizing Databricks services and MLflow.
Cloud Integration: Securely integrate Databricks with core Azure components such as Key Vault, Storage, Azure Data Factory (ADF), and Synapse, ensuring optimized communication and data flow.
Data Governance: Establish and manage access controls, data lineage, and governance policies within the Unity Catalog.
Collaboration: Work closely with Data Scientists and Data Engineers to operationalize models and enforce DevOps best practices for security, scalability, and infrastructure management across the organization.
Required Experience
6+ years of hands-on experience in DevOps
Proven, hands-on professional experience with the Databricks platform (workspaces, clusters, jobs, Delta Lake).
Solid knowledge and operational experience with Azure Cloud services and their secure integration with Databricks.
Expertise in Infrastructure-as-Code (IaC) using Terraform for provisioning complex cloud and Databricks resources.
Deep practical knowledge of CI/CD automation using tools like Azure DevOps or GitHub Actions.
Proficiency in scripting with Python and/or Bash.
Experience managing data/ML governance and versioning within Unity Catalog and MLflow.
Fluent communication in English and ability to work effectively in a distributed, senior-level team.
Nice to Have
Experience with containerization tools like Docker or orchestration using Kubernetes.
Contextual understanding of popular ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
Familiarity with industry-specific compliance standards (e.g., GDPR, financial sector regulations).
What Olmait Offers
Join Olmait and become a key specialist in the cutting-edge MLOps/DataOps space. We offer a pleasant, professional, and supportive work environment with:
Exceptional career development opportunities by working on challenging and innovative projects with global startups and industry leaders.
Opportunity to drive technology choices and ownership over a modern cloud infrastructure stack in a data-intensive sector.
A culture that values technical excellence, autonomy, and continuous learning.