➡️ Apply here: Senior/Lead Databricks Engineer
👩💼 Want to stand out? Improve your resume to appeal to recruiters, hiring managers, and Applicant Tracking Systems. ➡️ Improve your resume
We are looking for a Senior/Lead Databricks Engineer with expertise in cloud infrastructure, big data processing, data integration and analytics.
In this role, you will play a crucial part in advancing our client’s Data-Driven Company initiative. Your role will involve designing and building robust data architecture to support various aspects of the client’s business. This position is integral to one of our projects in the client’s IT area, focusing on the integration component of their landscape. Join us at our Malta office, which offers a flexible hybrid work setup.
Would you like to be a part of this ambitious and innovative project? We look forward to receiving your application.
Responsibilities:
Data integration, transformation and modelling
Serve large amounts of structured & semi-structured financial data
Analyze existing process logic
Implement best practices in data architecture, including security, governance, compliance and performance optimization
Optimize the data storage across Delta Lake for data management
Develop and maintain scalable data pipelines and build new API integrations to support continuing increases in data volume and complexity
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization
Requirements:
At least 5+ years of professional experience in the data engineering field
Proficiency in Azure Databricks, Delta Lake, Python and PySpark for data manipulation
Proficiency in designing and optimising pipelines using Azure Data Factory, including performance tuning and optimising data pipelines with Databricks Notebooks
Experience with Azure data platforms and related services
Good understanding of SQL and experience with relational database systems (e.g. MSSQL, PostgreSQL, Oracle DB)
Understanding data structures, data modelling and data architecture patterns (Data Lake, DWH, Data mesh, etc.)
Ability to work in an Agile environment and eagerness to learn and develop new skills
Good problem-solving skills and attention to detail
Strong written and spoken English
Nice to have:
Certifications in Azure data or Cloud Services (e.g., Azure Data Engineer Associate)
Business understanding of the insurance or financial domain
Experience with BI Tools (Power BI)
We offer:
Private health insurance (including dental insurance)
EPAM Group life assurance
Wellness allowance
Employee assistance program
Corporate Programs including Employee Referral Program with rewards
Learning and development opportunities including in-house training and coaching, professional certifications, over 22,000 courses on LinkedIn Learning Solutions and much more
*All benefits and perks are subject to certain eligibility requirements