Job Summary
We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Python Databricks SQL Databricks Workflows and PySpark. This role operates in a hybrid work model with day shifts offering the opportunity to work on innovative projects that drive our companys success.
Responsibilities
Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities.Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations.Optimize Databricks SQL queries to improve data retrieval performance and ensure efficient data management.Provide technical expertise in Python programming to support the development of robust data solutions.Oversee the integration of data sources into Databricks environments to facilitate seamless data processing.Ensure data quality and integrity by implementing best practices in data validation and error handling.Troubleshoot and resolve complex technical issues related to Databricks and PySpark environments.Contribute to the continuous improvement of data processing frameworks and methodologies.Mentor junior developers and provide guidance on best practices in data engineering.Collaborate with stakeholders to gather requirements and translate them into technical specifications.Conduct code reviews to ensure adherence to coding standards and best practices.Stay updated with the latest industry trends and technologies to drive innovation in data engineering.Document technical processes and workflows to support knowledge sharing and team collaboration.Qualifications
Possess a strong proficiency in Python programming and its application in data engineering.Demonstrate expertise in Databricks SQL and its use in optimizing data queries.Have hands-on experience with Databricks Workflows for efficient data processing.Show proficiency in PySpark for developing scalable data solutions.Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.Have a solid understanding of data integration techniques and best practices.Display strong communication skills to collaborate effectively with cross-functional teams.Certifications Required
Databricks Certified Data Engineer Associate Python Institute PCEP Certification
