Job Summary
We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Python Databricks SQL Databricks Workflows and PySpark. This role operates in a hybrid work model with day shifts offering the opportunity to work on innovative projects that drive our companys success.
Responsibilities
- Develop and maintain scalable data processing systems using Python and PySpark to enhance data analytics capabilities.
- Collaborate with cross-functional teams to design and implement Databricks Workflows that streamline data operations.
- Optimize Databricks SQL queries to improve data retrieval performance and ensure efficient data management.
- Provide technical expertise in Python programming to support the development of robust data solutions.
- Oversee the integration of data sources into Databricks environments to facilitate seamless data processing.
- Ensure data quality and integrity by implementing best practices in data validation and error handling.
- Troubleshoot and resolve complex technical issues related to Databricks and PySpark environments.
- Contribute to the continuous improvement of data processing frameworks and methodologies.
- Mentor junior developers and provide guidance on best practices in data engineering.
- Collaborate with stakeholders to gather requirements and translate them into technical specifications.
- Conduct code reviews to ensure adherence to coding standards and best practices.
- Stay updated with the latest industry trends and technologies to drive innovation in data engineering.
- Document technical processes and workflows to support knowledge sharing and team collaboration.
Qualifications
-
- Possess a strong proficiency in Python programming and its application in data engineering.
- Demonstrate expertise in Databricks SQL and its use in optimizing data queries.
- Have hands-on experience with Databricks Workflows for efficient data processing.
- Show proficiency in PySpark for developing scalable data solutions.
- Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
- Have a solid understanding of data integration techniques and best practices.
- Display strong communication skills to collaborate effectively with cross-functional teams.
Certifications Required
Databricks Certified Data Engineer Associate Python Institute PCEP Certification