Job Summary
We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus. This hybrid role requires working during the day shift with no travel obligations.
Responsibilities
Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store to enhance data accessibility and security.Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle ensuring seamless deployment and continuous integration.Utilize Python and PySpark to design and implement efficient data processing pipelines optimizing performance and reliability.Create and manage Databricks SQL queries to extract transform and load data supporting business intelligence and analytics initiatives.Oversee the execution of Databricks Workflows ensuring timely and accurate data processing to meet project deadlines.Provide technical expertise and support to team members fostering a collaborative and innovative work environment.Analyze complex data sets to identify trends and insights contributing to data-driven decision-making processes.Ensure data quality and integrity by implementing robust validation and error-handling mechanisms.Stay updated with the latest industry trends and technologies applying new knowledge to improve existing systems and processes.Collaborate with stakeholders to understand business requirements and translate them into technical specifications.Document technical designs processes and procedures to facilitate knowledge sharing and future reference.Support the development of data management strategies aligning with organizational goals and objectives.Contribute to the continuous improvement of development practices enhancing efficiency and effectiveness.Qualifications
Demonstrate proficiency in Databricks Unity Catalog Azure Data Lake Store and Azure DevOps.Exhibit strong programming skills in Python and PySpark for data processing and analysis.Possess experience in Databricks SQL and Workflows for data management and analytics.Have a background in Data Management Hedge Fund Accounting or Account Management as a plus.Show ability to work in a hybrid model with excellent communication and collaboration skills.Certifications Required
Databricks Certified Data Engineer Associate Microsoft Certified: Azure Data Engineer Associate
