Azure Data Engineer

Job Description:

Key Responsibilities:
? Design, construct, install, test, and maintain highly scalable and robust data management
systems.
? Understand and apply data warehousing concepts to design and implement robust data
warehouse tables in line with business requirements.
? Build complex ETL/ELT processes for large-scale data migration and transformation across
platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.
? Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc
? Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets,
improve the performance, and enhance scalability of our data operations.
? Develop and implement Azure-based data architectures consistent across multiple projects
while adhering to best practices and standards.
? Lead initiatives for data integrity and normalization within Azure data storage and processing
environments.
? Evaluate and optimize Azure-based database systems for performance efficiency, reusability,
reliability, and scalability.
? Troubleshoot complex data-related issues within Azure and provide expert guidance and
support to the team.
? Ensure all data processes adhere to governance, data security, and privacy regulations.
Required Qualifications:
? Bachelor's degree in Computer Science, Information Technology, Engineering, or a related
field.
? 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data
engineer.
? Expertise in Python, SQL, and deep understanding of PySpark.
? Proficient in Databricks or similar big data solutions.
? Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.