Data Engineer Senior Consultant

Short Description

Data Engineer

We are seeking a skilled and experienced Data Engineer to join our dynamic team. As a Data Engineer, candidate will play a critical role in designing, building, and maintaining our data infrastructure to support our growing data needs. Your expertise in SQL, Python, ETL, cloud technologies (Azure, AWS, GCP), and DevOps will be essential in streamlining our data operations and driving efficiency across the organization. 

Qualifications

Bachelor's degree in Computer Science, Information Systems, or a related field.

Job Responsibilities

• Minimum 4 years of relevant experience in data engineering, including strong experience with SQL, Python and PySpark.
• Strong Experience in any ETL tool like Informatica, DataStage, Alteryx, Talend, etc.
• Expertise in writing complex SQL and PL SQL queries.
• Proficiency in at least one of the cloud technologies: Azure, AWS, or GCP.
• Experience in API integration- REST API would be a big plus
• Experience in any job scheduling tool e.g. Control M, Autosys, Airflow Luigi would be a big plus
• Experience in complex ETL mappings, CI CD pipelines, dev ops and deployment tools e.g. Docker, Jenkins etc. would be a big plus
• At-least 2 full life cycle implementations experience from conceptualization, design, architecture to delivery

• Strong hands-on experience on AWS or Azure (E.g. Amazon Athena, Amazon EMR, Amazon Redshift, Amazon Kinesis, Amazon Elasticsearch      Service, AWS Glue, Quick sight, Azure Synapse, Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Power BI)
• Solid understanding of data modeling concepts and experience with data warehousing and dimensional modeling.

• Guide architectural choices using various cloud services and solution methodologies.
• Understand existing architecture and develop plans to support the growth in the cloud adoption.
• Must understand networking, security, design principles and best practices in cloud.
• Perform POC's on tools and provide recommendations to solve specific business needs