Skip to content
Home » Data Engineer

Data Engineer

  • by

Fragma Data Systems

Data Engineer Jobs in Abu Dhabi

 

About the job

Primary Responsibilities:

• Responsible for developing and maintaining applications with PySpark

• Contribute to the overall design and architecture of the application developed and deployed.

• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.

• Interact with business users to understand requirements and troubleshoot issues.

• Implement Projects based on functional specifications.

Must-Have Skills: 

OVERALL EXPERIENCE SHOULD BE 10+ YEARS

• Good experience in Pyspark – Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs – Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skills

 

 

 

To apply for this job please visit www.linkedin.com.