Website Marc Ellis
Job Details
Job Position – Data Engineer
Company Name – Marc Ellis
Location: Abu Dhabi
Job Type: 6 months extendable
Responsibilities:
•Experience with handling large volumes of unstructured data (TBs ideally), looking for proficiency beyond structured databases like MySQL.
•Expeience with various tools such as Kibana, Power BI, and optionally, Neo4j for graph visualization.
•Knowledge in diverse data science techniques including topic modeling, clustering, classification, regression, and time-series analysis.
•Expert level of proficiency in Python programming.
•Must have managed large scale of data, both in terms of storage (GBs) and records/files (multi-million) as the role involves handling TBs of data
•Oversee and manage architecture on Azure platform for efficient data operations.
•Experience in working with audio, video, or image data
•Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
•Manage and optimize data storage solutions, including relational databases, Search Engines like Elasticsearch and NoSQL databases, to support the requirements of machine learning models.
•Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
•Proficiency in managing Azure infrastructure, (good to have – with cloud platforms like AWS, GCP)
Requirements:
•Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience
•3+ years of experience in a Data Engineering role.
•Extensive experience in handling unstructured data.
•Proficiency in dashboarding tools like Kibana, Power BI, and potentially Neo4j.
•Knowledge / skills in various data science techniques and NLP.
•Advanced Python programming skills.
•Familiarity with Hugging Face models.
•Experience in handling large-scale data, including multimedia data.
•Knowledge of multi-node clusters, multi-processing, and relevant libraries.
•Optional experience in Pyspark and big data handling.
Email : Nadja@marc-ellis.com
To apply for this job email your details to Nadja@marc-ellis.com