Orange recruits 01 Lead data lake

LEAD, DATA LAKE

Ref : CEGY399 | 24 févr. 2020

Date limite de candidature : 24 mars 2020

Telecom orange egypt smart village – Egypt

Leaflet

Votre rôle

As a data engineer you’ll work as s a Big Data Developer, you will be working on Data Ingestion activities to bring large volumes of data  into our Big Data Lake. The candidate will play a vital role in building new data pipelines from various structured and unstructured sources into Hadoop. You will be working closely with data consumers and source owners to inject data for data analytics and machine learning activities.

Identifying data ingestion patterns and build framework to efficiently ingest the data to our Data Lake

Write scripts for CI/CD processes to automate build, test and deployment framework

Build algorithms, prototypes, and proof of concepts

Research opportunities for data acquisition and new uses for existing data

Develop data set processes for data modeling, mining and production

Use current data management technologies and software engineering tools

Collaborate with data architects, modelers and IT team members on project goal

Votre profil

Bachelor degree of Engineering in Computer Systems, or Computer Science.

2+ years working with Java based applications and open source technologies

2+ years data engineering experience supporting high-volume, high-velocity data streams.

Prior experience in working with Hadoop technologies such as HBase, Hive, Spark is a plus

Prior experience with relational databases such as MS SQL, Oracle and DB2

Knowledge and understanding of SDLC and Agile/Scrum procedures, CI/CD and Automation is required

Ability to use containers like dockers or kubernettes is a plus

Ability to write SQL queries and use tools such as Hadoop, Tableau, QlikView, and other data reporting tools. Experience in transactional and data warehouse environments using MySQL, Hive, or other database systems. Must deeply understand joins, subqueries, window functions, etc.

Strong background in working with relational databases like Postgres and NoSQL database like Mongo DB or Cassandra

Very good English both written & spoken.

Good computer skills.

Past experience in telecom operators and service providers is preferred

Good knowledge of database systems and BI solutions

Good programming and debugging skills.

Good problem solving skills.

Ability to administer different hardware and operating system solutions.

Entité

Transformation & Operational Efficiency

Contrat

Regular