Senior Data Engineer

Job Details

Senior Data Engineer

Why Should You Apply For The Job

-

Worked in top multi-national company (MNC) with fast growing pace during pandemic.
Great exposure to MNC culture, processes, and methodology.
Good remuneration and benefits.

Job Description

-

We are seeking for an enthusiastic Senior Data Engineer to join our team. You will investigate, analyse and record all or part of a business in a systematic approach. You will also define architecture requirements and create viable specifications of the processes and systems.

You are required to manage architecture-related communication inside the organisation.

Responsibilities:

Work with people responsible for architectural communication in all regions of IT Services and in DP DHL Business divisions
Communicate all important news to the architectural community effectively
Analyze public events regarding IT architecture and bring them to the attention of the members of the team
Mapping data sources: An understanding of where data is stored and maintained. Although the application teams are responsible for documenting the details of application data, you must know where data is maintained and accessed.
Defining integrative views of data: These views will draw together data from across the domains. Some views will use a database of extracted data – others will bring together data in “near real time.” You will work with business people and data engineers and application designers to identify and model these integrative views and determine the quality of service requirements — data currency, availability, response times and data volumes.
Analyzing business and system requirements, and define optimal data strategy of fulfilling them
Designing and implementing data acquisition strategies. Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets

APPLICATION YOU WILL USE

Azure related Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Azure Stream Analytics, Azure Data Factory, Azure Data Lake Storage (ADLS) Gen2
Hadoop Distributed File System (HDFS) with Hadoop distributions (Cloudera or MapR)
Fundamental Data Modelling experience at enterprise level
Apache skills include Kafka, Apache Spark Streaming, Apache Spark, Apache Flink (java, Scala)
Python scripting
Outstanding knowledge of SQL, procedural SQL (PL/SQL & T-SQL)
Extract/load/transform (ELT) process
Data architect experience
Hands-on experience with Snowflake (Development & Configuration)

Requirements

-

8 years of experience in software engineering with relevant qualifications in IT field and methods including formal methods (e.g. Prince 2)
Experience in the field of Business Systems Analysis, Business Performance and Analysis

Experience in Business, Data, Technical Architecture and leveraging tools
Minimum 5 years of professional experience with Data Management technologies and a minimum of 3 years of Hadoop, NoSQL, and Open-Source data management technologies.

Inquisitive and analytical minded
Proven ability to manage non-direct reports to achieve results and to work in a multi-cultural multi-functional environment where consensus is critical for success
Customer and end-user focused and have excellent oral and written communications skills

About The Company

-

Our client is world renowned and established multinational company in the logistic industry with a strong presence in Malaysia.

About TalentTag Recruitment

TalentTag Recruitment is an IT specialist recruitment division of Agensi Pekerjaan ELS Sdn Bhd (808430-P and JTKSM 076A) (“ELS”). ELS is an award-winning recruitment firm with more than a decade of proven track record in recruitment. In 2019, ELS took home the Gold Prize for “The Best Executive Search Firm of HR Vendors of the Year Awards 2019”.

Kindly visit www.talenttag.asia to view more IT-related jobs.