Company: PSA Corporation
Data Engineer
You will work in the Data Engineering and Management team of Insights and Analytic Department (InAD) to:
Design and Develop the API /Web Services framework for curation of new datasets whether internal or external (Internet), and to interface with other systems (both internal and external)
Design, Develop, Test, Deploy and Maintain web-based data applications launched on the Microsoft Azure cloud
Develop, Test, Deploy and Maintain data pipelines (ETL) on Enterprise Data Platform (Big Data technologies) and InAD’s on-premise or Microsoft Azure cloud-based servers
Explore and source new data sets to address emerging business use case needs
Requirements:
Possess a good Bachelor’s degree in Computer Science or Computer Engineering; a Specialization in Software Engineering will be advantageous.
Those with 2-3 years of related work experience will be preferred
Good grasp of Software Engineering principles such as Requirements Gathering (both functional and non-functional), Modular & Re-usable Design.
Proficient in ETL using programming language /tools such as Python and/or SSIS and/or Informatica Power Centre
Able to develop data applications including integration with ICT systems, build APIs and web applications via .NET, Java and/or Python
Familiarity with MS SQL, PostgreSQL or Oracle is preferred.
There will an added advantage for any of the following:
Experience in designing and building scalable database schema for applications.
Understanding of Object-Oriented Design.
Knowledge of or prior work experience on Big Data platforms such as Hadoop or using Spark.
Experience in the cloud environment setup using Microsoft Azure