Business Function
Middle Office Technology (MOT) works hand-in-glove with the Bank’s middle office units to protect and manage risks & controls, financials, and regulations, enabled by purpose-built innovative solutions. The Risk Platform team focuses on developing robust data processing pipelines, risk engines, and analytical platforms using advanced big data and distributed processing technologies to support enterprise risk management, regulatory compliance, and data-driven decision-making across DBS.
Job Responsibilities
Create Scala/Spark/Pyspark jobs for data transformation and aggregation
Produce unit tests for Spark transformations and helper methods
Use Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API.
Develop an application by using Hadoop tech stack and deliver effectively, efficiently, on-time, in-specification and in a cost-effective manner.
Work closely with Business Analysts team to review the test results and obtain sign off
Prepare necessary design/operations documentation for future usage Perform peer reviews
Code quality review and be gatekeeper for quality checks Hands-on coding, usually in a pair programming environment
Working in highly collaborative teams and building quality code
Ensure smooth production deployments as per plan and post-production deployment verification.
Job Requirements
The candidate must exhibit a good understanding of data structures, data manipulation, distributed processing, application development, and automation.
Show the full description
Familiar with Oracle, Spark streaming, Kafka, ML.
Tech stack: Hadoop, Spark, Scala, Java, Hive, Impala, CI/CD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution.
Strong Knowledge in data warehousing Methodology
Strong problem-solving skills, ability to manage deliverables within desired timeframes, and effective communication skills.
Location
DBS Asia Hub
Job
Technology
Schedule
Regular
Employee Status
Full time