COLLABORATION: Collaborates with traders, analysts, and other cross functional teams to gather requirements and deliver needed solutions ensuring technical solutions aligned with business goals, participates in agile practices like standups and sprint planning for effective communication, and shares knowledge through code reviews to support learning and best practices, and explains technical concepts clearly to nontechnical team members.
TESTING & DEBUGGING: Partners to develop comprehensive test plans, including unit and integration tests, to validate functionality and performance, applying strong debugging skills to resolve software defects and maintain system integrity, performing moderately complex testing to ensure the system handles high transaction volumes, and collaborates with quality assurance teams members to ensure software meets standards before deployment.
CONTINUOUS IMPROVEMENT: Partners to sustain the commitment to improving system performance, scalability and reliability to ensure systems evolve with changing needs, staying current with industry trends and best in class standards, proactively suggesting improvements to development processes and tools, and integrating users and stakeholders feedback to refine software solutions.
DOCUMENTATION: Drafts and maintains technical documentation of moderately complex system architecture and development processes, drafting clear technical guides and operation manuals to facilitate ease of use, maintaining compliance with regulations and policies, and assisting with the knowledge base and onboarding and training new team members.
TECHNICAL SUPPORT: Monitors live trading systems for optimal performance, including addressing moderately complex real time issues promptly, responding quickly to resolve operational problems, minimizing downtime and risk, performing routine maintenance to keep systems secure and efficient, and supporting disaster recovery planning to ensure business continuity during system failures or crises.
Develop ETL/ELT pipelines with AWS tools (Glue, Step Functions, Lambda, DMS) and implement direct-to-Aurora ingestion strategies for snapshots and deltas. Ensure referential integrity, correct ordering, idempotency, and recovery, build monitoring, validation, and reconciliation frameworks. Manage scaling and throughput during EOD ingestion peaks.
Qualifications
Minimum requirement of 3 years of relevant work experience, typically reflecting 5+ years in data engineering, data integration, or related roles.
Proven track record of building resilient, idempotent ingestion frameworks.
Experiences in supporting high-volume, time-sensitive processing, especially EOD workloads
Strong operational mindset, including monitoring, alerting, and maintaining runbooks.
Required Skills
Mandatory
Expert-level SQL development and performance optimization
Strong proficiency in SQL and Python.
Hands-on experience with ETL pipelines and orchestration frameworks.
Solid understanding of ACID-compliant data ingestion principles.
Experience with schema evolution and CDC (Change Data Capture) patterns.
Experience owning production readiness and end-to-end solution delivery
Good to Have
Experience with SAP ODP or enterprise data replication technologies.
Familiarity with distributed PostgreSQL systems.
Exposure to event-driven architectures (e.g., Kafka).
Exposure to cloud-native architectures and AWS-based platforms
#Standard