Support orchestration and scheduling of pipelines using tools such as AWS Glue Workflows, Apache Airflow, or AWS Step Functions.
Participate in CI/CD implementation and code deployment processes using Git, AWS CodePipeline, and CodeBuild.
Apply best practices related to data governance, metadata management, security, and access control.
Support production issue resolution, ad hoc data requests, and continuous improvement of the data platform.
Required Skills and Qualifications
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related discipline.
3–4 years of experience in Data Engineering or a similar role.
Strong hands-on experience with AWS Databricks.
Good proficiency in PySpark and SQL for large-scale data processing.
Experience working with Delta Lake and modern lakehouse concepts.
Familiarity with AWS services such as Amazon S3, Amazon RDS, AWS Glue, AWS Lambda, and Amazon Redshift.
Knowledge of batch and streaming data architectures.
Experience with workflow orchestration, monitoring, and debugging of pipelines.
Understanding of version control and CI/CD practices.
Awareness of data security, governance, and metadata management principles.
Strong analytical, problem-solving, and communication skills.
Preferred Qualifications
Experience in building data pipelines in enterprise-scale cloud data platforms.
Familiarity with real-time / streaming frameworks and event-driven architectures.
Exposure to data quality frameworks, reconciliation processes, and operational monitoring.
Working knowledge of infrastructure automation and cloud deployment best practices.
Experience collaborating in agile delivery environments.
Key Competencies
Strong problem-solving orientation
Attention to detail and focus on data quality
Ability to work in a fast-paced, collaborative environment
Good stakeholder communication and coordination skills
Ownership mindset with a focus on delivery excellence
Nice to Have
Experience with data modeling and analytics enablement
Exposure to DevOps and platform engineering practices
Certification in AWS or Databricks technologies
Why Join Us
This role offers the opportunity to work at the forefront of cloud-based data engineering, partnering with talented data scientists, analysts, and architects to build scalable, high-impact data solutions on AWS Databricks.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
