Establish data quality standards, perform data validation, and proactively identify and address data quality issues.
Optimize data pipelines and storage solutions to handle large volumes of data while maintaining high performance and reliability.
Ensure data privacy and security by implementing access controls, encryption, and compliance with data protection regulations.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure to support their needs.
Maintain comprehensive documentation for data pipelines, data models, and processes to facilitate knowledge sharing and troubleshooting.
Implement monitoring solutions to proactively detect and address data pipeline failures or performance bottlenecks.
Keep abreast of industry trends and emerging technologies in data engineering to recommend and implement improvements to our data infrastructure.
About the team
We are the Amazon DSP Analytics team, supporting all business pillars across the DSP organization horizontally, with the vision to enable data-, insights-, and science-driven decision-making. We are an exceptionally talented and fun-loving team. Here, you'll have the opportunity to dive deep into complex business and data problems, drive large-scale technical solutions, and raise the bar for operational excellence. We love sharing ideas and learning from each other, and we believe in using those ideas to disrupt the status quo.
2+ years of data engineering experience
Experience with SQL
Experience with data modeling, warehousing and building ETL pipelines
Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
Experience with one or more scripting language (e.g., Python, KornShell)
Knowledge of database, data warehouse, or data lake solutions
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Knowledge of basics of designing and implementing a data schema like normalization, relational model vs dimensional model
Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
Demonstrated experience leveraging generative AI tools to enhance workflow efficiency and productivity, with the ability to craft effective prompts and critically evaluate AI-generated outputs in a professional setting
Experience identifying opportunities to integrate AI solutions into products and services to drive business value
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.