Standard Job Description
Delivers full-stack data solutions across the entire data processing pipeline. This relies on systems engineering principles to design and implement solutions that span the data lifecycle to: collect, ingest, process, store, persist, access, and deliver data at scale and at speed. It includes knowledge of local, distributed, and cloud-based technologies; data virtualization and smart caching; and all security and authentication mechanisms required to protect the data.Build data pipelines that clean, transform, and aggregate unorganized data into databases or data sources that are ready for analysis; Design and implement data solutions by defining functional capabilities, security, back-up, and recovery specifications; Work through all stages of a data solution lifecycle, e.g., analyze / profile data, create conceptual, logical and physical data model designs, architect and design ETL, reporting and analytics; Maintain data systems performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; Define standards, best practices, and certification processes for data objects
Basic Qualifications
- Bachelor’s degree in Artificial Intelligence, Computer Science, Information Systems, Data Engineering, or a related field (Master’s preferred).
- Data mining and data warehousing principles.
- Database management systems, query languages, table relationships, and views.
- Proficiency with Hadoop, Java, Python, SQL, Hive, and PIG for data exploration.
- DataOps processes and best practices.
- Data security roles and responsibilities; ability to implement access control and encryption safeguards.
- Knowledge of how to collect, store, monitor, and validate test data.
- Ability to assess methodological limitations and recommend mitigation strategies.
Show the full description
Desired Skills
- IBM Cloud Pak for Data (CP4D) – Advanced
- Oracle / Microsoft SQL Server – Advanced (schema design, performance tuning)
- Microsoft Power BI Report Server – Proficient
- Deltek COBRA – Working knowledge
- Microsoft SharePoint – Working knowledge
- SAP S/4HANA– Working knowledge
- Teamcenter – Working knowledge
- Scripting – Python, PowerShell – Basic to intermediate (data extraction, automation)
- Data modeling & metadata management tools – Advanced
- ETL/ELT design (Informatica, Talend) – Preferred
- Cloud & distributed data platforms (AWS, Azure, GCP) – Preferred
- Experience with creation of Analytical Databases – Preferred
- Additional scripting – PERL, VBS (Windows/UNIX) – Basic