Implement and enforce security best practices, including encryption, network controls, and data access policies.
Collaborate with security and compliance teams to ensure adherence to organizational and regulatory requirements.
Support implementation of data governance standards (e.g., Unity Catalog, catalogs, schemas, tables, and permissions).
Performance & Cost Optimization
Optimize cluster configurations, autoscaling, and job scheduling to balance performance and cost.
Analyze usage metrics and costs; implement strategies for cost control and chargeback/showback where applicable.
Recommend and implement platform tuning and optimization strategies for large-scale data workloads.
Collaboration & Support
Partner with data engineers, analysts, and data scientists to understand workload requirements and recommend best practices in Databricks usage.
Provide Tier 2/3 support for Databricks-related incidents and service requests.
Develop and maintain platform documentation, runbooks, and standard operating procedures.
Conduct user onboarding, training, and knowledge-sharing sessions on Databricks capabilities and best practices.
Automation & DevOps
Automate workspace and cluster provisioning, configuration, and policy enforcement using Infrastructure as Code (e.g., Terraform, ARM/Bicep, CloudFormation).
Integrate Databricks with CI/CD pipelines for code deployment and environment management.
Support version control best practices for notebooks, jobs, and configuration.
WHAT YOU’LL NEED TO SUCCEED
Bring your expertise and drive for innovation to GDIT.
Education
Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.
Alternative Path: If the candidate does not possess a relevant four-year degree, an additional four years of relevant work experience will be required.
Required Experience
8+ years of experience administering cloud-based data platforms or big data environments.
