Terraform/IaC Validation Engineer Job at Openkyber, New York, NY

c0REcFhVajJCWkk2ZmU1WUFtRU01ckFVemc9PQ==
  • Openkyber
  • New York, NY

Job Description

No C2C, No 1099

Job Title: Azure Data Engineer (only W2)

Location : Cincinnati, OH (3 days on-site required)

Duration: 1 Year Contract (potential for conversion/extension)

The team is seeking a Data Engineer experienced in implementing modern data solutions in Azure, with strong hands-on skills in Databricks, Spark, Python, and cloud-based DataOps practices. The Data Engineer will analyze, design, and develop data products, pipelines, and information architecture deliverables, focusing on data as an enterprise asset. This role also supports cloud infrastructure automation and CI/CD using Terraform, GitHub, and GitHub Actions to deliver scalable, reliable, and secure data solutions.

Key Responsibilities

  • Analyze, design, and develop enterprise data solutions with a focus on Azure, Databricks, Spark, Python, and SQL
  • Develop, optimize, and maintain Spark/PySpark data pipelines, including managing performance issues such as data skew, partitioning, caching, and shuffle optimization
  • Build and support Delta Lake tables and data models for analytical and operational use cases
  • Apply reusable design patterns, data standards, and architecture guidelines across the enterprise, including collaboration with 84.51 when needed
  • Use Terraform to provision and manage cloud and Databricks resources, supporting Infrastructure as Code (IaC) practices
  • Implement and maintain CI/CD workflows using GitHub and GitHub Actions for source control, testing, and pipeline deployment
  • Manage Git-based workflows for Databricks notebooks, jobs, and data engineering artifacts
  • Troubleshoot failures and improve reliability across Databricks jobs, clusters, and data pipelines
  • Apply cloud computing skills to deploy fixes, upgrades, and enhancements in Azure environments
  • Work closely with engineering teams to enhance tools, systems, development processes, and data security
  • Participate in the development and communication of data strategy, standards, and roadmaps
  • Draft architectural diagrams, interface specifications, and other design documents
  • Promote the reuse of data assets and contribute to enterprise data catalog practices
  • Deliver timely and effective support and communication to stakeholders and end users
  • Mentor team members on data engineering principles, best practices, and emerging technologies

Requirements

  • 7+ years of experience as a Data Engineer
  • Hands-on experience with Azure Databricks, Spark, and Python
  • Experience with Delta Live Tables (DLT) and Databricks SQL
  • Strong SQL and database background
  • Experience with Azure Functions, messaging services, or orchestration tools
  • Familiarity with data governance, lineage, or cataloging tools (e.g., Purview, Unity Catalog)
  • Experience monitoring and optimizing Databricks clusters or workflows
  • Experience working with Azure cloud data services and understanding how they integrate with Databricks and enterprise data platforms
  • Experience with Terraform for cloud infrastructure provisioning
  • Experience with GitHub and GitHub Actions for version control and CI/CD automation
  • Strong understanding of distributed computing concepts (partitions, joins, shuffles, cluster behavior)
  • Familiarity with SDLC and modern engineering practices
  • Ability to balance multiple priorities, work independently, and stay organized

Job Tags

Contract work,

Similar Jobs

Akraya Inc

UX/UI Designer II Job at Akraya Inc

 ...Primary Skills: HTML, User-Centered Design, Interface Design, UX Design, Product Development Job Title: UX/UI Designer II Contract Type: W2 Only Duration: 6 Months (Possible Extension) Location: Mountain View, CA Pay Rate: $60.23 - $64.52 /... 

OTSI

Field Services Job at OTSI

 ...OTSI) has an immediate opening for Field Services Field Services ( onsite)...  ...other network & IT equipment. Power Management: Work with power feeds, including redundancy...  ...& Media Entertainment, Engineering & Telecom, Retail & Consumer Services, Hi-tech,... 

Hotze Health and Wellness Center

Entry Level - Pharmacy Technician - Compounding Lab Job at Hotze Health and Wellness Center

 ...Job Description The ultimate goal of the Compounding Pharmacy Technician is to provide extraordinary hospitality and guest experiences by preparing the highest quality compounds according to our standard operating procedures. Responsibilities include, but are not limited... 

David's Bridal

Seamstress Sewing Specialist Job at David's Bridal

 ...this job, the employee is occasionally required to stand, walk, and sit for extended periods of time; reach for tools and objects with hands and arms; climb stairs; stoop, kneel, crouch, or crawl; ability to bend, twist and stand; move throughout the store; and talk to and... 

United Land Services

Small Engine Mechanic Job at United Land Services

 ...developments to condominium complexes, commercial buildings, and shopping centers. Job Description: A small engine mechanic builds, maintains, and repairs small engines. Including lawn mowers, weed whackers, and chainsaws. If you have a knack for problem-solving...