Jobs / Remote data in the United States / Princeton IT Services
Data Engineer - AI
Posted 1 day ago
Apply on the original posting ↗You'll apply on the original posting. We keep this job in your tracker so you never lose the thread.
Data Engineer (AI & Data)
Job Title: Data Engineer
Work Arrangement: 100% Remote
Job Type : Contract
Job Summary
We are seeking an experienced Data Engineer with strong expertise in Databricks, PySpark, SQL, and Delta Lake to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have hands-on experience building ETL/ELT pipelines, processing large-scale datasets, and optimizing data workflows across cloud environments.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, and SQL.
- Build data ingestion and transformation frameworks for large-volume structured and semi-structured datasets.
- Implement Delta Lake patterns, data quality validations, exception handling, and data reconciliation processes.
- Optimize Spark jobs and SQL queries for performance, scalability, and cost efficiency.
- Work with Unity Catalog for data governance, access control, and data management.
- Develop and manage workflows using Azure Data Factory (ADF) and Databricks Workflows.
- Implement CI/CD practices for data pipeline deployment and management.
- Collaborate with data analysts, architects, and source-system teams to deliver reliable and high-quality data products.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks, PySpark, and SQL.
- Expertise in Delta Lake, ETL/ELT, and large-scale data processing.
- Experience with Unity Catalog and data governance.
- Working knowledge of Azure/AWS cloud platforms.
- Experience with Azure Data Factory (ADF) and Databricks Workflows.
- Knowledge of CI/CD processes and pipeline deployment.
- Strong understanding of Spark performance tuning and optimization.
- Excellent problem-solving and analytical skills.
Preferred Qualifications
- Experience working with healthcare or life sciences data.
- Knowledge of data quality frameworks and reconciliation processes.
- Experience building enterprise-scale data pipelines and curated data products.
Pay: $60.00 - $65.00 per hour
Experience:
- Data engineer: 10 years (Required)
- AI: 4 years (Required)
- ETL: 8 years (Required)
- Databricks: 8 years (Required)
- pyspark: 8 years (Required)
Work Location: Remote
About this listing
Verified live 1 day ago
Removed when the employer takes it down
No resume yet? Fix that first
Build a free, recruiter-ready resume in minutes, then tailor it to this job in one tap.
Create a free resume