Top Skills' Details

• Strong BQ and Databricks data engineering experience
• Strong SQL / data engineering fundamentals
• PySpark and Databricks notebook development
• Ideally, experience building BigQuery-to-Databricks data replication / ingestion pipelines
• Experience with BigQuery authorized views and federated connections
• Strong understanding of Apache Iceberg, preferably Databricks-managed Iceberg / Unity Catalog
• Experience with large-scale data movement, incremental replication, performance tuning and optimization

Secondary Skills - Nice to Haves

Job Description

Our customer has an immediate need to bring on 4-6 onshore contractor resources to support a high-priority BigQuery-to-Databricks replication effort. They are looking to move quickly, so please start sending qualified candidates as soon as possible. The work will support the replication of enterprise data currently housed in BigQuery into Databricks. For these roles, they would like candidates with direct, hands-on experience with this type of replication path, ideally specifically BigQuery → Databricks.
Key skills we are looking for:
• Strong BQ and Databricks data engineering experience
• Strong SQL / data engineering fundamentals
• PySpark and Databricks notebook development
• Ideally, experience building BigQuery-to-Databricks data replication / ingestion pipelines
• Experience with BigQuery authorized views and federated connections
• Strong understanding of Apache Iceberg, preferably Databricks-managed Iceberg / Unity Catalog
• Experience with large-scale data movement, incremental replication, performance tuning and optimization
• Experience with orchestration and productionizing Databricks jobs is a plus

Additional Skills & Qualifications

Experience with orchestration and productionizing Databricks jobs is a plus

Employee Value Proposition (EVP) Opt to support large Fortune 500 company in large replication project