**Please strictly adhere to the following resume naming convention:
ALL CAPS, NO SPACES BETWEEN UNDERSCORES
PTN_US_GBAMSREQID_CandidateBeelineID
Example: PTN_US_9999999_SKIPJOHNSON0413
: -
MSP Owner: Michelle Lee
Location: Lake City, WA
Duration: 6 months
skill id: 10878876
Role Description
• Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
• Build and optimize ETL/ELT processes for large-scale structured and unstructured data.
• Develop data transformation and processing frameworks using Java and Spark.
• Write complex SQL queries, stored procedures, and performance-tuned data solutions.
• Integrate data from multiple sources into enterprise data lakes and data warehouses.
• Monitor, troubleshoot, and optimize data processing jobs for performance and reliability.
• Implement data quality, governance, and security standards.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Support CI/CD deployment and automation of data engineering workflows.
Required Skills
Data Engineering
• Azure Databricks
• Apache Spark
• Data pipeline design, development, and maintenance
• ETL/ELT processes
• Large-scale structured and unstructured data processing
Programming & Development
• Java
• Data transformation and processing frameworks using Java and Spark
Database & SQL
• SQL
• Complex SQL queries
• Stored procedures
• Performance-tuned data solutions
Data Integration
• Integration of data from multiple sources
• Enterprise data lakes
• Enterprise data warehouses
Operations & Optimization
• Data processing job monitoring
• Troubleshooting
• Performance optimization
• Reliability optimization
Data Governance & Security
• Data quality standards
• Data governance standards
• Data security standards
DevOps
• CI/CD deployment
• Automation of data engineering workflows
Collaboration
• Collaboration with business stakeholders
• Collaboration with data architects
• Collaboration with analytics teams
• Translation of business requirements into technical solutions
Candidate Profile
• We are seeking a skilled Data Engineer with strong expertise in Azure Databricks, Apache Spark, SQL, and Java to design, build, and maintain scalable data pipelines and data processing solutions.
• The ideal candidate will work closely with business stakeholders, data architects, and analytics teams to support enterprise data initiatives and enable data-driven decision-making.
Skills: Digital : Microsoft Azure ~ Digital : Databricks ~ Core Java
Experience Required: 6-8
ALL CAPS, NO SPACES BETWEEN UNDERSCORES
PTN_US_GBAMSREQID_CandidateBeelineID
Example: PTN_US_9999999_SKIPJOHNSON0413
: -
MSP Owner: Michelle Lee
Location: Lake City, WA
Duration: 6 months
skill id: 10878876
Role Description
• Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
• Build and optimize ETL/ELT processes for large-scale structured and unstructured data.
• Develop data transformation and processing frameworks using Java and Spark.
• Write complex SQL queries, stored procedures, and performance-tuned data solutions.
• Integrate data from multiple sources into enterprise data lakes and data warehouses.
• Monitor, troubleshoot, and optimize data processing jobs for performance and reliability.
• Implement data quality, governance, and security standards.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Support CI/CD deployment and automation of data engineering workflows.
Required Skills
Data Engineering
• Azure Databricks
• Apache Spark
• Data pipeline design, development, and maintenance
• ETL/ELT processes
• Large-scale structured and unstructured data processing
Programming & Development
• Java
• Data transformation and processing frameworks using Java and Spark
Database & SQL
• SQL
• Complex SQL queries
• Stored procedures
• Performance-tuned data solutions
Data Integration
• Integration of data from multiple sources
• Enterprise data lakes
• Enterprise data warehouses
Operations & Optimization
• Data processing job monitoring
• Troubleshooting
• Performance optimization
• Reliability optimization
Data Governance & Security
• Data quality standards
• Data governance standards
• Data security standards
DevOps
• CI/CD deployment
• Automation of data engineering workflows
Collaboration
• Collaboration with business stakeholders
• Collaboration with data architects
• Collaboration with analytics teams
• Translation of business requirements into technical solutions
Candidate Profile
• We are seeking a skilled Data Engineer with strong expertise in Azure Databricks, Apache Spark, SQL, and Java to design, build, and maintain scalable data pipelines and data processing solutions.
• The ideal candidate will work closely with business stakeholders, data architects, and analytics teams to support enterprise data initiatives and enable data-driven decision-making.
Skills: Digital : Microsoft Azure ~ Digital : Databricks ~ Core Java
Experience Required: 6-8