Specialist - Data Engineering

Role description

Job Title: Big data Developer

Work Location : Tampa,florda

Job Summary

• Seeking a Specialist with 5 to 7 years of experience in the Big Data Hadoop Ecosystem to design develop and optimize largescale data solutions

Job Description

• Work extensively with the Big Data Hadoop Ecosystem to manage and process large datasets Utilize Hadoop components such as HDFS MapReduce and YARN for efficient data storage and processing Develop scalable data pipelines and workflows to support data analytics and business intelligence initiatives Collaborate with crossfunctional teams to integrate data from diverse sources Leverage Apache Spark and SparkSQL to improve data processing speed and efficiency Apply Python programming skills for data manipulation automation and scripting tasks Ensure data quality reliability and security across all data processes Stay updated with the latest advancements and trends in Hadoop and big data technologies

Roles and Responsibilities

• Design develop and maintain big data solutions using Hadoop Ecosystem components Optimize and tune Hadoop and Spark jobs to enhance performance and scalability Implement data ingestion transformation and aggregation processes Troubleshoot and resolve issues related to data processing and storage Collaborate with data scientists analysts and other stakeholders to gather and understand data requirements Develop and maintain comprehensive documentation for data workflows architecture and processes Mentor junior team members and provide technical guidance on big data technologies Participate in code reviews testing and deployment activities to ensure highquality deliverables