jobTitle

skills

Senior Data Engineer

<h3><strong>Job Title:</strong> Senior Data Engineer – Hadoop</h3><div><strong>Location:</strong>  Pittsburgh, PA /Cleveland,OH</div><div> <strong>Department:</strong> Enterprise Data &amp; Analytics</div><div> <strong>Employment Type:</strong> Full-time</div><h3><strong>Job Summary:</strong></h3><div>PNC Bank is seeking a highly skilled <strong>Senior Data Engineer</strong> with extensive experience in <strong>Hadoop-based big data ecosystems</strong>. As part of our Enterprise Data &amp; Analytics team, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support advanced analytics and business intelligence initiatives. You will work with cross-functional teams to enable data-driven decision-making across the organization.</div><h3><strong>Key Responsibilities:</strong></h3><div>Design, build, and optimize large-scale data pipelines using Hadoop and related technologies (Hive, Pig, HDFS, Spark, Sqoop, etc.).</div><div>Collaborate with data architects and business stakeholders to understand data requirements and translate them into scalable data solutions.</div><div>Implement data integration and ETL processes from diverse sources into Hadoop data lake environments.</div><div>Ensure data quality, data security, and governance standards are upheld across systems.</div><div>Troubleshoot and resolve issues in complex data environments.</div><div>Monitor and maintain performance, availability, and reliability of big data platforms.</div><div>Mentor junior engineers and contribute to the development of best practices and engineering standards.</div><div>Collaborate with DevOps to support CI/CD and automation processes.</div><h3><strong>Required Qualifications:</strong></h3><div>Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.</div><div>5+ years of experience in data engineering, with a strong focus on Hadoop ecosystem tools.</div><div>Strong programming skills in <strong>Python</strong>, <strong>Java</strong>, or <strong>Scala</strong>.</div><div>Deep understanding of <strong>HDFS</strong>, <strong>Hive</strong>, <strong>Spark</strong>, <strong>Sqoop</strong>, and <strong>Kafka</strong>.</div><div>Experience with workflow orchestration tools such as <strong>Apache Airflow</strong> or <strong>Oozie</strong>.</div><div>Proficient in <strong>SQL</strong> and working with relational and non-relational databases.</div><div>Experience working in <strong>cloud environments</strong> (AWS/GCP/Azure) is preferred.</div><div>Familiarity with data governance and security compliance in the financial services industry.</div><div><br></div>