isCompletedInterview

jobTitle

location

productDomainEngineering

skills

yearsOfExperience

Lead Java PySpark Developer

Incedo is an equal opportunity employer and values diversity at all levels. We are committed to creating an inclusive environment for all employees.

Lead Java Developer

<h3>Lead Java Developer with PySpark</h3><div><strong>Location:</strong> Dallas, TX / Pittsburgh, PA / Cleveland, OH</div><div><strong>Workplace Type:</strong> Hybrid (depending on location)</div><div><br></div><h3>About the Role</h3><div>We are seeking a highly experienced Lead Java Developer with expertise in Apache Spark (PySpark) to join a critical data engineering and backend development initiative at Incedo. The ideal candidate will lead a team of engineers in designing and implementing scalable backend solutions, integrating with large-scale data pipelines. This role requires a strong understanding of Java development, Spring Boot, REST APIs, and microservices architecture, coupled with proficiency in PySpark for distributed data processing. The Lead Java Developer will be responsible for guiding the team in building robust, efficient, and scalable data processing pipelines and backend services. They will collaborate closely with Data Engineers, Architects, and DevOps teams to ensure seamless data flow and platform stability. The candidate should possess excellent problem-solving, communication, and leadership skills, with a proven track record of mentoring junior developers and delivering high-quality solutions in an Agile environment. Experience in the Banking/Financial Services domain is highly desirable, as is familiarity with cloud platforms like AWS or Azure. This is an excellent opportunity to lead a team and make a significant impact on a critical data initiative.</div><div><br></div><h3>Key Responsibilities</h3><ul><li>Lead the design and development of scalable backend services using Java and Spring Boot.</li><li>Develop batch and real-time data processing pipelines using PySpark on Apache Spark.</li><li>Work closely with Data Engineers, Architects, and DevOps teams to ensure smooth data flow and platform stability.</li><li>Optimize and tune performance of Java applications and PySpark jobs.</li><li>Implement and enforce best practices in code quality, testing, and deployment.</li><li>Participate in Agile ceremonies and work closely with business stakeholders to deliver solutions.</li><li>Mentor junior developers and review code to ensure maintainability and performance.</li><li>Contribute to the overall architecture and design of the data platform.</li><li>Ensure adherence to security and compliance standards in all development activities.</li><li>Troubleshoot and resolve complex technical issues related to Java applications and PySpark pipelines.</li></ul><div><br></div><h3>Required Skills &amp; Qualifications</h3><ul><li>10+ years of hands-on experience in Java development (Java 8+).</li><li>Strong experience with Spring Boot, REST APIs, and Microservices.</li><li>Proficient in PySpark and distributed data processing using Apache Spark.</li><li>Hands-on experience with Hadoop Ecosystem, HDFS, and Hive.</li><li>Experience working with Kafka for data streaming.</li><li>Strong knowledge of SQL, data modeling, and performance tuning.</li><li>Exposure to CI/CD pipelines, Docker, and Kubernetes is a plus.</li><li>Excellent problem-solving, communication, and leadership skills.</li><li>Bachelor's or Master’s Degree in Computer Science, Engineering, or related field.</li><li>Experience with version control systems (e.g., Git).</li></ul><div><br></div><h3>Additional Information</h3><div>This position offers a competitive salary and benefits package, including health insurance, paid time off, and opportunities for professional development. Experience in Banking / Financial Services domain and familiarity with AWS / Azure cloud platforms are preferred. Exposure to tools like Airflow, Databricks, or Snowflake is a plus. The successful candidate will be a self-starter with a passion for technology and a desire to contribute to a dynamic and growing team. Incedo is an equal opportunity employer and values diversity at all levels. We are committed to creating an inclusive environment for all employees. The role may require occasional travel to client sites or other company locations. The specific work arrangement (Onsite/Hybrid/Remote) will depend on the chosen location (Dallas, TX / Pittsburgh, PA / Cleveland, OH) and company policy.</div>