Senior Data Tech Lead/Architect

<div><strong style="color: black;">Title:</strong><span style="color: black;">&nbsp;Senior Data Tech Lead/Architect – AWS | Kafka | | Glue Streaming; API consumption</span></div><div><strong style="color: black;">Location</strong><span style="color: black;">: Dallas, Texas (Preferred) Or Florham Park, New Jersey , NJ </span></div><div><strong style="color: black;">Full time </strong></div><div><span style="color: black;">&nbsp;</span></div><div><strong style="color: black;">About the Role:</strong></div><div><span style="color: black;">We are seeking a&nbsp;</span><strong style="color: black;">Senior Technical Lead</strong><span style="color: black;">&nbsp;/</span><strong style="color: black;">Architect</strong><span style="color: black;"> with strong expertise in&nbsp;</span><strong style="color: black;">AWS-based streaming data pipelines</strong><span style="color: black;">,&nbsp;</span><strong style="color: black;">Apache Kafka (MSK)</strong><span style="color: black;">,&nbsp;</span><strong style="color: black;">AWS Glue</strong><span style="color: black;">, </span><strong style="color: black;">Flink</strong><span style="color: black;">&nbsp;and&nbsp;</span><strong style="color: black;">PySpark</strong><span style="color: black;">, to help solution, design and implement a scalable data ingestion, data validation, data enrichment and reconciliation processing, and event logs, data observability, operational KPI tracking&nbsp;framework.</span></div><div><span style="color: black;">You will play a key role in solutioning and building out the&nbsp;, event driven capabilities with control gates in place to measure, track, and improve the operational SLAs and drive the&nbsp;</span><strong style="color: black;">data quality and reconciliation workflows</strong><span style="color: black;">&nbsp;for a high-impact data platform serving financial applications</span></div><div><span style="color: black;">&nbsp;</span></div><div><strong style="color: black;">Key Responsibilities:</strong></div><ul><li>Provide technical solution discovery effort on any new capabilities or new functionality.</li><li>Assist PO with technical user stories to ensure healthy backlog features </li><li>Lead the development of&nbsp;<strong>real-time data pipelines</strong>&nbsp;using&nbsp;<strong>AWS DMS</strong>,&nbsp;<strong>MSK</strong>, Kafka or Glue Streaming and&nbsp;<strong> </strong>for CDC ingestion from multiple SQL Server sources (RDS/on-prem).</li><li>Build and optimize&nbsp;<strong>streaming and batch data pipelines</strong>&nbsp;using&nbsp;<strong>AWS Glue (PySpark)</strong>&nbsp;to validate, transform, and normalize data to&nbsp;<strong>Iceberg and DynamoDB</strong>.</li><li>Define and enforce&nbsp;<strong>data quality, lineage, and reconciliation logic</strong>&nbsp;with support for both streaming and batch use cases.</li><li>Integrate with&nbsp;<strong>S3 Bronze/Silver layers</strong>&nbsp;and implement efficient&nbsp;<strong>schema evolution and partitioning strategies</strong>&nbsp;using Iceberg.</li><li>Collaborate with architects, analysts, and downstream application teams to design&nbsp;<strong>API and file-based egress</strong>&nbsp;layers.</li><li>Implement&nbsp;<strong>monitoring, logging</strong>, and&nbsp;<strong>event-based alerting</strong>&nbsp;using CloudWatch, SNS, and EventBridge.</li><li>Mentor junior developers and enforce best practices for modular, secure, and scalable data pipeline development.</li></ul><div><span style="color: black;">&nbsp;</span></div><div><strong style="color: black;">Required Skills:</strong></div><ul><li>6+ years of hands-on expert level data engineering experience in&nbsp;<strong>cloud-based environments</strong>&nbsp;(AWS preferred) with event driven implementation</li><li>Strong experience with&nbsp;<strong>Apache Kafka / AWS MSK</strong>&nbsp;including topic design, partitioning, and Kafka Connect/Debezium</li><li>Proficiency in&nbsp;<strong>AWS Glue (PySpark)</strong>&nbsp;and&nbsp;for both batch and streaming ETL</li><li>Working knowledge of&nbsp;<strong>AWS DMS</strong>,&nbsp;<strong>S3</strong>,&nbsp;<strong>Lake Formation</strong>,&nbsp;<strong>DynamoDB</strong>, and&nbsp;<strong>Iceberg</strong></li><li>Solid grasp of&nbsp;<strong>schema evolution</strong>,&nbsp;<strong>CDC patterns</strong>, and&nbsp;<strong>data reconciliation frameworks</strong></li><li>Experience with infrastructure-as-code (CDK/Terraform) and DevOps practices (CI/CD, Git)</li></ul><div><span style="color: black;">&nbsp;</span></div><div><strong style="color: black;">Preferred:</strong></div><ul><li>Familiarity with&nbsp;<strong>PostgreSQL</strong>,&nbsp;<strong>Athena</strong>,&nbsp;<strong>Step Functions</strong>, and&nbsp;<strong>Lambda</strong></li><li>Knowledge of&nbsp;<strong>event-driven architectures</strong>&nbsp;and&nbsp;<strong>microservices-based data APIs (This should be the required skills)</strong></li><li><strong>Familiar with data lake concept</strong></li><li><strong>Familiar with Financial or Financial Wealth management data domain</strong></li></ul><div><br></div>

Deepak Gulia

business_unit

client_name

Sourcing

Shortlisted

Applied

Tracy interview

Coding interview

Recruiter Check

Quality Check

Pending Business Review

L1 to be scheduled

L1 Interview

L1 Shortlisted

L2 to be scheduled

L2 Interview

L2 Shortlisted

Client

Submmitted to Client

Client round-1 to be scheduled

Client round-1 Interview

Client round-2 to be scheduled

Client round-2 Interview

Hired

Offered

Joined

Offer Rejected

On Hold