jobTitle

skills

yearOfExperience

Data Engineer

<div><strong>Role&nbsp;and&nbsp;responsibilities</strong></div><div>•&nbsp;Strong&nbsp;technical,&nbsp;analytical,&nbsp;and&nbsp;problem-solving&nbsp;skills&nbsp;•&nbsp;Strong&nbsp;organizational&nbsp;skills,&nbsp;with&nbsp;the&nbsp;ability&nbsp;to&nbsp;work&nbsp;autonomously&nbsp;as&nbsp;well&nbsp;as&nbsp;in&nbsp;a&nbsp;team-based&nbsp;environment&nbsp;•&nbsp;Data&nbsp;pipeline&nbsp;template&nbsp;development&nbsp;•&nbsp;Data&nbsp;pipeline&nbsp;Monitoring&nbsp;development&nbsp;&amp;&nbsp;support&nbsp;(operations)</div><div><br></div><div><strong>Technical&nbsp;skills&nbsp;requirements</strong></div><div>The&nbsp;candidate&nbsp;must&nbsp;demonstrate&nbsp;proficiency&nbsp;in,</div><div>•&nbsp;On-premise&nbsp;servers&nbsp;for&nbsp;data&nbsp;processing&nbsp;and&nbsp;extraction</div><div>•&nbsp;Ability&nbsp;to&nbsp;own&nbsp;and&nbsp;deliver&nbsp;on&nbsp;large,&nbsp;multi-faceted&nbsp;projects</div><div>•&nbsp;Fluency&nbsp;in&nbsp;complex&nbsp;SQL&nbsp;and&nbsp;experience&nbsp;with&nbsp;RDBMSs</div><div>•&nbsp;(Bigdata,&nbsp;Spark,&nbsp;PySpark,&nbsp;Scala,&nbsp;Python,&nbsp;NiFi,&nbsp;Hive,&nbsp;NoSql&nbsp;DBs)</div><div>•&nbsp;Experience&nbsp;designing&nbsp;and&nbsp;building&nbsp;big&nbsp;data&nbsp;pipelines</div><div>•&nbsp;Experience&nbsp;working&nbsp;on&nbsp;large&nbsp;scale,&nbsp;distributed&nbsp;systems</div><div>•&nbsp;Experience&nbsp;working&nbsp;on&nbsp;Azure&nbsp;Cloud&nbsp;services&nbsp;like&nbsp;(Azure&nbsp;Data&nbsp;Factory,&nbsp;Databricks,&nbsp;ADLS,&nbsp;Azure&nbsp;HD&nbsp;Insights,&nbsp;Azure&nbsp;Synapse,&nbsp;Azure&nbsp;Data&nbsp;warehouse)</div><div>•&nbsp;Strong&nbsp;hands-on&nbsp;experience&nbsp;of&nbsp;programming&nbsp;language&nbsp;like&nbsp;PySpark,&nbsp;Scala&nbsp;with&nbsp;Spark,&nbsp;Python.</div><div>•&nbsp;Exposure&nbsp;to&nbsp;various&nbsp;ETL&nbsp;and&nbsp;Business&nbsp;Intelligence&nbsp;tools</div><div>•&nbsp;Solid&nbsp;grounding&nbsp;in&nbsp;Agile&nbsp;methodologies</div><div>•&nbsp;Experience&nbsp;with&nbsp;git&nbsp;and&nbsp;other&nbsp;source&nbsp;control&nbsp;systems</div><div>•&nbsp;Strong&nbsp;communication&nbsp;and&nbsp;presentation&nbsp;skills</div><div><br></div><div><strong>Nice-to-have&nbsp;skills</strong></div><div>•&nbsp;Certification&nbsp;in&nbsp;Hadoop/Big&nbsp;Data&nbsp;–&nbsp;Hortonworks/Cloudera</div><div>•&nbsp;Azure&nbsp;Cloud&nbsp;certification</div><div>•&nbsp;Unix&nbsp;or&nbsp;Shell&nbsp;scripting</div><div>•&nbsp;Strong&nbsp;delivery&nbsp;background&nbsp;across&nbsp;the&nbsp;delivery&nbsp;of&nbsp;high-value,&nbsp;business-facing&nbsp;technical&nbsp;projects&nbsp;in&nbsp;major&nbsp;organizations</div><div>•&nbsp;Experience&nbsp;of&nbsp;managing&nbsp;client&nbsp;delivery&nbsp;teams,&nbsp;ideally&nbsp;coming&nbsp;from&nbsp;a&nbsp;Data&nbsp;Engineering&nbsp;/&nbsp;Data&nbsp;Science&nbsp;environment</div>