Lead Data Engineer java sparc sqlLocation: St Louis, MO (Onsite)

Job Description

Lead Data Engineer

>

> Location: St Louis, MO (Onsite)

>

> Duration: 12 month with possible extension

>

> Required Work Experience:

>

> · 5+ years of experience in an engineering role using Python,

> Java, Spark, and SQL.

>

> · GCP Cloud Experience Required

>

> · Strong working experience in HealthCare domain is a must

>

> · Strong Linux/Unix background and hands on knowledge.

>

> · Experience with Shell scripting and bash.

>

> · Experience with version control platform github

>

> · Experience with development ecosystem including Jenkins,

> Artifactory, CI/CD, and Terraform.

>

> · Pipeline creation and automation for Data Acquisition

>

> · Metadata extraction pipeline design and creation between

> raw and finally transformed datasets

>

> · Past experience with big data technologies including HDFS,

> Spark, Impala, Hive

>

> · Able to collaborate with scrum team including scrum master,

> product owner, data analysts, Quality Assurance, business owners, and

> data architecture to produce the best possible end products

>

> · Works on problems of diverse scope and complexity ranging

> from moderate to substantial

>

> · Assists senior professionals in determining methods and

> procedures for new tasks

>

> · Leads basic or moderately complex projects/activities on

> semi-regular basis

>

> · Must possess excellent written and verbal communication

> skills

>

> · Ability to understand and analyze complex data sets

>

> · Exercises independent judgment on basic or moderately

> complex issues regarding job and related tasks

>

> · Makes recommendations to management on new processes, tools

> and techniques, or development of new products and services

>

> · Works under minimal supervision, uses independent judgment

> requiring analysis of variable factors

>

> · Collaborates with senior professionals in the development

> of methods, techniques and analytical approach

>

> · Able to effectively communicate highly technical

> information to numerous audiences, including management, the user

> community, and less-experienced staff.

>

> · Consistently communicate on status of project deliverables

>

> · Consistently provide work effort estimates to management to

> assist in setting priorities

>

> · Deliver timely work in accordance with estimates

>

> · Solve problems as they arise and communicate potential

> roadblocks to manage expectations

>

> · Adhere strictly to all security policies

>

> Regards...!!!!

>

> Aravind

Skills