Home

Big Data/Hadoop Engineer

Irvine, CA. Posted 02-13-18

Tekstrom Inc
Wilmington, DE
Posted By
Vineela Vasipalli
Duration
12 Months
Start Date
Immediate
Tech Category
Big Data
Pay
$65 - $75 Hourly, Negotiable
Experience
5 - 8 Years
Tech Sub-Category
Data Analysis
Work Permit
Any Work Permit encouraged to apply
Tax Terms
N/A

Job Description

Big Data/ Hadoop Engineer - (Ideal candidate will be a Sr. java Developer currently working in Big Data and AWS cloud platform)

Responsibilities:

  • Work with big data analytics engineers to develop automated testing systems.
  • Develop testing software that will generate and validate test data for big data systems.
  • Develop testing software that will investigate the performance and scalability of big data systems.
  • Work with product managers and development leads to create testing strategies.
  • Create test plans and test cases for assigned components.
  • Execute and automate test cases, and perform bug tracking and management.
  • Contribute in building a flexible and scalable data testing automation solution.
  • Help create and implement quality processes and requirements.
  • Identify and communicate risks about our releases.

Required skills needed for this role:

 

  • Minimum 3+ years of hand on experience with big data or analytics systems.
  • Strong SQL / Analytical SQL expertise
  • Develop and update scripts written in Bash and Python.
  • Experience developing software or test automation in Java.
  • Amazon Web Services (EC2, EMR, S3 & Cloud Formation).
  • Working knowledge of bug tracking tools (e.g., Atlassian Jira).
  • Experience testing big data storage systems and tools such as  EMR, Spark, Hive.
  • Knowledge of Spark and related applications (Kafka, Spark SQL).
  • Experience testing scalable, distributed big data systems.
Key Skills
testing strategies including unit test unix and windows platforms agile methodology sql server bash and python big data alpine/greenplum atlassian jira testing big data storage systems spark hive spark sql java amazon web services big data systems

Similar Jobs

Similar jobs will be listed here