Candidate should have a minimum of 5 years of experience and must have the following key skillsets
Strong experience in Spark with Java, Hbase/Phoenix.
Should have good experience in providing technical designs using Spark, Hbase/phoenix and other related Hadoop big data technologies
Should have prior experience in sourcing, transforming and analyzing vast amounts of raw data from various systems using Spark to provide ready-to-use data to the business team.
Should have sound knowledge on creating Spark jobs for data transformation and aggregation and produce unit tests for Spark transformations and helper methods
Should have strong experience working with Hbase/Phoenix
Should possess a deep understanding of distributed systems
Should have strong communication skills to work with business end-users and gather requirements