Hello
I have more than 6 years of experience in Apache Spark, Scala, Hive, Impala, Sqoop, Oozie, Airflow, Java and Python.
I have also worked on support job for employee in New Jersey.
I am sure to take on this task as I have excellent skill set in mentioned technology stack.
Some of my project details in mentioned technology stack:
We are currently working on Data Warehousing project for Security and Law firm in London for Security Log generation and analysis. We are using Apache NiFi for data stream ingestion, we are processing this data stream with Apache spark then lookup is done using File and Hbase. We have developed dashboard for log monitoring using Kibana.
I have worked on Data warehousing for Pharmaceuticals Industry where we need to collect and analyze data and come up with results like which particular area is having which particular disease most often. For this I have used Scala as Scripting Language, Hive as RDS and AWS environment.
Project: Revo POD.
Technologies: Amazon S3, BASH, Python, Oozie, Spark-SQL, Hive, Presto, HDFS, Java, Sqoop (On EMR).
Description: Project aims at creating Insights for the business from scratch using the different data available and manage the system using the cloud technologies to make it readily available to the client and hence enhance their business opportunities.
Work Details: Worked on multiple modules (like Activity, Redemptions, Claims, TOT, Placement, etc) and was part of cluster administrator team.
Best Regards,
Suraj