Spark/nifi Developer - Cary, NC

view the job in browser: Jobboard.aquainsys.com


Title: Spark/Nifi Developer
Location: Cary, NC
 
Job Description:
10+ years working with open source Big Data technology stacks (Apache Nifi, Spark, Hadoop/HDFS, Hive, Livy,YARN, Map Reduce etc.)
or commercial open source Big Data technology stacks (Hortonworks, Cloudera, etc.) 
Should have experince in Agile methodology 
Familiarity with Agile process management tools (e.g. Atlassian Jira) 
Experience in building NIFI data pipeline 
Experience in designing, building, and deployment of PySpark-based applications for both batch and streaming requirements,
which will require in-depth knowledge on majority of Hadoop and NoSQL databases as well. 
Should have ability to write and debug Spark jobs 
Ability to build abstracted, modularized reusable code components. 
Optimize performance of the built Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD's. 
Worked with Devops team to Clusterize NIFI Pipeline on EC2 nodes integrated with Spark, Kafka, Postgres running on other instance
using SSL handshakes in QA and Production Environments. 
Apache Hive Experience must 
Knowledge of BI Tool like Tableau 

Link: Apply with Resume at Jobboard


Thanks and Regards,

Vennela Gunna
Aqua Information Systems Inc. 300 N Pottstown Pike, Suite # 130 Exton, PA 19341 Contact No: 215-666-6276 Fax: 215-600-1617 Email: vgunna@aquainsys.com GTalk: vgunna@aquainsys.com

--
You received this message because you are subscribed to the Google Groups "SureShotJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sureshotjobs+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sureshotjobs/1751347612.430.1645629468075%40aquaadm-PowerEdge-T30.