Hi BusinessPartners,
Hope you are doing great!
Please find below mentioned job description and revert back with the updated resume to lucky@itstrategiesinc.com
Job Title: Big Data Developer
Location: Philadelphia, PA
Duration: 6+ Months
Interview: Face to Face interview required ….
Application Development - Big Data Developer (Java, Hadoop) III (5-8 years)
Sr. Data Engineer:
Need Experienced Data engineer with 6 to 8 years of experience working with Data Centric Applications and Services with at least 5 years of experience working in Big Data environment
Expert in:
• Object oriented programming in Python and/or Scala is a must have.
• Build Custom Data Pipelines in Python and Scala that Clean, Transform and Aggregate data from many different sources
• Expert level working experience with Spark and related big data technologies such as: MapReduce, Hadoop, HBase, Hive, Elastic Search
• Data Structures and Data Processing Algorithms and Frameworks
• Data Migration, high throughput Data Pipelines
• Massively Parallel Processing using Python Tools
• Big data modelling and ETL Processes
• Ability to analyze Performance Issues in Big Data Environment
• Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques
• Analytical views and data visualization
• RDBMS, In-Memory, NoSQL, Columnar and Document Storage Systems
• Batch Processing with Petabyte Scale data sets
• Communication and Collaboration
Well experienced with:
• Large Volumes of data Processing and Developing Automated ETL Processes
• High Throughput Low Latency Systems
• Large Scale Data Modelling from Big Data perspective
• Big Data Structures in Python
• PyData, Anaconda, numPy, PyTables, DataFrames, RDDs, Jupyter Notebook
• PyHive, PySpark
• JSON/Parquet Data formats
• Real time streaming with either Spark Streaming of Kafka
• Develop API's/Tools that help share data with Enterprise
• Debugging in Big Data environment
• Version control Systems: Git/github/BitBucket etc.
• DevOps Skills with Python, Shell Scripts, Ansible, Docker etc.
Nice to have:
• Familiarity with PyPi
• Workflow Management Tools such as Luigi, Apache Airflow, Snowflow, Apache NiFi or similar
• Experience Developing Models that help Predictions
• Experience with Functional Programming is a Big Plus
Non-Technical Experience:
• Effective Collaborator and Team Player
• Quick Learner and Self-starter with excellent debugging skills
• Ability to foresee scalability issues and make judgements
You received this message because you are subscribed to the Google Groups "SureShotJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sureshotjobs+unsubscribe@googlegroups.com.
To post to this group, send email to sureshotjobs@googlegroups.com.
Visit this group at https://groups.google.com/group/sureshotjobs.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment