Looking for Databricks consultant

Hello There,

 

Below is the JD for Databricks consultant Role. Please source relevant resumes.

 

Role: Databricks consultant        

Location: Atlanta, GA

Duration: Long Term

 

 

The JD is as follows :

·       Create Databricks workspace and assigned the user access using SCIM API

·       Estimate the cluster size, monitoring and troubleshooting of the Spark databricks cluster.

·       Create All purpose and Job clusters for respective job in lower lanes and production environments.

·       Define cluster policies which can be used for setting up the cluster

·       Creating pipelines, data flows and complex data transformations and manipulations using PySpark with Databricks.

·       Create, provision multiple Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.

·       Create custom scripts for deploying the Databricks jobs from lower lanes to Production environment with appropriate tags.

·       Upgrade the Databricks runtime version for jobs

·       Develop Azure Databricks notebooks to apply the business transformations and perform data cleansing operations.

·       AWS Databricks experience

 

Full Name

E-Mail

Contact

Location

Relocation

Availability

Work Auth

Graduation Year

LinkedIn

Rate

Thanks & Regards,

 

Rao. A

Sr. Delivery Manager (IT)

Rao.A@sysrs.com

Contact: 410-639-6697

SYSRS IT SERVICES

Office : 10632 Little Patuxent Parkway Suite # 256 Columbia, MD 21044 

--
You received this message because you are subscribed to the Google Groups "SureShotJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sureshotjobs+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sureshotjobs/CA%2BRonb_y%3DzvNrxw5DthZOYE%2Bd%2BYi8WA7w14W1PzBOQEaYGwopg%40mail.gmail.com.