Hello There,
Below is the JD for Databricks Admin Role. Please source relevant resumes.
Role: Databricks Admin
Location: Atlanta, GA
Duration: Long Term
The JD is as follows :
· Create Databricks workspace and assigned the user access using SCIM API
· Estimate the cluster size, monitoring and troubleshooting of the Spark databricks cluster.
· Create All purpose and Job clusters for respective job in lower lanes and production environments.
· Define cluster policies which can be used for setting up the cluster
· Creating pipelines, data flows and complex data transformations and manipulations using PySpark with Databricks.
· Create, provision multiple Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.
· Create custom scripts for deploying the Databricks jobs from lower lanes to Production environment with appropriate tags.
· Upgrade the Databricks runtime version for jobs
· Develop Azure Databricks notebooks to apply the business transformations and perform data cleansing operations.
· AWS Databricks experience
| Full Name |
| |
| Contact |
| Location |
| Relocation |
| Availability |
| Work Auth |
| Graduation Year |
| |
| Rate |
Rao. A
Sr. Delivery Manager (IT)
Contact: 410-639-6697
SYSRS IT SERVICES
Office : 10632 Little Patuxent Parkway Suite # 256 Columbia, MD 21044
You received this message because you are subscribed to the Google Groups "SureShotJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sureshotjobs+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sureshotjobs/CA%2BRonb8tX%2BHx_NSpmKwg_Jy_2PRrVb36E7noTAxBRpUonqDTWg%40mail.gmail.com.
No comments:
Post a Comment