Remote - Data Engineer – 2 Positions

Data Engineer 1 – 2 Positions

CA, Remote

2 Rounds of Client Interview

Responsibilities:

·        Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Airbnb business growth and improve the product experience.

·        Build scalable Spark data pipelines leveraging Airflow scheduler/executor framework

 

Minimum Requirements:

·        8+ years of relevant industry experience

·        Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions

·        Working knowledge of relational databases and query authoring (SQL).

·        Good communication skills, both written and verbal

·        Strong experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines.

·        Experience building batch data pipelines in Spark Scala.

·        Strong understanding of distributed storage and compute (S3, Hive, Spark)

·        General software engineering skills (Java or Python, Github)

--

Thanks,

Jonna Sreenivas 

Operations Manager

1601 N Harrison Ave, STE # 2B, Pierre, SD 57501

Phone: 605-220-5981 ext 110 | Direct: 605-223-6768 | sjonna@my3tech.com

F: (605) 609-2010  | W: www.my3tech.com

Certified Minority Business Enterprise (MBE)

An E-Verify Company

DISCLAIMER: The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer or if you want to be REMOVED please reply with REMOVE in the Subject line of this email.

--
You received this message because you are subscribed to the Google Groups "SureShotJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sureshotjobs+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sureshotjobs/CAF9Kwf%3D-5Ep8LZ1S9PbJazgKN1PvR8y1eo%2BVOGCmR2gop6pOJA%40mail.gmail.com.