Data Engineer Job at SFE, Sunnyvale, CA

  • SFE
  • Sunnyvale, CA

Job Description

Section

Details

Job Title

Senior Data Engineer

Job Type

Full Time

Client Location

Sunnyvale, CA

Work Arrangement

Remote

Duration

Full Time

Pay Rate / Salary

$120-$150k/yr.

Job Summary

  • The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.

Key Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines.
  • Automate data ingestion from multiple data sources.
  • Ensure reliable, high-performance, and scalable data movement.
  • Develop and optimize PySpark-based data processing frameworks.
  • Build and manage Airflow workflows and orchestration pipelines.
  • Work with Hive and Kafka-based batch and streaming data solutions.
  • Implement data quality, monitoring, governance, and operational controls.
  • Support production incidents, performance tuning, and continuous improvement initiatives

Required Qualifications

  • Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
  • Strong experience with large-scale GCP Data Engineering solutions.
  • Hands-on experience with Airflow DAG development and support
  • Experience building and optimizing Spark/PySpark data pipelines.
  • Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
  • Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable
  • Google Cloud Platform (GCP)
  • PySpark
  • Python
  • Airflow
  • Hive
  • Kafka

Job Tags

Full time, Remote work

Similar Jobs

RK Mechanical, Inc.

Manufacturing Production Assistant Job at RK Mechanical, Inc.

 ...standards and professional execution allow us to turn our customers greatest concepts into reality.Position SummaryThe Production Assistant reports to the VP of Manufacturing and supports the Plant Managers in the administrative, operational, and documentation... 

YMCA

Pilates Instructor - YMCA at Black Creek Golf Country Club - Thursdays, 5:30pm Job at YMCA

 ...class. We are in need of a Pilates Instructor who can teach classes every Thursday from 5:30pm-6:30pm at the Black Creek Golf Country Club. Compensation is $37.50 per class. RESPONSIBLITIES: Leads energizing, fun, safe, and educational group classes as directed... 

Compass Group

HOUSEKEEPER (FULL TIME) Job at Compass Group

 ...is hiring immediately for a full time HOUSEKEEPER position. Location : Des Moines Wellness...  ...interview. Requirement : No prior experience is required; willing to train!...  ...duties to maintain establishments, including hotels, restaurants and hospitals, in a clean and... 

Airplus Refrigeration, Inc.

Work From Home - Data Entry Clerk Job at Airplus Refrigeration, Inc.

 ...outgoing personality with superior communication skills and great work ethic. Data entry and strong organizational skills. ...  ...information and offer solutions. Familiarity with home computers and have at least an average working level typing ability. ... 

RWS Global

Hersheypark | Stage Manager Job at RWS Global

 ...embracing our mission, Raise Your Experience. Job Description: Stage Manager Type of Employment: Seasonal Location: Hersheypark,...  ...operational logistics to General Manager(s) if applicable Assist RWS Leadership and Producer with administrative duties for...