ETL SDET - PySpark Coding Experience

Cloud Analytics Technologies LLC
Jersey City, NJ

Job Details

Must-Have Skills:

  • ETL Testing, Python PySpark - Coding Experience is Mandatory
  • AWS S3, Redshift
  • Complex SQL Quires - Wring Complex Query is Mandatory

Good to Have:

  • Kafka, Shell scripting, Healthcare domain

Position Summary:

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.

This role involves designing and implementing automated tests to validate data transformation and migration,

as well as collaborating with data engineers and developers to identify and resolve data quality issues.

The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification:

  • At least 12 years of IT experience with minimum 8 years of experience in below skills:
  • Tech Skills
    • Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
    • Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
    • Testing experience in cloud environment (AWS s3)
    • Experience with Test Automation and DevOps practices in ETL and Cloud
    • Work experience in a Big Data ecosystem processing data in data lakehouse.
    • Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
  • Experience providing testing oversight in Agile team.
  • Should have excellent business communication to interact with Business teams and cross-functional teams.
Posted 2025-10-31

Recommended Jobs

Mammography Technologist, Registered QA Specialist-Per Diem

355 Grand Street
Jersey City, NJ

Job Title:Registered QA Specialist Location:Jersey City Medical Center Department Name:O/P Radiology-Satellite I Req #:0000205053 Status:per hour Shift:Day Pay Range: $53.45 - $53.45…

View Details
Posted 2025-09-10

NJ Licensed Psychotherapist ( LCSW, LMFT, LPC, LSW)

Dr. Stephen J. Oreski LCSW & Associates
Paramus, NJ

We are seeking energetic and experienced New Jersey licensed psychotherapists to work 15-35 hours a week, evenings, Fridays & Saturdays, in our multi-clinician, concierge-style psychotherapy practice…

View Details
Posted 2025-10-23

Domestic Violence Overnight-Weekend Shelter Advocate

YWCA Of Eastern Union County
Elizabeth, NJ

Job Description Job Description JOB SUMMARY The Overnight Weekend Shelter Advocate will provide services under the supervision and direction of the Director of Residential & Shelter Coordinato…

View Details
Posted 2025-10-20

Continuous Improvement Engineer

UNEX
Lakewood, NJ

Job Description Job Description Salary: $70,000-90,000 dependent on experience Summary: UNEX Manufacturing, a family-owned manufacturing company with a long record of success, currently has…

View Details
Posted 2025-10-23

Intern Software Engineer

GD Mission Systems
Florham Park, NJ

Responsibilities for this Position Intern Software Engineer ID: 2025-68655 USA-NJ-Florham Park Required Clearance: No clearance Posted Date: 10/23/2025 Category: Engineering-Softw…

View Details
Posted 2025-10-23

Venture & Growth Finance Attorney

Direct Counsel
Northfield, NJ

Job Description Job Description Mid-Level Venture & Growth Associate Attorney Locations: New York, Reston, San Diego, San Francisco, Washington, Wilmington, Phoenix, Los Angeles, Houston, Bos…

View Details
Posted 2025-10-28

Lead Sales Supervisor

Coach
East Rutherford, NJ

Coach is seeking a Lead Sales Supervisor in East Rutherford, NJ, to drive sales and lead a dynamic team in a luxury retail environment. The role involves overseeing daily operations, implementing mark…

View Details
Posted 2025-10-24

Sales Associate

Coach
Cherry Hill, NJ

Coach is seeking a Sales Associate in Cherry Hill, NJ, to deliver exceptional customer service and achieve sales targets. The role involves engaging with clients, maintaining store aesthetics, and sup…

View Details
Posted 2025-10-06

RN Resident - (Periop 101) Operating Room - Full-time

110 Rehill Ave
Somerville, NJ

Job Title: RN Resident Location: RWJUH Somerset Department Name: Operating Room Req #: 0000221157 Status: Hourly Shift: Day Pay Range: $45.55 - $45.55 per hour Pay Transparency: …

View Details
Posted 2025-10-29

Medical Physicist

Greenberg-Larraby, Inc. (GLI)
East Orange, NJ

Greenberg-Larraby, Inc. (GLI) is seeking a skilled and dedicated Medical Physicist to join our innovative oncology team at a well-known hospital facility in NJ. In this vital role, you will be res…

View Details
Posted 2025-09-30