Big Data Engineer
Experience: 10+ years
Job Type : Full time
Job Summary:
Job Description:
We are hiring a Big Data Engineer to work with large-scale distributed data systems. The role involves processing massive datasets using Hadoop, Spark, and cloud technologies.
Key Responsibilities:
Build and optimize data processing pipelines using Apache Spark.
Manage distributed data storage solutions using Hadoop and HDFS.
Work with streaming technologies such as Kafka and Flink.
Develop data ingestion pipelines from multiple sources.
Optimize large-scale batch and real-time processing workflows.
Required Skills:
Hadoop Ecosystem (HDFS, Hive, HBase)
Apache Spark, PySpark
Kafka, Flink, Airflow
NoSQL Databases (Cassandra, MongoDB)
Cloud Platforms (AWS EMR, Azure HDInsight, GCP Dataproc)
Preferred Skills:
Kubernetes for Big Data Workloads
Data Modeling & Schema Design
Experience with AWS Glue or GCP BigQuery
Recommended Jobs
HR Compensation Analyst
How would you like to join one of the most highly regarded financial institutions in New Jersey with deep roots in the community? Provident is a successful and highly regarded multi-billion-dollar ba…
School Operations Coordinator: Newark, NJ
Job Description Job Description Company Description About KIPP New Jersey KIPP New Jersey is part of the nationally recognized “Knowledge Is Power Program” network of free, open-enrollmen…
Registered Veterinary Technician (RVT)
Registered Veterinary Technician – Valley Veterinary Hospital Valley Veterinary Hospital in Fredericton, NB is on the lookout for a compassionate and skilled RVT to join our friendly and collabor…
Front Desk Receptionist/Insurance Coordinator
Job Description Job Description Benefits/Perks ~ Competitive Compensation ~ Great Work Environment ~ Paid Time off ~ Health and Dental Benefits ~401k ~40-hours/week, Monday-Friday/No …
Clinical Supervisor
Job Description Job Description Benefits: Competitive salary Flexible schedule Training & development Company Overview: At CoxPHIT, we are dedicated to transforming the lives of …
Designer
Designer SNAPSHOT: ~Ad agency Designer with 1-3 years experience ~A highly hands-on role that will touch every creative aspect of diverse projects for a variety of clients ~Willingness to learn an…
Senior Program Manager
Public Trust: None Requisition Type: Regular Your Impact Own your opportunity to work alongside federal civilian agencies. Make an impact by providing services that help the government ens…
Nurse Practitioner
We are searching for full-time and Part-Time Nurse Practitioners (NPs) - for our urgent care Locations in Belleville and Perth Amboy. We provide high-quality walk-in medical care for the treatment …
Lending Reporting Analyst
Job Description Job Description BASIC FUNCTION Responsible for assisting in managing and monitoring Lending Division’s portfolios, ensuring they align with the Bank’s goals. This is to include…