Big Data Solutions Lead Engineer

Role: Big Data Solutions Lead Engineer

Location: Paterson New Jersey

Experience: 12 Years

Employment: Contract

Interview Type: In-Person or Webcam

Job Overview

We are seeking a highly experienced Big Data Solutions Lead Engineer to design implement and manage large-scale data solutions. The ideal candidate will be responsible for leading the architecture development and optimization of big data platforms ensuring they meet business requirements and performance standards. This role requires strong technical expertise leadership skills and the ability to drive complex projects from conception to deployment.

Key Responsibilities

• Lead the design and implementation of end-to-end big data solutions using modern technologies and frameworks.

• Architect and manage large-scale data processing pipelines including ETL/ELT workflows data lakes and data warehouses.

• Ensure data quality security and governance standards are maintained across all platforms.

• Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions.

• Evaluate select and implement big data tools technologies and frameworks to optimize performance and efficiency.

• Mentor and guide technical teams providing best practices and solutions for complex data challenges.

• Troubleshoot and resolve performance issues in existing big data infrastructure.

• Develop and maintain documentation for data architecture processes and standards.

• Stay current with emerging trends and technologies in big data analytics and cloud platforms.

Required Skills and Qualifications

• Education: Bachelors or Masters degree in Computer Science Information Systems or a related field.

• Experience: Minimum 12 years of professional experience in big data engineering including hands-on experience with large-scale data platforms.

• Technical Skills:

  • Expertise in big data technologies such as Hadoop Spark Kafka Hive HBase or similar.

  • Proficient in programming languages like Java Scala or Python.

  • Experience with cloud platforms such as AWS Azure or GCP and cloud-based data services.

  • Strong knowledge of data modeling ETL/ELT processes and data warehousing concepts.

  • Familiarity with data governance data security and compliance requirements.

• Soft Skills:

  • Strong problem-solving and analytical skills.

  • Excellent leadership and team management capabilities.

  • Effective communication skills for collaborating with technical and non-technical stakeholders.

  • Ability to manage multiple priorities and projects in a fast-paced environment.