Python Developer

Python Developer for a contract position with a client in New Jersey, NJ (Hybrid). You will design and build scalable data solutions using Python, PySpark, and Big Data technologies, including HDFS and Impala, to support financial valuation and Independent Price Verification (IPV) processes within the Quartz platform.

RESPONSIBILITIES:

• Design and implement a Finance Data Lake on HDFS to support enterprise-wide financial data management and analytics.
• Develop robust data transfer tools to replicate and ingest data from NoSQL datastores into the Data Lake environment.
• Create and maintain scalable ETL pipelines using PySpark to process large-scale datasets efficiently.
• Build and maintain RESTful web services and APIs to enable secure and efficient data access for internal Quantitative teams.
• Actively participate in the full software development lifecycle, including requirements gathering, design, development, testing, and deployment.
• Collaborate in an Agile development environment, contributing to sprint planning, daily stand-ups, and iterative delivery of features.

REQUIRED QUALIFICATIONS:

• 6 10 years of overall technology experience in software development and system architecture.
• Proven experience (6 10 years) in designing and developing applications in an object-oriented programming environment using languages such as Java, C++, or C#.
• 3 5 years of hands-on experience with Python development.
• 3 5 years of Big Data experience working with HDFS, Impala, and PySpark, including handling petabyte-scale datasets.
• Strong expertise (6 10 years) in designing, writing, and tuning complex SQL queries and working with relational database schemas.
• Experience with grid computing and large-scale data processing is a plus.
• Familiarity with object-oriented databases is a plus.
• Exposure to test-driven development (TDD), functional testing, and continuous integration practices is desirable.
• Strong written and verbal communication skills.
• Experience with financial instruments and Price Verification processes is highly desirable.

PREFERRED QUALIFICATIONS:

• Strong hands-on experience with Quartz, particularly in the context of financial systems and analytics.
• Solid understanding of Independent Price Verification (IPV) processes and valuation methodologies for financial instruments.

• Proficient in Python programming for building scalable and maintainable data pipelines and applications.
• Experience developing ETL workflows and data processing applications using PySpark.
• Expertise working with Big Data technologies, including HDFS and Impala, in environments handling petabyte-scale datasets.
• Deep understanding of data architecture and performance optimization in distributed systems.