Senior AI Data and Evaluation Engineer
What You Will Do:
We are looking for an experienced and highly skilled Senior AI Data and Validation Engineer. A successful candidate will be responsible for both dry and wet lab experiments for AI functionality acquiring datasets, developing labeling guidelines, and preparing dataset for AI model development. Also, candidate will be responsible for developing methods and processes for scientific evaluation of AI/ML models used in medical devices, ensuring compliance with all applicable FDA guidelines and regulations. This role is crucial for maintaining the safety, effectiveness, and quality of AI-enabled medical devices throughout their product lifecycle from initial training to final validation. The engineer will contribute to the design, execution, and analysis of validation studies, ensuring that the devices perform predictably and reliably for their intended use and across all relevant demographic groups., placing a strong emphasis on comprehensive data management practices, including data collection, processing, annotation, storage, and use. This includes ensuring data integrity, quality, and representativeness to mitigate potential biases and demonstrate the safety, effectiveness, and quality of AI-enabled medical devices throughout their lifecycle.
What you will do:
- Perform dataset collection, develop, synthesis, generation, preparing datasets for AI development, stress testing and validation.
- Execute web lab experiments that interact with human blood samples with good laboratory practice.
- Create detailed validation plans, protocols, and reports for AI-enabled medical device software functions encompassing both performance validation and model evaluation.
- Perform Data Operation such as management of data used in both the development and validation of AI models, ensuring the quality, diversity, and independence of datasets . This involves assessing data representativeness, addressing potential biases, and ensuring the appropriate separation of training and test datasets
- Conduct comprehensive risk assessment for AI models, considering potential and unintended biases, limitations, and cybersecurity vulnerabilities
- Conduct rigorous performance validation studies, analyzing performance across different subgroups of the intended user population .
- Perform analysis to address transparency and bias throughout the device lifecycle, from design to post-market surveillance . This includes evaluating whether a device benefits all relevant demographic groups similarly and incorporating transparency into device design
- Stay abreast of the latest FDA guidelines, regulations, and industry best practices related to AI model validation in medical devices.
Minimum Qualifications (Required):
- Bachelor's Degree in Computer Science, Machine Learning, Electrical Engineering, Mathematics, Statistics, Bioengineering or related field, 2+ years of work experience required.
- OR Master's Degree in the above fields
Preferred Qualifications (Strongly desired):
- 2+ years of experience in medical device R&D, preferably AI-enabled devices.
- Fluent in commercial data analysis tools or similar scripting and statistical language for data analysis, Python preferred.
- Experience in the development, evaluation and validation of AI models, specifically within the medical device or healthcare industry. This experience including one or more of the following R&D life cycle: Data Acquisition and preprocessing and labeling, model training and tuning, AI Model evaluation and performance, bias detection and mitigation, risk assessment, and QMS documentation
- Experience in Statistics and descriptive data analysis to help develop data-driven scientific rigor to AI model validation process, including experience with one or more of the following: confidence intervals development, power analysis, statistical tests, etc.
- Entry level knowledge with AI/ML frameworks such as PyTorch, OpenCV, TensorFlow, scikit-learn etc. for model training and development, testing and validation.
- Experience with commercial Data Operation tools
- General knowledge of the healthcare market and competitors.
- $116k - $193k salary plus bonus eligible + benefits. Individual pay is based on skills, experience, and other relevant factors.
Recommended Jobs
Associate Sales Planner
Description Position at WebMD Medscape, a division of WebMD, develops and hosts physician portals and related mobile applications that make it easier for physicians and healthcare professionals …
Electrical Engineer MEP
Job Details: Electrical Engineer MEP Respected South Jersey consulting firm seeks Electrical Engineer: ~5 to15 years of experience ~ PE license desired ~ AutoCAD and REVIT skills ~ Stab…
Electronics Engineer
Globally recognized as the leader in live video technology for broadcast and new media productions, our passion, and purpose are to help our customers craft compelling stories that trigger the highest…
Registered Nurse (RN)
Discover a new lane in nursing and earn top pay doing what you are made to do. The last few years have put unbearable pressure on nurses. The long hours, relentless demands and sacrifices have become …
Field Service Tech / Print Technician
POSITION PROFILE: This position is designed as an entry level technician position to service and repair a variety of company products. Provides installation, preventative maintenance, connectivity…
Regional Class A Company Truck Driver
10-4 Logistics USA is hiring full‑time W2 Class A CDL Drivers. Opportunities exist across OTR, Regional, and Dedicated fleets, mostly east of the I‑35. We provide steady freight, reliable home time, a…
Field Diesel Mechanic - CES
Great company. Great people. Great opportunities. If you’d like the chance to make your mark with the world’s largest equipment rental provider, come build your future with United Rentals! …
Underwriter-Lawyers Program
Amwins Program Underwriters (APU) is seeking an underwriter to join its Professional Liability underwriting team. Hybrid role (2-3 days in-office) based in Edison, NJ. The underwriter will focus exclu…
Locum Pathologist
Locum Pathologist High-Volume Cancer Center Coverage (NJ License Required) We are seeking an experienced Board-Certified Pathologist to provide locum coverage starting in October at a high-acuity, …
Development Assistant
The Development Assistant is a member of the Society’s Development, Membership and Outreach Team, reports directly to the Assistant Director and supports the work of the Assistant Director and Execut…