AI Operations Platform Consultant

Cloud Analytics Technologies LLC
Jersey City, NJ

Job Description:

  • Brings extensive experience operating large-scale GPU-accelerated AI platforms, deploying and managing LLM inference systems on Kubernetes with strong expertise in Triton Inference Server and TensorRT-LLM.
  • They have repeatedly built and optimized production-grade LLM pipelines with GPU-aware scheduling, load balancing, and real-time performance tuning across multi-node clusters. Their background includes designing containerized microservices, implementing robust deployment workflows, and maintaining operational reliability in mission-critical environments.
  • They have led end-to-end LLMOps processes involving model versioning, engine builds, automated rollouts, and secure runtime controls.
  • The candidate has also developed comprehensive observability for inference systems, using telemetry and custom dashboards to track GPU health, latency, throughput, and service availability.
  • Their work consistently incorporates advanced optimization methods such as mixed precision, quantization, sharding, and batching to improve efficiency. Overall, they bring a strong blend of platform engineering, AI infrastructure, and hands-on operational experience running high-performance LLM systems in production


Basic Info:

  • AI Operations Platform Consultant
  • Experience deploying, managing, operating, and troubleshooting containerized services at scale on Kubernetes for mission-critical applications (OpenShift)
  • Experience with deploying, configuring, and tuning LLMs using TensorRT-LLM and Triton Inference server.
  • Managing MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production
  • Setup and operation of AI inference service monitoring for performance and availability.
  • Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
  • Operation and support of MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production
  • Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
  • Experience with standard processes for operation of a mission critical system – incident management, change management, event management, etc.
  • Managing scalable infrastructure for deploying and managing LLMs
  • Deploying models in production environments, including containerization, microservices, and API design
  • Triton Inference Server, including its architecture, configuration, and deployment.
  • Model Optimization techniques using Triton with TRTLLM
  • Model optimization techniques, including pruning, quantization, and knowledge distillation
Posted 2026-01-24

Recommended Jobs

Director, Client Finance

CMI Media and Compas, Inc.
Cherry Hill, NJ

Description Position at CMI Media Group Empower Media Excellence: Become Our Next Director, Client Finance   Are you a strategic leader with a passion for optimizing workflows, fostering a cultu…

View Details
Posted 2026-03-06

Logistics Operations Analyst

Umicore
South Plainfield, NJ

About Umicore Reducing harmful vehicle emissions. Powering the cars of the future. Giving new life to used metals. We are the leading circular materials technology company fulfilling its mission…

View Details
Posted 2026-03-06

NDT Level II Technician

HMT Tank
Newark, NJ

About HMT HMT is the global leader in aboveground storage tank solutions. HMT brings a distinct level of innovation and service to the tank industry through a unique approach of partnering with cu…

View Details
Posted 2026-01-01

Senior Bridge Engineer

AtkinsRéalis
Edison, NJ

Job Description Overview We are seeking a Senior Bridge Engineer to join us from one of our offices in Edison, NJ; Philadelphia, PA; or Calverton, MD. Your role Performs project de…

View Details
Posted 2025-12-09

Roof Repair Technician

Pj Fitzpatrick
Paterson, NJ

P.J. Fitzpatrick, Inc. is on the lookout for a skilled Repair Technician to join our dynamic team. In this role, you will work primarily on residential home repairs, ensuring that our customers recei…

View Details
Posted 2026-01-26

Food Service Worker

One Robert Wood Johnson Place
New Brunswick, NJ

Job Title: Food Service Worker Location: Main Hospital - New Brunswick Department Name: Dietary-Management Req #: 0000227993 Status: Hourly Shift: Evening Pay Range: $16.00 - $16.00 …

View Details
Posted 2026-03-16

Full Stack Engineer

Career Mentors, LLC
New Jersey

Full Stack Engineer Our Client – San Francisco, CA (On-site, 5 days/week) Full-time | $160K–$230K base + 0.1%–0.5% equity About Our Client Our client is the collaborative AI platform powering d…

View Details
Posted 2026-03-02

Psychiatrist-ER

NYC Health + Hospitals/South Brooklyn Health
Ocean County, NJ

Description Physician Affiliate Group of New York (PAGNY)is adding a Psychiatrist-ER  to the group at  NYC Health + Hospitals System / South Brooklyn Health. South Brooklyn Health is a redesigned…

View Details
Posted 2025-04-01

Part Time Cable Assembly Technician

Metuchen, NJ

Are you detail-oriented, handy with tools, and looking for a consistent evening schedule? We are looking for a reliable Production Technician to join our assembly team. This role is perfect for someon…

View Details
Posted 2026-02-20