Distinguished AI Engineer

Req ID

379369

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).

Distinguished AI Engineer

Enterprise AI Architecture / LLM Platforms / Advanced AI Systems

Role purpose

Set the architecture, engineering standards, platform strategy, and technical governance for enterprise AI and GenAI capabilities. This role guides senior engineering teams and ensures AI platforms are scalable, reusable, observable, cost-efficient, and compliant with enterprise risk expectations. This role will be onsite in Jersey City, NJ.

Primary ownership

• Target-state enterprise AI architecture, reference patterns, and platform guardrails.
• LLMOps, AI gateways, model-serving strategy, evaluation platforms, observability, governance, and operating standards.
• Technical assurance for high-risk or high-impact AI initiatives.

Key responsibilities

• Define target-state architecture for LLM platforms, model hubs, AI gateways, RAG services, agent frameworks, orchestration layers, and model-serving infrastructure.
• Establish enterprise standards for AI SDLC, LLMOps, MLOps, evaluation, release management, operational resilience, and production support.
• Guide architecture for secure, scalable, and cost-efficient inference across cloud, hybrid, private, and containerized environments.
• Define guardrail patterns for hallucination mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight.
• Lead design reviews for critical AI systems and provide technical assurance to architecture and risk forums.
• Partner with cybersecurity, risk, compliance, legal, audit, product, and business teams to align...