AI Foundational Model Engineer

Req ID

379364

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.

We are currently seeking a AI Foundational Model Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).

Role purpose

Design, build, deploy, and optimize enterprise-grade AI systems powered by foundation models, LLMs, retrieval-augmented generation, and agentic AI workflows. The role converts AI concepts into secure, scalable, observable, and supportable production systems suitable for a regulated financial-services environment.

Primary ownership

• Production LLM applications, RAG pipelines, AI services, and model-serving integrations.
• End-to-end LLMOps/MLOps lifecycle from experimentation to deployment, monitoring, evaluation, rollback, and continuous improvement.
• Model adaptation, inference optimization, APIs, observability, and operational readiness for GenAI solutions.

Key responsibilities

• Design and implement LLM-powered applications such as knowledge assistants, document intelligence solutions, workflow agents, summarization tools, and decision-support systems.
• Build RAG pipelines using embeddings, chunking strategies, vector databases, semantic retrieval, reranking, response grounding, and citation patterns.
• Adapt and optimize models using LoRA, PEFT, instruction tuning, distillation, transfer learning, quantization, and domain adaptation techniques.
• Develop scalable APIs, microservices, model-serving components, and integration patterns across cloud, hybrid, or containerized environments.
• Optimize inference workloads for latency, throughput, token efficiency, cost, reliability, and user experience.
• Implement model and application observability, including prompt logs, retrieval quality, hallucination indicators, drift signals, feedback loops, cost tel...