AI Engineer-Agentic AI-Orchestration And Azure AI Foundry-Full‑Stack-Azure‑Native
About the role
Job Summary
full AI lifecycle
secure, scalable, observable, and governed
reliable, enterprise‑ready systems
evaluation, quality monitoring, and runtime security
LLM‑as‑a‑Judge
agent lifecycle governance and runtime protection controls
orchestration layers
multi-agent workflows
end-to-end AI experiences
RESTful APIs
Azure Functions
Durable Functions
ADLS
Azure Cognitive Services / Azure AI Services
Azure AI Search
LLM-as-a-Judge
patterns and structured scoring/assessment approaches where appropriate.
Agent Lifecycle Governance with Agent 365 (A365) Awareness (Core): Build solutions that align with enterprise lifecycle management and governance patterns such as:
•
- Agent registry / inventory expectations
- Access controls and telemetry/observability requirements
- Monitoring and operational controls at "agent scale
Runtime Security / Runtime Protection (Core): Implement and support
runtime protection
expectations for agentic solutions, and participate in controls aligned to:
•
- Runtime protection
- Access controls (e.g., Entra ID patterns)
- Threat detection and monitoring expectations
Analytical/Decision Making Responsibilities
- This role is critical to ensuring the enterprise's AI ambition translates into
real, reliable, and scalable systems
Knowledge and Skills Requirements
Core Software Engineering (Required)
- Strong hands-on development in
Python / C# / TypeScript/JavaScript
(or similar).
- Experience building API-driven services and integrating distributed systems. [Build agen...65 Copilot | SharePoint], [Agents in...65 Copilot | SharePoint]
- Strong understanding of
non-functional requirements
: reliability, availability, scalability, performance, and cost.
Azure & Platform Engineering
- Hands‑on experience with
Azure AI Foundry
for delivering enterprise GenAI solutions in an enterprise context.
- Experience building serverless and asynchronous workloads using
Azure Functions
(including Durable Functions or equivalent).
- Experience using
queues and event‑driven messaging
for decoupled, reliable workflows.
- Experience working with
ADLS
for data ingestion, storage, and processing.
- Experience using
Azure Cognitive Services / Azure AI Services
as part of AI solutions.
Azure Functions + Queues/Eventing (Required)
- Experience with
Azure Functions
(including Durable Functions or equivalent orchestration patterns).
- Experience implementing asynchronous patterns with
queues/eventing
for scale and reliability.
Vector Databases (Required)
- Hands-on experience with
vector databases / vector search
, including enterprise deployment patterns
LLM-as-a-Judge Evaluation (Required)
- Experience implementing evaluation approaches that include
LLM-as-a-Judge
(or equivalent automated evaluation patterns) for quality monitoring and continuous improvement.
Agent 365 (A365) + Governance Alignment (Required)
- Familiarity/experience working in environments using
Agent 365 (A365)
-style lifecycle management concepts (e.g., agent registry, governance, monitoring/observability, and access controls)
Runtime Security / Runtime Protection (Required)
- Experience delivering solutions with
runtime protection
expectations (runtime security controls, access controls, and monitoring alignment as defined by enterprise governance).
Nice to Have
- Experience integrating AI services into enterprise automation platforms (e.g., Power Platform, ServiceNow).
- Familiarity with Azure AI services and data platforms.
Detailed Responsibilities
AI & Agentic Solution Engineering
- Build and evolve AI applications and agents using Azure AI Foundry and Azure‑native services.
- Design and implement
multi‑agent workflows
and orchestration logic for complex use cases.
- Integrate AI capabilities into enterprise systems through
secure APIs
.
Full‑Stack & Backend Development
- Develop backend services, APIs, and supporting components for AI solutions.
- Build full‑stack solutions where required, including UI integration for AI experiences.
- Implement serverless components using Azure Functions for scalable, event‑driven execution.
Data, Retrieval & Knowledge Systems
- Design and implement data ingestion and storage pipelines using ADLS.
- Build and operate vector‑based retrieval systems for AI grounding and search.
- Maintain data freshness, indexing strategies, and retrieval performance.
Evaluation, Monitoring & Quality
- Implement evaluation pipelines for AI outputs, including
LLM‑as‑a‑Judge
-based scoring and analysis.
- Instrument AI systems with logging, metrics, and telemetry to support observability and diagnostics.
- Use evaluation insights to improve accuracy, consistency, and system behavior over time.
Security, Governance & Operations
- Build AI systems aligned to
runtime security and governance expectations
, including access controls and monitoring.
- Operate and support AI solutions in production, including incident response and root‑cause analysis.
- Continuously improve system reliability, performance, and cost efficiency.
Job Requirements
Education:
- A degree in Computer Science / Engineering or a related discipline; or equivalent work experience
Experience
- 10+ years in a Global IT environment working with multiple disciplines to deliver projects in line with customer needs
- 3+ Years Global delivery or transformation preferably in large scale infrastructure programs
- 3+ Years in a global operations environment
Certification Requirements
- Python Certification
- Azure AI Services
- Azure Data Services
EY | Building a better working world
Not included in the source posting: about the role, benefits.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.