AI Implementation Engineer

Position Overview

We are seeking a Staff IT AI Implementation Engineer to lead the architecture, deployment, and operational oversight of our enterprise AI ecosystem. Sitting at the intersection of hands-on technical execution and strategic governance, this role is pivotal in building production-ready AI solutions, automating cross-functional workflows, and shaping responsible AI adoption standards across the organization. 

The ideal candidate thrives on delivering scalable AI integrations while acting as a trusted advisor to help business units understand, deploy, and maximize the value of artificial intelligence securely.   This position is for local candidates only (CA - Milpitas / San Jose area) who can report in person. Remote or out-of-area candidates will not be considered 

Core Responsibilities

• AI Platform Administration: Manage enterprise AI platforms (including frontier LLMs like Claude Enterprise and ChatGPT Enterprise), ensuring secure access controls and seamless coordination with IT infrastructure. 
  
  
• Workflow Automation & Agent Development: Design, build, deploy, and maintain custom AI agents and automated workflows to solve business challenges while adhering to IT security standards. 
  
  
• Cross-Functional Advisory: Serve as the primary point of contact for AI requests across all business units. Partner with stakeholders to assess feasibility, scope technical requirements, and deliver production-ready implementations. 
  
  
• Governance & Security Compliance: Collaborate with IT Security and leadership to establish, implement, and enforce AI governance frameworks and acceptable use policies. 
  
  
• Vendor & Tool Evaluation: Review and vet emerging AI tools, services, and platform releases alongside IT Security to provide recommendations for adoption or integration. 
  
  
• Enablement & Training: Develop cross-departmental guidance, best practices, and training programs to support safe, compliant, and effective AI usage. 
  
  
• Performance & Cost Optimization: Track platform usage metrics, monitor cost allocations, and present operational insights and optimization strategies to leadership. 
  
  
• Security Reviews: Ensure all agents, MCP servers, integrations, and data connections undergo rigorous IT Security review before deployment, upholding principles of least-privilege access. 
  
  

Key Qualifications

• Experience: 3+ years of experience in software engineering, data science, ML engineering, or applied AI (or 2+ years specialized in building production LLM applications). 
  
  
• AI Model Integration: 1–3 years of hands-on experience working with frontier AI services, LLMs, or agent development. 
  
  
• Agent Architecture: Proven ability to build AI agents utilizing tool/function calling, API integrations, and Model Context Protocol (MCP) frameworks. 
  
  
• RAG Pipelines: Technical proficiency in Retrieval-Augmented Generation (RAG) architecture, including embeddings, vector databases, chunking strategies, and retrieval evaluation. 
  
  
• LLM Evaluation: Hands-on experience evaluating LLM performance using test sets, LLM-as-judge frameworks, and prompt regression testing. 
  
  
• Prompt & Context Engineering: Advanced expertise in production-grade prompt engineering and context optimization. 
  
  
• AI Security Standards: Strong knowledge of AI-specific security threats (e.g., prompt injection, data leakage, PII handling) and familiarity with the OWASP Top 10 for LLMs. 
  
  
• Deployment & Managed Services: Experience containerizing AI applications, managing self-hosted/served models, and utilizing cloud AI services (e.g., AWS Bedrock, Azure OpenAI/AI Foundry, Google Vertex AI). 
  
  
• Governance Frameworks: Familiarity with responsible-AI practices and governance models (such as NIST AI RMF or ISO/IEC 42001). 
  
  
• Communication & Collaboration: Demonstrated track record of collaborating across business units and translating complex technical concepts for non-technical stakeholders. 
  
  

Preferred Qualifications

• Certifications:
  
  
  • Anthropic Claude Certified Associate / Developer
    
    
  • AWS Certified AI Practitioner or AWS Certified Generative AI Developer
    
    
  • Microsoft Azure AI Fundamentals
    
    
  • CompTIA AI+ or equivalent vendor-neutral credential 
    
    
• Frameworks & Orchestration: Experience with agent orchestration tools (e.g., LangChain, LangGraph, AutoGen). 
  
  
• Observability: Experience using LLM observability and cost-tracking platforms (e.g., LangSmith). 
  
  
• Automation Platforms: Familiarity with workflow automation tools (e.g., Power Automate, n8n, Zapier). 
  
  
• Model Customization: Hands-on experience with fine-tuning or local deployment frameworks (e.g., Ollama, OpenWebUI). 
  
  

Company Culture & Benefits

We foster a collaborative, innovative culture centered on continuous growth, cross-functional mentorship, and transformative technology. 

We offer a comprehensive benefits package designed to support full employee well-being, including:

• Competitive medical, dental, and vision health coverage 
  
  
• Retirement savings plans with employer matching 
  
  
• Short-term and long-term disability protection 
  
  
• Paid time off, holidays, and parental leave programs 
  
  
• Wellness programs and dedicated professional development initiatives