Job Description
Career Opportunity for AI Application Engineer in Japan!
■ AI Application Engineer
■ Company Overview
An e-commerce, fintech, digital content and communications company with more than 30,000 employees, and operations in 30 countries and regions.
■ Your Role and Responsibilities
● Design and develop AI agents for key use cases such as search, booking, and customer support, including orchestration across MCP, tools, and backend systems.
● Define functional and non-functional requirements for AI agents based on business needs and user pain points.
● Implement and continuously improve AI agent and MCP platforms using LLM APIs (e.g., OpenAI, Vertex AI, Azure OpenAI) and modern agent frameworks.
● Design context management through knowledge bases and RAG architectures, and integrate with internal and external APIs/systems (e.g., tool invocation, multi-agent communication).
● Define conversation-quality metrics, build automated evaluation and test cases, and continuously drive quality improvements based on user logs and feedback.
● Own deployment, monitoring, and troubleshooting in production environments, and plan A/B tests to to evaluate the effectiveness and improve the system.
● Establish and refine development processes (e.g., Docker, CI/CD), providing technical leadership to the team through code reviews, mentoring, and knowledge sharing.
■ Mandatory Qualifications
● 5+ years of experience developing systems that incorporate machine learning/AI.
● 2+ years of experience leading projects end to end, from system design to production release, for systems using machine learning/AI (experience with AI agent–related products is a strong plus).
● Hands-on experience developing AI agents/MCP using AI agent frameworks such as OpenAI Agent SDK, Google ADK, etc.
● Experience in context engineering to personalize AI agent behavior and optimize response quality.
● Experience designing evaluation frameworks for AI agents and automating evaluation workflows.
● Experience working in cross-functional teams.
● Experience validating impact based on the product KPIs, and driving continuous improvement through A/B testing.
■ Mandatory Qualifications
● Practical experience applying machine learning to real-world business problems, or an academic background in a related field (Master’s degree or above, or equivalent research experience such as conference presentations).
● Experience with DevOps / LLMOps practices (e.g., Docker, CI/CD).
● Development experience on cloud infrastructure platforms such as Google Cloud Platform (GCP).
● Japanese communication skills (business level preferred).
■ Good Reasons to Join
● Hybrid position in Japan
● Work with International team members
■ Work Location
Tokyo, Japan
Details will be provided during the meeting.