About the Role
We are seeking a Senior Principal AI Architect to define and own the architectural foundation of PubMatic’s AI and Agentic Systems platform. This role will serve as the highest technical authority for AI architecture across the organization. This is a technical leadership role focused on architectural correctness, system integrity, platform governance, and long-term AI infrastructure health. The role partners closely with engineering, product, infrastructure, and business leaders to ensure AI systems are scalable, reliable, cost-efficient, and strategically aligned. The role demands a hands-on technical leadership style, ensuring direct involvement in critical AI and agentic system design decisions.
What You'll Do
- AI & Agentic Systems Technical Architect
- Define and enforce architecture-first principles for AI and agentic systems.
- Review system designs and recommend appropriate models, frameworks, and patterns.
- Translate non-functional requirements (latency, reliability, scalability, observability, cost) into concrete designs.
- Serve as final technical escalation point for complex AI decisions.
- Guide model selection, evaluation, and deployment strategies.
- AI / Agent Core Platform Architect
- Architect the agent ecosystem as a cohesive platform.
- Define shared agent patterns and orchestration frameworks.
- Establish standards for autonomy levels, guardrails, and safety.
- Ensure alignment between agent behaviour and business logic.
- Drive standardization of evaluation and lifecycle management.
- Cross-Functional Technical Representative
- Act as the technical voice in company-wide AI discussions.
- Clearly articulate system capabilities and trade-offs.
- Translate customer and business requirements into architecture.
- Partner with product and business teams for scalable AI solutions.
- AI Evangelism & Organizational Maturity Leader
- Raise AI maturity across engineering.
- Conduct knowledge-sharing sessions on emerging models and frameworks.
- Share lessons learned from deployments.
- Influence AI engineering best practices organization wide.
We'd Love for You to Have
- 12+ years of software engineering experience.
- 3+ years designing and deploying AI/ML systems in production.
- Deep expertise in LLMs, agentic systems, distributed systems, scalable inference infrastructure.
- Strong experience with cloud infrastructure and containerization.
- Proven ability to translate business requirements into architecture.
- Excellent communication and technical leadership skills.
- Strong hands-on experience in designing, implementing, and reviewing AI/ML systems and infrastructure.
Preferred Qualifications
- Experience building or governing internal AI platforms.
- Experience in AdTech or high-scale data platforms.
- Exposure to AI safety and governance frameworks.
- Prior experience at Principal, or Staff+ level.
- Being up to date with the latest tech trends and advancements in the Agentic AI space.
Qualification
- Should have a bachelor’s degree in engineering (CS / IT) or equivalent degree from well-known Institutes / Universities.