Principal AI/ML Architect / Applied AI Architect & Engineer
About Me
Strategy in one conversation.
Implementation in the next.
I design AI systems around the constraints that matter in production: reliability, latency, security, data quality, cost, and operational ownership.
7 min read · Bengaluru, India- 01Problem
- 02Architecture
- 03Prototype
- 04Engineering
- 05Evaluation
- 06Deployment
- 07Operation
- 08Improvement
Across the layers
I am a Principal AI/ML Architect and hands-on engineer focused on building AI systems that work reliably outside of demonstrations. My work sits at the intersection of technology strategy, enterprise architecture, AI/ML engineering, data systems, platform engineering, security, and production operations. I care about the complete path from a useful idea to a system that people can depend on.
That means moving between different levels of detail. At one moment I may be discussing AI platform strategy, governance, security boundaries, or operating models with CTO, CIO, and CISO stakeholders. At another, I may be working through retrieval quality, agent orchestration, API contracts, evaluation methodology, or deployment architecture with engineering teams. Those conversations are connected: an architectural commitment has consequences in code, and implementation evidence should change architectural decisions.
I lead work across the full lifecycle: identifying valuable problems, shaping technical strategy, prototyping, evaluating, engineering, deploying, and supporting long-term adoption. I want the system to remain useful after the initial team moves on. That requires maintainable interfaces, clear ownership, and a way to learn from production behavior.
AI is a systems problem.
A model is one component in a larger chain. A user brings an intent and a workflow. The application translates that into context, retrieval requests, tool calls, and model interactions. Data quality, identity, APIs, infrastructure, and operational controls shape what the system can actually deliver. A strong model cannot recover information that the retrieval layer never supplied, or make an unauthorized action acceptable.
I start by looking at that chain as a whole. Where does information enter? Which components can change state? What does the user see when a dependency fails? Which decisions can be retried, and which need a person? A system diagram should make these boundaries visible rather than place everything inside a box labelled “AI.”
This view also changes how I define success. A plausible answer is insufficient if it arrives too late, exposes information, cannot be traced to evidence, or requires expensive manual recovery. Evaluation and observability need to cover the workflow that the user experiences, including its failure paths.
Architecture that can be operated
The best architecture is rarely the most complicated one. I prefer systems whose behavior can be understood, measured, operated, and improved. Simplicity matters because every additional service, state transition, or infrastructure dependency creates another place where assumptions can diverge.
I evaluate choices against reliability, latency, cost, scale, security, privacy, governance, and maintainability. These constraints interact. A cache can reduce latency while making freshness and authorization harder. An additional retrieval stage can improve relevance while consuming the response budget. Centralizing a platform capability can reduce duplicated work while creating a shared dependency.
I make those trade-offs explicit and connect them to expected workloads. Developer experience and operational ownership belong in the same discussion. Someone needs to understand the deployment, interpret an alert, restore data, and reverse a failed release. Architecture should give that person a usable system, not just a diagram of the intended happy path.
From strategy to code
Architectural decisions become meaningful when they survive implementation. I stay close to prototypes and reference implementations because they expose ambiguities that a design review can miss: an underspecified API, an expensive data access pattern, a missing cancellation path, or a quality assumption that does not hold on realistic inputs.
I use prototypes to answer bounded questions. Can retrieval find the required evidence? Can an agent complete the workflow within its permission and time budget? Can a service recover after interruption without repeating an external side effect? The result should inform a decision, including the decision to simplify or stop an approach.
Working directly with engineering teams also makes validation continuous. Failure analysis, performance measurement, evaluation runs, and integration tests give architecture a feedback loop. I value a small working slice that tests the difficult boundary before investing in the entire platform.
Agents need explicit boundaries
I approach production agents as distributed systems with model-driven decision components. Tool access, identity, authorization, state, memory, and failure handling need explicit designs. A model can suggest the next action; the surrounding system must decide whether that action is permitted and how it is executed.
Memory needs provenance and a lifecycle. Tool results need to be treated according to their source and trust level. Retries need limits, and actions with external effects need an idempotency or reconciliation strategy. Human approval is useful when it is attached to a concrete action, with enough context for a person to make an informed decision.
I want an agent trace to explain what happened: the relevant input, selected tool, policy decision, result, and state transition. Evaluation should inspect that sequence, not only the final paragraph. My public agent-guard project explores the authorization boundary; selected work explains the architectural decisions behind it.
Retrieval is a data lifecycle
Retrieval quality begins before the query. Ingestion, document identity, parsing, metadata, access rules, indexing, updates, and deletion determine what information is available and who should see it. A useful RAG system needs a defensible answer to “which version of this source did we use?”
I consider lexical search, dense retrieval, hybrid methods, ranking, and reranking in terms of the query distribution and the available evidence. Exact identifiers and ambiguous natural-language questions may need different retrieval behavior. More context can also add distraction, so retrieval and context selection should be evaluated together.
Freshness and authorization are architectural concerns rather than finishing touches. Index updates must follow the document lifecycle, and permissions must remain effective after caching and transformation. I measure retrieval separately from generation where possible, so a fluent answer does not hide missing evidence. Latency budgets help decide which improvements are practical in the user’s workflow.
Evaluation belongs in the architecture
Evaluation should begin while the system is being designed. I want representative cases, explicit failure categories, and a baseline before making large changes. Golden datasets are useful when they reflect actual tasks and remain versioned, reviewed, and separated from the examples used to tune the system.
Different questions need different checks. Retrieval evaluation can measure whether required evidence is present. Agent evaluation can inspect tool selection, authorization, termination, and recovery. Deterministic checks can validate structured outputs and invariants. Model-based judges can help assess open-ended answers when their criteria are calibrated against human review.
Offline evaluation is only part of the picture. Online signals, user corrections, latency, costs, and support incidents reveal how the system behaves under changing conditions. I connect those signals to regression detection and new test cases. Continuous evaluation is an operating capability: it needs data ownership, repeatable runs, and a decision process for acting on results.
Enterprise requirements shape the system
Identity, security, privacy, data governance, auditability, and integration requirements influence service boundaries from the beginning. Data residency can constrain provider selection and deployment regions. Retention rules affect traces and memory. Existing authorization systems determine how retrieval and tools should enforce access.
I look for reusable platform patterns where they reduce repeated effort: common identity integration, evaluation interfaces, observability conventions, and deployment paths. Reuse should still leave room for different workload needs. A single default is useful; a single mandatory architecture for every use case can become an obstacle.
Enterprise adoption also requires an operating model. Who owns the data connection? Who approves a model or policy change? Who responds when quality degrades? Cost allocation, production support, and organizational ownership are part of making the system sustainable, alongside the technical implementation.
Working with teams
I work with research, product, engineering, security, platform, and data teams to turn emerging capabilities into systems people can use. Research helps establish what may be possible; product clarifies the workflow and value; engineering and platform teams make the system deliverable and operable. Security and data teams make trust boundaries and information responsibilities concrete.
Good architecture creates alignment and enables delivery. I use clear interfaces, recorded decisions, small reference implementations, and measurable acceptance criteria to connect those perspectives. Documentation is useful when it supports a decision or helps someone operate the system. It should evolve with implementation evidence rather than become a separate account of what the system was meant to be.
What keeps me interested
I am interested in production AI, human–AI workflows, agent systems, retrieval architectures, evaluation, distributed systems, AI infrastructure, enterprise platforms, security, and developer tools. The recurring question is how to make a powerful capability understandable and dependable enough to use in a real workflow.
My public repositories are places to explore architecture patterns, prototype ideas, test technical assumptions, and make engineering concepts concrete. They include open-source tools and research implementations. I keep that evidence distinct from confidential professional work and from claims about adoption or measured production impact.
Writing helps me make architectural reasoning explicit: what problem a decision addresses, what it costs, and when it should be reconsidered. I use it to examine difficult boundaries and explain trade-offs that are easy to hide behind a product name or a model choice.
If these areas overlap with what you are working on, I am interested in a thoughtful technical conversation. You can connect with me about architecture, engineering roles, shared technical problems, or an idea worth exploring.
A GOOD CONVERSATION STARTS SOMEWHERE
Let’s connect.
Working on a difficult AI or engineering problem? Hiring for a senior architecture role? Or simply interested in exchanging ideas?
I’d like to hear from you