BIRMINGHAM, UK · INDEPENDENT CONSULTING

Quality for AI
that matters.

Turn uncertain AI behaviour into clear, reviewable evidence. I help teams evaluate LLMs, validate RAG systems, and build automation they can trust.

AI Quality Architect · Test Architect · Senior SDET

14+ yearsEnterprise quality engineering

Healthcare & financeDomain-aware testing

Evidence firstExplicit criteria, visible limitations

WHERE I CAN HELP

From a quality question
to a defensible decision.

Start with a focused scope. Agree the evidence needed before choosing the tools.

01

LLM & RAG evaluation

Find hallucinations, retrieval failures and regressions before they reach users.

  • Evaluation datasets and quality rubrics
  • Grounding, relevance and accuracy checks
  • Prompt and model regression analysis
DeepEval · GEval · Python
02

UI & API automation

Build maintainable checks for the journeys that matter most to your product.

  • Playwright and Selenium frameworks
  • API contracts and cross-browser coverage
  • CI reports, traces and release gates
Playwright · TypeScript · REST
03

AI release assurance

Connect test results, human review and observability into a clear release decision.

  • Agent workflow and tool-call validation
  • Hard failure rules and review checkpoints
  • Failure triage and handover guidance
RAG · Agents · CI/CD

PUBLIC ENGINEERING EVIDENCE

Don’t take a claim.
Inspect the work.

Selected public reference projects. These demonstrate engineering approaches using synthetic or controlled examples; they are separate from employment outcomes.

REFERENCE IMPLEMENTATION

LLM Quality Evaluation Harness

A provider-neutral approach to datasets, deterministic metrics, regression comparisons and explicit release policies. The reference mode runs offline with synthetic data.

Python · RAG validation · CI quality gates
REFERENCE FRAMEWORK

Playwright Enterprise Test Framework

Typed UI/API tests, fixtures, cross-browser configuration, diagnostics and configurable quality gates. A documented local API path gives reviewers a focused starting point.

TypeScript · Playwright · GitHub Actions
Explore the wider portfolio evidence index

THE EXPERIENCE BEHIND THE WORK

Architecture with
hands-on depth.

I’m Ashok Kumar Manohar, an AI Quality Engineering Architect with experience at Happiest Minds Technologies, Acentra Health and Wipro. My work spans test architecture, healthcare API quality, banking regression and AI evaluation.

My approach combines deterministic checks, calibrated evaluation and clear human accountability. I favour practical systems that another engineer can inspect and maintain.

Professional background ↗

SELECTED EMPLOYMENT OUTCOMES

60% → 95%HL7 FHIR R4 API automation coverage
4h → <1hFull regression execution time
40% fewerEscaped defects year on year
Career outcomes reported in my CV. These figures are not results from the public reference projects above.

LET’S DEFINE THE FIRST MILESTONE

What needs to be
more reliable?

Share your application, AI workflow or test coverage challenge. We can agree a focused scope, acceptance criteria and handover.