Nicholas Hopper

LLM evaluation

Nicholas Hopper has used LLM evaluation in his work at APX Stream and Memector.

Where Nicholas Hopper has used LLM evaluation

  • Built the evaluation suite that gates every prompt and model change on scored regression sets.

    AI Engineer, APX Stream

  • Wrote the specifications and review standards for prompts, evals and agent code, and advises leadership on build versus buy, model choice and cost.

    AI Engineer, APX Stream

  • Added an LLM-as-judge entailment check on drafted answers that fails closed when the judge is unavailable or its output cannot be parsed.

    AI Engineer, APX Stream

  • Built golden-set benches for document extraction tools, scored on recall, precision and exact-answer accuracy.

    AI Engineer, APX Stream

  • Measured recall@1 of 94% and recall@5 of 100% on 50 vague queries that do not contain the template's name, with median latency around 100 ms.

    Memector