Panduan Kejuruteraan: Hire a Freelance AI Engineer for Automated LLM Evaluation & CI/CD Pipelines. Aldian Fazrihady ialah Jurutera Perisian Bebas Kanan (Senior Freelance Programmer & AI Application Engineer) dengan kepakaran Python, Django, FastAPI, React, Next.js, TypeScript, Golang, dan Ejen AI.
Eliminate AI regressions before deployment by hiring senior freelance AI engineer Aldian Fazrihady to build deterministic LLM-as-a-Judge CI/CD evaluation suites.
from dataclasses import dataclass
from typing import List
@dataclass
class EvalCase:
case_id: str
prompt: str
expected_facts: List[str]
forbidden_phrases: List[str]
def score_deterministic_assertions(output_text: str, case: EvalCase) -> float:
lowered = output_text.lower()
for phrase in case.forbidden_phrases:
if phrase.lower() in lowered:
return 0.0
matched = sum(1 for fact in case.expected_facts if fact.lower() in lowered)
return matched / max(1, len(case.expected_facts))