Loading profile…
Agustin Diaz Lusarreta
Looking for a jobAI Agent / LLM Evaluation Analyst
I test AI agents and LLM outputs to uncover failures and improve model quality.
ArgentinaAI Agent / LLM Evaluation Analyst at Lyra Project
Experience
AI Agent / LLM Evaluation Analyst
Tested and evaluated a conversational AI agent across complex multi-turn interactions, designing adversarial prompts to identify weaknesses and inconsistencies. Evaluated responses for factuality, reasoning, instruction following, and contextual understanding, and provided structured feedback for model improvement.
LLM EvaluationAI Agent TestingAdversarial PromptingFailure Mode AnalysisEvaluation rubricsInstruction FollowingFactualityReasoningContextual UnderstandingHuman Feedback
Multilingual Search Quality Analyst / AI Evaluator
Evaluated search results and AI-generated responses for relevance, factual accuracy, reasoning, instruction adherence, clarity, and usefulness. Created evaluation rubrics, designed challenging prompts, ranked alternative responses, and identified hallucinations and logical errors.
Search QualityAI EvaluationMultilingual EvaluationEvaluation rubricsPrompt EngineeringResponse RankingHallucination DetectionFactual AccuracyReasoningLocalization
AI Audio Quality Evaluator
Evaluated AI-generated audio and speech for quality, naturalness, intelligibility, consistency, pronunciation, and transcript alignment. Identified TTS/audio artifacts and provided structured feedback using standardized criteria.
AI Audio EvaluationTTS EvaluationQuality Assessmenterror detectionStructured Feedback
QA Technician
Performed quality-control testing, sampling, data recording, and analysis under standardized procedures and specifications. Identified deviations, investigated quality issues, maintained documentation, and supported corrective actions.
Quality AssuranceTestingData AnalysisDocumentationProblem Solving
Education
Agricultural Engineer
Completed an Agricultural Engineering degree in Argentina.