07/20/2026 updated


100 % available
AI Trainer | AI Model Evaluator | LLM Quality Analyst
GREENWOOD, USA
Only remote
Bachelor of Science in Computer Science (2023) - Full Sail UniversityAI AgentsLLMC (Programming Language)JavaScriptArtificial IntelligenceGoogle BigQueryCommand PromptGitHubPython (Programming Language)Node.jsAzure Machine LearningNext.jsSQL and Java (SQLJ)TypeScriptLarge Language Models
LLM Evaluation & AI Model Training
Expertise in evaluating large language model outputs for factual accuracy, logical reasoning, relevance, bias, safety, tone, clarity, and instruction adherence. Creation of prompts, evaluation rubrics, gold-standard responses, and scoring criteria for AI training and benchmarking assignments.
Reinforcement Learning from Human Feedback (RLHF) & Prompt Engineering
Proficiency in RLHF methodologies and prompt engineering to improve model reasoning and response quality. Development of high-quality technical and nontechnical training data and structured feedback to support model improvement and retraining.
Python Programming & Data Validation
Strong programming skills in Python for building validation workflows, identifying formatting errors, rubric violations, inconsistent reasoning, and model regressions. Experience developing and supporting AI and data workflows using Python and R.
Data Annotation & Labeling
Extensive experience performing text, image, search-query, and computer-vision annotation workflows with more than 95% precision. Maintenance of consistent quality while completing high-volume assignments under detailed project requirements.
CI/CD & Docker
Hands-on experience containerizing model pipelines with Docker to improve deployment consistency across development and production environments. Support of CI/CD processes to automate validation, testing, and production releases.
Google BigQuery & Cloud Data Tools
Practical experience creating AI governance guidelines and compliance audit checks in Google BigQuery to reduce quality and regulatory risks. Familiarity with Snowflake and other data tools for managing large-scale datasets.
JavaScript, SQL & Web Technologies
Programming knowledge in JavaScript, SQL, HTML, CSS, React, and Node.js. Background in backend development, REST APIs, and workflow automation.
Computer Vision & Object Detection
Experience with computer vision annotation workflows and object detection tasks as part of data labeling and AI quality improvement initiatives.
AI Governance & Compliance
Creation of AI governance guidelines and compliance audit checks to reduce quality and regulatory risks. Documentation of recurring model errors and recommendations for improvements to evaluation guidelines and annotation workflows.
Agile & Cross-functional Collaboration
Collaboration with data scientists, software engineers, and product teams to test, validate, and improve model workflows. Translation of technical findings into clear recommendations for cross-functional teams using Agile methodologies.
Expertise in evaluating large language model outputs for factual accuracy, logical reasoning, relevance, bias, safety, tone, clarity, and instruction adherence. Creation of prompts, evaluation rubrics, gold-standard responses, and scoring criteria for AI training and benchmarking assignments.
Reinforcement Learning from Human Feedback (RLHF) & Prompt Engineering
Proficiency in RLHF methodologies and prompt engineering to improve model reasoning and response quality. Development of high-quality technical and nontechnical training data and structured feedback to support model improvement and retraining.
Python Programming & Data Validation
Strong programming skills in Python for building validation workflows, identifying formatting errors, rubric violations, inconsistent reasoning, and model regressions. Experience developing and supporting AI and data workflows using Python and R.
Data Annotation & Labeling
Extensive experience performing text, image, search-query, and computer-vision annotation workflows with more than 95% precision. Maintenance of consistent quality while completing high-volume assignments under detailed project requirements.
CI/CD & Docker
Hands-on experience containerizing model pipelines with Docker to improve deployment consistency across development and production environments. Support of CI/CD processes to automate validation, testing, and production releases.
Google BigQuery & Cloud Data Tools
Practical experience creating AI governance guidelines and compliance audit checks in Google BigQuery to reduce quality and regulatory risks. Familiarity with Snowflake and other data tools for managing large-scale datasets.
JavaScript, SQL & Web Technologies
Programming knowledge in JavaScript, SQL, HTML, CSS, React, and Node.js. Background in backend development, REST APIs, and workflow automation.
Computer Vision & Object Detection
Experience with computer vision annotation workflows and object detection tasks as part of data labeling and AI quality improvement initiatives.
AI Governance & Compliance
Creation of AI governance guidelines and compliance audit checks to reduce quality and regulatory risks. Documentation of recurring model errors and recommendations for improvements to evaluation guidelines and annotation workflows.
Agile & Cross-functional Collaboration
Collaboration with data scientists, software engineers, and product teams to test, validate, and improve model workflows. Translation of technical findings into clear recommendations for cross-functional teams using Agile methodologies.
Experience
Professional experience5 - 10 years
Freelancer since2017
Languages
EnglishNative speaker
Project history
Training and evaluating large language models by reviewing AI-generated responses for factual accuracy, relevance, reasoning quality, clarity, safety, and instruction adherence. Creating and refining prompts, reference answers, scoring criteria, and evaluation rubrics for AI training and benchmarking assignments. Comparing multiple model responses and ranking outputs according to accuracy, completeness, usefulness, and alignment with user intent. Identifying hallucinations, logical inconsistencies, missing information, formatting issues, and policy violations in model-generated content.
Evaluating large language model outputs for factual accuracy, logical reasoning, relevance, bias, safety, tone, clarity, and compliance with user instructions. Creating prompts, evaluation rubrics, gold-standard responses, scoring criteria, and technical reasoning datasets for AI training and model benchmarking. Using Python validation scripts to identify omissions, formatting errors, rubric violations, inconsistent reasoning, and model regressions. Performing text, image, search-query, and computer-vision annotation workflows with more than 95% precision.
Designing assessment frameworks used to create engineering challenges and evaluate machine learning performance. Developing evaluation criteria to identify model limitations, reasoning errors, edge cases, and inconsistent outputs. Reviewing model responses against technical requirements and documenting actionable quality findings.