- name
SKILL.md
The skill file stays in the publisher's repository.
Paste the copied command in a terminal. It installs this SKILL.md into that agent.
npx skills add awslabs/agent-plugins --skill dataset-evaluation -a cursor -yPaste the copied command in a terminal. It installs this SKILL.md into that agent.
npx skills add awslabs/agent-plugins --skill dataset-evaluation -a claude-code -yPaste the copied command in a terminal. It installs this SKILL.md into that agent.
npx skills add awslabs/agent-plugins --skill dataset-evaluation -a codex -yPaste the copied command in a terminal. It installs this SKILL.md into that agent.
npx skills add awslabs/agent-plugins --skill dataset-evaluation -a grok -ySend the copied message in a Grok Bot chat. The Bot fetches this SKILL.md from GitHub and adds it to the skills all your Bots share.
Install this skill: https://github.com/awslabs/agent-plugins/tree/HEAD/plugins/sagemaker-ai/skills/dataset-evaluationFrom the publisher
Follow the workflow shown below. Locate the dataset, check the file type, and resolve any issues with missing files or wrong file types. Determine the fine-tuning model and fine-tuning strategy. Run the appropriate validation based on the model family. Summarize the results: is the dataset ready for fine-tuning?
sdk-getting-started skill first.Locate Dataset:
Determine strategy and model:
Check File Formatting: Run the tool format_detector.py to make sure the file conforms to formatting requirements.
Summarize Results: Tell the user if their data is ready
references/strategy_data_requirements.mdreferences/custom-scorer-evaluation-dataset-formats.md and validate against the scorer-specific schema. The scorer type should be known from conversation context (determined in the model-evaluation skill).# With the file path argument identified in workflow step 1
python scripts/format_detector.py local_path/to/dataset
scripts/format_detector.py — Self-contained format validation scriptreferences/strategy_data_requirements.md — Data format requirements per strategyValidates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the user says "is my dataset okay", "evaluate my data", "check my training data", "I have my own
---name: dataset-evaluationdescription: Validates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the…---# plugins/sagemaker-ai/skills/dataset-evaluation/SKILL.mdOverview
Validates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the user says "is my dataset okay", "evaluate my data", "check my training data", "I have my own data", or before starting any fine-tuning job. Detects file format, checks schema compliance against the selected model and technique, and reports whether the data is ready for training or evaluation.
FAQ
Download plugins/sagemaker-ai/skills/dataset-evaluation/SKILL.md from the publisher, or copy the path and open the repository. PlugMCP lists the skill and does not host the file.
The publisher keeps it at https://github.com/awslabs/agent-plugins.
Claude, Cursor, Codex, and Grok Build can read a SKILL.md you add from the publisher's repository. Grok Bot installs it when you send the skill's GitHub folder link in a chat.