使用此技能用于 Hugging Face Dataset Viewer API 工作流程,这些工作流程可以获取子集/分集元数据,平分行,搜索文本,应用过滤器,下载parquet URL,并读取大小或统计数据.
何时用
官方 description 未单独写出 Use when。按规范,代理会在用户任务与这段 description 的关键词匹配时激活本技能。
代理如何加载
按 Agent Skills 渐进披露:启动时只加载 name 与 description(约 100 token);任务匹配后才读入整份 SKILL.md 正文;scripts/、references/、assets/ 仅在需要时再读。 本文件正文结构:Hugging Face Dataset Viewer、Core workflow、Defaults、Dataset Viewer、Creating and Uploading Datasets、Agent Traces。 其中含规范建议的小节:分步指令。
文件分析
文件分析:这是一份仅含 SKILL.md 的指令型技能,代理激活后整份正文进入上下文。
官方 description(原文)
Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or statistics.
Hugging Face Dataset ViewerCore workflowDefaultsDataset ViewerCreating and Uploading DatasetsAgent Traces
Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or statistics.
---
name: huggingface-datasets
description: Use this skill for Hugging Face Dataset Viewer API workflows that fetch subset/split metadata, paginate rows, search text, apply filters, download parquet URLs, and read size or statistics.
---
# Hugging Face Dataset Viewer
Use this skill to execute read-only Dataset Viewer API calls for dataset exploration and extraction.
## Core workflow
1. Optionally validate dataset availability with `/is-valid`.
2. Resolve `config` + `split` with `/splits`.
3. Preview with `/first-rows`.
4. Paginate content with `/rows` using `offset` and `length` (max 100).
5. Use `/search` for text matching and `/filter` for row predicates.
6. Retrieve parquet links via `/parquet` and totals/metadata via `/size` and `/statistics`.
## Defaults
- Base URL: `https://datasets-server.huggingface.co`
- Default API method: `GET`
- Query params should be URL-encoded.
- `offset` is 0-based.
- `length` max is usually `100` for row-like endpoints.
- Gated/private datasets require `Authorization: Bearer `.
## Dataset Viewer
- `Validate dataset`: `/is-valid?dataset=`
- `List subsets and splits`: `/splits?dataset=`
- `Preview first rows`: `/first-rows?dataset=&config=&split=`
- `Paginate rows`: `/rows?dataset=&config=&split=&offset=&length=`
- `Search text`: `/search?dataset=&config=&split=&query=&offset=&length=`
- `Filter with predicates`: `/filter?dataset=&config=&split=&where=&orderby=&offset=&length=`
- `List parquet shards`: `/parquet?dataset=`
- `Get size totals`: `/size?dataset=`
- `Get column statistics`: `/statistics?dataset=&config=&split=`
- `Get Croissant metadata (if available)`: `/croissant?dataset=`
Pagination pattern:
```bash
curl "https://datasets-server.huggingface.co/rows?dataset=stanfordnlp/imdb&config=plain_text&split=train&offset=0&length=100"
curl "https://datasets-server.huggingface.co/rows?dataset=stanfordnlp/imdb&config=plain_text&split=train&offset=100&length=100"
```
When pagination is partial, use response fields such as `num_rows_total`, `num_rows_per_page`, and `partial` to drive continuation logic.
Search/filter notes:
- `/search` matches string columns (full-text style behavior is internal to the API).
- `/filter` requires predicate syntax in `where` and optional sort in `orderby`.
- Keep filtering and searches read-only and side-effect free.
For CLI-based parquet URL discovery or SQL, use the `hf-cli` skill with `hf datasets parquet` and `hf datasets sql`.
## Creating and Uploading Datasets
Use one of these flows depending on dependency constraints.
Zero local dependencies (Hub UI):
- Create dataset repo in browser: `https://huggingface.co/new-dataset`
- Upload parquet files in the repo "Files and versions" page.
- Verify shards appear in Dataset Viewer:
```bash
curl -s "https://datasets-server.huggingface.co/parquet?dataset=/"
```
Low dependency CLI flow (`npx @huggingface/hub` / `hfjs`):
- Set auth token:
```bash
export HF_TOKEN=
```
- Upload parquet folder to a dataset repo (auto-creates repo if missing):
```bash
npx -y @huggingface/hub upload datasets// ./local/parquet-folder data
```
- Upload as private repo on creation:
```bash
npx -y @huggingface/hub upload datasets// ./local/parquet-folder data --private
```
After upload, call `/parquet` to discover `//` values for querying with `@~parquet`.
## Agent Traces
The Hub supports raw agent session traces from Claude Code, Codex, and Pi Agent. Upload them to Hugging Face Datasets as original JSONL files and the Hub can auto-detect the trace format, tag the dataset as `Traces`, and enable the trace viewer for browsing sessions, turns, tool calls, and model responses. Common local session directories:
- Claude Code: `~/.claude/projects`
- Codex: `~/.codex/sessions`
- Pi: `~/.pi/agent/sessions`
Default to private dataset repos because traces can contain prompts, file paths, tool outputs, secrets, or PII. Preserve the raw `.jsonl` files and nest them by project/cwd instead of uploading every session at the dataset root.
```bash
hf repos create / --type dataset --private --exist-ok
hf upload / ~/.codex/sessions codex/ --type dataset
```