Blacksmith

List all Blacksmith organizations accessible to your account. Use this first to see available orgs.

Get the status of the current organization (personal org, onboarding, runner region).

List workflow runs with filtering. Filter by status (success/failure/cancelled/skipped/in_progress), branch, workflow name, actor, or PR number. Example: list_runs(status="failure") to find failed runs.

Get details of a specific workflow run by ID. Includes list of jobs.

List all jobs for a specific workflow run. Use this to get job IDs for get_job, get_job_logs, and get_job_tests.

Get details of a specific job including steps, runner info, and timing.

Get the logs for a specific job. Returns raw log output.

Get test results for a job. Optionally filter by status (pass/fail/skip).

Get failed tests for a job with full error details. Use error_lines param to control stack trace length. Returns all failures by default (no limit).

Group failed tests by error pattern (e.g., "is not a function", "Cannot read properties"). Shows count, affected suites/files, and sample error for each pattern. Best for quickly identifying root causes.

Compare test failures between two runs to identify regressions. Shows new failures, fixed tests, and persistent failures. If base_run_id not provided, compares against most recent prior run.

Detect flaky tests by analyzing pass/fail patterns across recent runs. Returns tests that fail intermittently (e.g., "failed 3 of 10 runs"). Killer feature for CI stability.

Find tests exceeding a duration threshold. Shows slowest tests, their percentage of total test time, and average duration stats.

Get the failure history for a specific test across recent runs. Shows when it passed/failed, on which branches, and error messages for failures.

Track metrics over time: duration (are tests getting slower?), failure_rate (are tests getting flakier?), test_count (are we adding tests?). Returns trend analysis with data points.

Get current core usage snapshot (active cores vs max cores).

Get the current billing period invoice amount.

Get usage summary showing billable minutes vs free tier allowance. Shows remaining free minutes and overage.

Get Blacksmith cache statistics: total size, hit rate, entries by repository. Shows how effectively caching is being used.

Get detailed cache entries for a repository. Shows cache keys, sizes, scopes (branches), and last hit times. Useful for debugging cache issues.

Search logs across all jobs. Filter by query (e.g., "error", "timeout"), log level (INFO/WARN/ERROR/DEBUG), and time range. Great for finding issues across runs.