Skip to content

docs(agenteye): document the agenteye-python-sdk agent skill#568

Merged
NiveditJain merged 2 commits into
mainfrom
docs/agenteye-python-sdk-skill
Jul 17, 2026
Merged

docs(agenteye): document the agenteye-python-sdk agent skill#568
NiveditJain merged 2 commits into
mainfrom
docs/agenteye-python-sdk-skill

Conversation

@NiveditJain

@NiveditJain NiveditJain commented Jul 17, 2026

Copy link
Copy Markdown
Member

Summary

Adds /agenteye/python-sdk-skill, and fixes an install command on /agenteye/python-sdk that has been telling readers to install the wrong product.

agenteye-cli has had a page since #561 and agenteye-evaluator since #567. The third skill — the one that gets an agent emitting events in the first place — had none, which is the wrong one to be missing: there is nothing to evaluate and nothing to read back until a session exists, so this is where a new customer actually starts.

What the page says, and why

The silences are the story, not the API. The SDK is thirteen keyword-only methods; an agent can read /agenteye/python-sdk and produce plausible instrumentation in a minute. The reason a skill earns its place is that this SDK doesn't raise when you get it wrong, and wrong instrumentation is indistinguishable from right instrumentation until someone opens an empty dashboard:

The mistake What you see
No agent_start Every event lands. Zero sessions.
Environment never set Everything works, filed under dev.
outcome="failure" The run shows green — only failed/error/timeout/rejected count.
A typo'd field name Accepted and stored as a new field.
Events from a thread pool Silently dropped.

So the page's weight sits on the skill's third step — running the agent and reading the event files back. That step is the one people skip, and the SDK writes to local files, so a full integration can be proven with no server, no API key, and no network. That property is what makes the skill's promise checkable rather than aspirational.

pip install agenteye installed the wrong product. /agenteye/python-sdk said "Install the SDK from PyPI: pip install agenteye". That name on public PyPI is the CLI — a separate product sharing the distribution name — so the documented command gave readers the CLI, and import agenteye then failed with ModuleNotFoundError (the CLI's module is agenteye_cli). The SDK is distributed privately and is not on any public index.

The page now states that distribution is private and points at onboarding, rather than naming a command that cannot work. It deliberately does not detail the private install mechanics — that is signed-customer material and lives in the enterprise docs. The skill page carries the same fact framed as a tell ("if your agent proposes installing from a public index, the skill didn't load"), which is the shape #567 used for the evaluator's unclaimed-name problem.

Changes

File Change
docs/agenteye/python-sdk-skill.mdx New page
docs/agenteye/python-sdk.mdx Installation section: private distribution + a pointer to the skill, replacing the incorrect PyPI command
docs/docs.json English nav entry, after python-sdk in SDK and CLI (same parent-then-skill placement #567 used)
docs/agenteye/cli-skill.mdx Sibling row in the interfaces table + next-steps link
docs/agenteye/evaluator-skill.mdx Row pointing back here for "your agent isn't emitting sessions yet"
CHANGELOG.md Docs entry under 0.0.14-beta.1 — 2026-07-17

Translations

English nav only. The daily translate-docs cron walks the English .mdx, picks up the new source via the content-hash cache, and --update-nav regenerates the 14 localized navs from the English tabs — so the locales fill in on the next run rather than needing 15 hand-written entries here.

Worth noting explicitly: an earlier pass at docs.json rewrote it with json.dumps, which escaped every non-ASCII character and mangled all 14 locale nav labels (快速开始快速...) — a 49-line diff hiding behind a one-line change. Reverted and inserted surgically; the diff here is exactly +1 line.

Testing

  • bun run validate:mdx647 pages parse cleanly (646 before this page).
  • Verified every one of the 632 nav entries across all 15 languages resolves to a file, and that no agenteye/*.mdx is missing from the nav — the second direction is the one mintlify validate does not check, so an unregistered page would otherwise be green CI with no sidebar link.
  • Confirmed agenteye/python-sdk-skill was added to the en nav only, and no locale nav gained an entry (which would break validation for a page they don't have yet).
  • ⚠️ mintlify@4.2.680 validate could not be run locally: it refuses node 25+ and this machine is on 26. Leaving that to the docs CI job — please don't merge on a red run. Everything it checks for this change (docs.json structure, nav-link resolution) is covered by the checks above, but it is the authority, not me.

🤖 Generated with Claude Code

Summary by CodeRabbit

  • New Features

    • Added documentation for the Python SDK Agent Skill, including setup, instrumentation planning, verification, and troubleshooting guidance.
    • Added the Python SDK skill to documentation navigation and related CLI and evaluator resources.
  • Documentation

    • Updated SDK installation guidance for private wheel distribution.
    • Added package verification instructions and clarified how the SDK skill supports integration.
    • Updated the changelog with the new documentation resources.

Adds /agenteye/python-sdk-skill, completing the set: agenteye-cli has had a
page since #561 and agenteye-evaluator since #567, but the skill that gets an
agent emitting events in the first place had none — and it is the one the
other two depend on. There is nothing to score and nothing to read until a
session exists.

The page leads with the silences rather than the API. The SDK's thirteen
methods are easy to call and easy to get quietly wrong: no agent_start means
every event lands and zero sessions appear; an unset environment files
production runs under dev; outcome="failure" reads as success because only
failed/error/timeout/rejected count; a typo'd field is accepted as a new
field; events from a thread pool are dropped. None of them raise. So the
page's weight sits on the skill's third step — verifying against the event
files the SDK writes, which needs no server, no API key, and no network.

Also fixes /agenteye/python-sdk, which told every reader to
`pip install agenteye`. That name on public PyPI is the CLI — a different
product sharing the distribution name — so the documented command installed
the wrong thing and left `import agenteye` failing. The SDK is distributed
privately, so the page now says that and points at onboarding rather than
naming a command that cannot work.

Cross-linked from cli-skill and evaluator-skill. English nav entry only; the
daily translate-docs cron regenerates the 14 localized navs from the English
tabs.
@coderabbitai

coderabbitai Bot commented Jul 17, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 32f00aa6-5d18-4615-8807-b54ab1e2b5cd

📥 Commits

Reviewing files that changed from the base of the PR and between dea1761 and b829562.

📒 Files selected for processing (6)
  • CHANGELOG.md
  • docs/agenteye/cli-skill.mdx
  • docs/agenteye/evaluator-skill.mdx
  • docs/agenteye/python-sdk-skill.mdx
  • docs/agenteye/python-sdk.mdx
  • docs/docs.json

📝 Walkthrough

Walkthrough

Adds a Python SDK Agent Skill documentation page, updates private SDK installation guidance, registers the page in documentation navigation, and links it from the CLI and evaluator skill pages.

Changes

Python SDK skill documentation

Layer / File(s) Summary
Python SDK skill workflow
docs/agenteye/python-sdk-skill.mdx
Documents the skill’s purpose, instrumentation workflow, prerequisites, installation, offline verification, examples, cautions, and related resources.
SDK installation guidance
docs/agenteye/python-sdk.mdx, CHANGELOG.md
Replaces PyPI installation instructions with private-wheel onboarding and version verification, and records the documentation update.
Skill navigation and cross-links
docs/docs.json, docs/agenteye/cli-skill.mdx, docs/agenteye/evaluator-skill.mdx
Adds the new page to SDK and CLI navigation and links it from CLI and evaluator documentation.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

Suggested labels: enhancement

Suggested reviewers: hermes-exosphere

Poem

I’m a rabbit with SDK notes in a row,
Helping telemetry safely grow.
Wheels install, event files gleam,
Skills cross-link like a carrot dream.
Hop through the docs—everything’s in flow!

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and concisely summarizes the main change: documenting the agenteye-python-sdk agent skill.
Description check ✅ Passed It explains the purpose, changes, and testing clearly, even though it doesn't follow the template headings exactly.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

Warning

There were issues while running some tools. Please review the errors and either fix the tool's configuration or disable the tool if it's a critical failure.

🔧 ESLint

If the error stems from missing dependencies, add them to the package.json file. For unrecoverable errors (e.g., due to private dependencies), disable the tool in the CodeRabbit configuration.

ESLint install failed. For unrecoverable errors, disable the tool in CodeRabbit configuration.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot added the enhancement New feature or request label Jul 17, 2026
@hermes-exosphere

Copy link
Copy Markdown
Contributor

Automated code review started - full review. Results will be posted here.

@hermes-exosphere

Copy link
Copy Markdown
Contributor

[progress] Review in progress — Phase 0-2 complete. Running build & MDX validation now...

@hermes-exosphere

Copy link
Copy Markdown
Contributor

Build & test complete. Results:

  • TypeScript: clean (0 errors)
  • Tests: 2174 passed / 0 failed (124 test files)
  • MDX validation: 647 pages parsed cleanly

@hermes-exosphere

Copy link
Copy Markdown
Contributor

🔍 Automated Code Review

📋 Executive Summary

This PR adds the agenteye-python-sdk agent skill documentation page and fixes a critical documentation bug where /agenteye/python-sdk told readers to pip install agenteye — a command that installed the wrong product (the CLI, not the SDK). The new page completes the three-skill set (CLI, Evaluator, Python SDK) with a clear handoff chain. The documentation is well-structured, the cross-links are complete, and the bug fix is correct. No code changes — docs-only PR.


📊 Change Architecture

graph TD
    A["python-sdk.mdx (existing)"] -->|"fixed: removed wrong pip install, added verification command"| B["python-sdk-skill.mdx (NEW)"]
    B -->|"cross-linked in"| C["cli-skill.mdx"]
    B -->|"cross-linked in"| D["evaluator-skill.mdx"]
    B -->|"nav entry added"| E["docs.json (en tab only)"]
    F["CHANGELOG.md"] -->|"entry added"| B
    
    style B fill:#90EE90
    style A fill:#FFD700
    style C fill:#87CEEB
    style D fill:#87CEEB
    style E fill:#87CEEB
    style F fill:#87CEEB
Loading

Legend: 🟢 New | 🔵 Modified | 🟡 Bug Fix


🔴 Breaking Changes

No breaking changes detected. This is a docs-only PR. No code, schema, API, config, or dependency changes.


⚠️ Issues Found

No issues found.


🔬 Logical / Bug Analysis

1. Bug fix: pip install agenteye removed from python-sdk.mdx (line 18-30)

The old install section said pip install agenteye which installed the CLI product, not the SDK. The fix correctly replaces this with a statement that distribution is private, a verification command, and a pointer to the new SDK skill page. The replacement does not leak private distribution mechanics.

2. New page python-sdk-skill.mdx (131 lines)

  • Frontmatter: valid YAML with proper title and description
  • The "silences" table documenting 5 common mistakes is accurate
  • The session walkthrough (lines 77-104) shows a realistic agent session
  • All internal links resolve to existing pages
  • External link to FailproofAI/skills is correct

3. Cross-linking: All three sibling pages (cli-skill, evaluator-skill, python-sdk) now reference the new page consistently.

4. docs.json nav entry: Only added to en tab, placed correctly in "SDK and CLI" group, +1 line clean diff.

5. CHANGELOG.md entry: Proper format, correctly referenced as (#568).


🧪 Evidence — Build & Test Results

  • TypeScript: clean (0 errors)
  • MDX validation: 647 pages parsed cleanly
  • Tests: 2174 passed / 0 failed (124 test files, 88 seconds)

🔗 Issue Linkage

⚠️ No issue linked — PR description is thorough and self-contained.


👥 Human Review Feedback

No human review comments on this PR. One prior bot comment from hermes-exosphere (superseded by this review).


💡 Suggestions

  1. Monitor the docs CI job — the PR author couldn't run mintlify validate locally due to Node version incompatibility and asks not to merge on red CI.
  2. Minor: the three skill page frontmatter titles could be standardized — cli-skill uses "AgentEye CLI Agent Skill" while the other two use "Failproof AI Observability ... Agent Skill". Not blocking.

🏆 Verdict

VERDICT: APPROVED


Automated code review · 2026-07-17 13:07 UTC

@hermes-exosphere hermes-exosphere left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review: Approved. Docs-only PR — new skill page, bug fix for wrong install command, clean cross-linking. All 2174 tests pass, MDX validates, TypeScript clean. ✅

@NiveditJain
NiveditJain merged commit bd3a620 into main Jul 17, 2026
11 checks passed

@hermes-exosphere hermes-exosphere left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review: Approved. ✅

@hermes-exosphere hermes-exosphere left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review Summary

Verdict: APPROVED

PR: #568 — docs(agenteye): document the agenteye-python-sdk agent skill
Author: NiveditJain
Files changed: 6 (+142 -2)

🔴 Critical

None.

⚠️ Warnings

None.

💡 Suggestions

  • docs/agenteye/python-sdk-skill.mdx:75-104 — The sample session transcript is excellent documentation, but the fixed-width text code block wraps at ~80 columns. On narrower viewports this may cause horizontal scroll. Consider a slightly narrower reflow for mobile readers — cosmetic, not blocking.

✅ Looks Good

  • The pip install agenteye fix is the right fix. The old page told readers a command that installed the CLI (different product sharing the distribution name), making import agenteye fail. The new text states private distribution, gives a verification command, and points to the skill. It correctly does not name a private install command — that's enterprise-docs material.

  • The new page's structure is exactly right. It leads with why the skill exists (the SDK's silent failures — the table of 5 mistakes that don't raise), not the API surface. The three-step plan→write→verify loop is clear and actionable. The sample session transcript demonstrates the skill's behavior concretely.

  • Cross-linking is thorough and directional. The skill relationship table correctly models the pipeline (SDK → Evaluator → CLI), and each sibling page links back with a purpose-specific description.

  • Nav placement is surgical. Added as a single line in docs.json under the English "SDK and CLI" group, immediately after python-sdk, matching the parent-then-skill pattern. No locale navs were touched — the translate-docs cron will regenerate those.

  • No security concerns. No secrets, no internal paths, no private install commands. The only external link is to the public FailproofAI/skills GitHub repo.

  • The CHANGELOG entry is correctly placed and references #568.

  • All referenced files exist. Every internal link resolves to an actual .mdx file on disk.


Reviewed by Hermes Agent

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants