Repository navigation
Operative: refresh evaluations, screenshots and run-aligned lab copy - #3245
Open
Scott Durow (scottdurow) wants to merge 2 commits into
Open
Scott Durow (scottdurow) wants to merge 2 commits into
Scott Durow (scottdurow) wants to merge 2 commits into
Conversation
Update evaluation authoring, consolidate Work IQ guidance, repair screenshots, and align learner instructions and evaluation copy with the latest completed automation run. Preserve identity-safe length handling and original copy-block paragraph formatting; rerun evaluations after release instruction changes. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Scott Durow (scottdurow)
force-pushed
the
evals-update
branch
from
November 7, 2026 07:54
d04e84e to
c068cb9
Compare
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
The replacement instructions remove critical privacy and untrusted-input safeguards and required document-skill protections, while adding application-creation guidance that conflicts with the Interview Agent’s read-only permissions.
3 open issues
What changed in this PR
Refreshes the Operative course to align its hands-on labs with the current Copilot Studio interface and the latest completed automation run.
Changes:
- Updates evaluation setup, expected responses, connection guidance, and screenshots.
- Revises agent instructions, document-skill installation, and supervised Work IQ scheduling.
- Corrects workflow field-editor steps and published-agent testing guidance.
| File | Description |
|---|---|
docs/operative-nextgen/11-publish-and-monitor/index.md |
Updates evaluation, release, sharing, and monitoring steps. |
docs/operative-nextgen/10-work-iq-scheduling/index.md |
Consolidates Work IQ setup and expands availability and booking prompts. |
docs/operative-nextgen/09-human-oversight/index.md |
Corrects review-message and expression-editor instructions. |
docs/operative-nextgen/08-workflow-agents/index.md |
Refines matching prompts, tool-call limits, and card editing. |
docs/operative-nextgen/07-workflow-trigger/index.md |
Documents popup expression editing and insertion. |
docs/operative-nextgen/06-document-skill/index.md |
Clarifies builder outputs and tested reference-skill installation. |
docs/operative-nextgen/05-intake-matching-applications/index.md |
Makes intake, matching, and application-check prompts more explicit. |
docs/operative-nextgen/04-model-response-and-safety/index.md |
Refreshes safety evaluations and complete instruction blocks. |
docs/operative-nextgen/03-connected-agent/index.md |
Updates specialist setup and baseline evaluation authoring. |
docs/operative-nextgen/02-instructions-skills-dataverse-mcp/index.md |
Updates evaluation setup and restricts length-error corrections. |
docs/operative-nextgen/01-get-started/index.md |
Updates initial model guidance and intake boundaries. |
cspell.json |
Adds skillbuilder to the spelling dictionary. |
Review effort: Balanced
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Contributor
There was a problem hiding this comment.
🔵 Needs a closer look
The consolidated Work IQ setup needs validation in the current Copilot Studio UI because the revised steps omit explicit connection selection, leaving the identity used for real calendar invitations unconfirmed.
No open issues 🎉
3 resolved since last review
Review effort: Balanced
Scott Durow (scottdurow)
marked this pull request as ready for review
November 8, 2026 23:37
Scott Durow (scottdurow)
requested a review
from April Dunnam (aprildunnam)
as a code owner
November 8, 2026 23:37
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.


What changed
This PR updates the Operative labs to match the current Copilot Studio evaluation UI and the copy used by the latest completed automation run.
Evaluation instructions and screenshots
Agent, skill and workflow copy
Screenshot and guidance corrections
skillbuilderto the spelling dictionary so the requiredppa_skillbuilderschema name passes CI.Validation
The broader screenshot validator also checks retired images, archived metadata and untouched historical captures; those existing findings are outside the active changed-image checks above.
Scope
Course Markdown and rendered screenshots only, plus the spelling-dictionary entry. Automation code and raw screenshot files are maintained in the separate automation repository.