# microsoft/skill-recorder

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/microsoft-skill-recorder).**

_How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._

5,710 stars · 651 forks · TypeScript · MIT

## Links

- GitHub: https://github.com/microsoft/skill-recorder
- awesome-repositories: https://awesome-repositories.com/repository/microsoft-skill-recorder.md

## Topics

`agent-skills` `ai-agents` `automation` `copilot` `copilot-cli` `copilot-cowork` `copilot-studio` `electron` `microsoft-scout` `screen-recording`

## Description

Skill Recorder is a desktop app that records an on-screen work session and turns it into a reusable skill or scheduled automation for AI agents. It captures clicks, app and window switches, visited pages, clipboard previews, terminal activity and spoken narration in the background, controlled by a global shortcut and a floating bar. It can also import an existing MP4 or WebM demonstration instead of recording live. Everything is recorded and stored locally until the user chooses to analyze it.

Analysis uses the GitHub Copilot SDK, with sign-in through the browser via enterprise single sign-on or a personal account. A multi-turn session reconstructs the recording into one overall intent and an ordered list of steps that can be reviewed, edited and reordered. Once a user approves the analysis, the app generates a skill file or a scheduled automation. The output favors native tools over replaying interface clicks and keeps calculation steps separate from steps that change things outside. A read-only preview of the generated skill text is available before installing or exporting.

Privacy handling runs on the device. Terminal commands and transcripts are scanned for secrets and personal data, and detected values are masked before any excerpt goes to a cloud service. Optional advanced protection uses text recognition to blur sensitive values in screenshots, including values split across several words. Narration is transcribed locally with a multilingual speech model, so audio is not sent over the network.

The repository also includes an offline evaluation harness. It scores inferred intents and steps against rubrics, checks generated skill plans and automation builders against frozen analyses, runs repeatable business-workflow scenarios, and measures redaction recall and precision without models or network access. Installation on Windows is scripted.

## Tags

### Development Tools & Productivity

- [Desktop Screen Recorders](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities/desktop-screen-recorders.md) — Records an on-screen work session in a desktop app and converts it into a reusable skill or scheduled automation for AI agents.
- [Copilot API Integrations](https://awesome-repositories.com/f/development-tools-productivity/github-api-integrations/copilot-api-integrations.md) — Uses the GitHub Copilot SDK in a multi-turn session to reconstruct a recording into one intent and editable ordered steps.
- [Session Recorders](https://awesome-repositories.com/f/development-tools-productivity/macro-recorders/session-recorders.md) — Records work sessions including clicks, app switches, clipboard previews, terminal activity and narration, or imports an existing video demonstration for analysis.
- [Screen Capture Utilities](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities.md) — Captures on-screen work including clicks, window switches, clipboard, terminal activity and narration in the background, or imports an existing demonstration video.
- [Skill Generation](https://awesome-repositories.com/f/development-tools-productivity/skill-generation.md) — Turns an approved analysis into a structured skill file or scheduled automation that prefers native tools and separates calculation from side-effecting steps.
- [Agent-Driven Task Automation](https://awesome-repositories.com/f/development-tools-productivity/task-automation-tools/agent-driven-task-automation.md) — Turns a demonstrated knowledge-work task into a reusable agent skill or scheduled automation so repeated work needs no manual effort.
- [Automation Skills](https://awesome-repositories.com/f/development-tools-productivity/automation-skills.md) — Converts a demonstrated workflow into a reusable skill file that an agent can run on demand.
- [Session Analysis Integrations](https://awesome-repositories.com/f/development-tools-productivity/github-api-integrations/copilot-api-integrations/session-analysis-integrations.md) — Uses the GitHub Copilot SDK in a multi-turn session to reconstruct a recording into one intent and editable ordered steps.
- [Local-First Screen Captures](https://awesome-repositories.com/f/development-tools-productivity/screen-capture-utilities/local-first-screen-captures.md) — Captures screen activity, clipboard previews, terminal sessions and narration on the device, keeping all raw recording data local until the user chooses to analyze.
- [Automation Schedulers](https://awesome-repositories.com/f/development-tools-productivity/workflow-automation-triggers/event-driven-triggers/automation-schedulers.md) — Creates a scheduled automation for autonomous agents from an approved analysis so a recorded task can rerun without manual effort. ([source](https://github.com/microsoft/skill-recorder#readme))

### Artificial Intelligence & ML

- [Workflow Intent and Step Reconstruction](https://awesome-repositories.com/f/artificial-intelligence-ml/workflow-intent-and-step-reconstruction.md) — Analyzes a recorded session with an AI assistant to produce one overall intent and an ordered list of steps that can be reviewed, edited and reordered. ([source](https://github.com/microsoft/skill-recorder#readme))
- [Agent Skill Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-skill-configurations/skill-quality-validators/agent-skill-generators.md) — Generates a skill file or scheduled automation from an approved analysis, favoring native tools over replaying interface clicks.
- [On-Device Speech Recognizers](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/speech-processing/automatic-speech-recognition/on-device-speech-recognizers.md) — Runs a multilingual speech recognition model locally on recorded narration, producing transcripts without sending audio over the network.
- [Speech-to-Text Transcribers](https://awesome-repositories.com/f/artificial-intelligence-ml/speech-to-text-transcribers.md) — Converts recorded spoken commentary into text on the user's device with a multilingual speech model, without sending audio to the cloud. ([source](https://github.com/microsoft/skill-recorder#readme))
- [On-Device Transcriptions](https://awesome-repositories.com/f/artificial-intelligence-ml/text-to-speech/on-device-transcriptions.md) — Transcribes recorded narration into text locally with a multilingual speech model, so audio is never sent over the network.

### Part of an Awesome List

- [Sensitive Data Redaction](https://awesome-repositories.com/f/awesome-lists/devtools/information-extraction/sensitive-data-identification/sensitive-data-redaction.md) — Masks detected secrets and personal values in text before anything reaches the cloud AI service, keeping prose, URLs, and hashes intact. ([source](https://github.com/microsoft/skill-recorder/blob/main/evals/README.md))

### Security & Cryptography

- [Secret and Personal Data Detection](https://awesome-repositories.com/f/security-cryptography/secret-and-personal-data-detection.md) — Scans terminal commands and transcripts on the device for secrets and personal data, using validators to avoid flagging invalid numbers. ([source](https://github.com/microsoft/skill-recorder/blob/main/evals/README.md))
- [Sensitive Variable Redaction](https://awesome-repositories.com/f/security-cryptography/sensitive-variable-redaction.md) — Masks secrets and personal data in text and blurs sensitive values in screenshots on the device before anything is sent to the cloud.
- [PII Recognition Pipelines](https://awesome-repositories.com/f/security-cryptography/pii-detection-and-screening/pii-recognition-pipelines.md) — Runs an on-device pipeline that detects and masks secrets and personal data in text and blurs sensitive screen regions before any cloud analysis.
- [Privacy and Data Protection](https://awesome-repositories.com/f/security-cryptography/privacy-data-protection.md) — Scans terminal commands and transcripts on the device for secrets and personal data before any excerpt is sent, keeping recording data local until analysis. ([source](https://github.com/microsoft/skill-recorder/blob/main/README.md))
- [Prompt Redaction Gateways](https://awesome-repositories.com/f/security-cryptography/prompt-redaction-gateways.md) — Passes every outgoing text excerpt through on-device secret and personal-data detectors and masking so only sanitized content reaches a cloud service.
- [Screenshot Sensitive Value Blurring](https://awesome-repositories.com/f/security-cryptography/screenshot-sensitive-value-blurring.md) — Locates sensitive values in recorded frames with text recognition, including values split across words, and blurs those pixel regions before frames are used.

### Business & Productivity Software

- [Digital Activity Recorders](https://awesome-repositories.com/f/business-productivity-software/digital-activity-recorders.md) — Captures window switches, visited pages, clipboard previews, terminal activity, and narration to give each recorded step supporting context. ([source](https://github.com/microsoft/skill-recorder#readme))
- [Recurring Task Automation](https://awesome-repositories.com/f/business-productivity-software/recurring-task-automation.md) — Packages a reconstructed procedure as a scheduled automation that runs again on a recurring timetable. ([source](https://github.com/microsoft/skill-recorder/blob/main/README.md))

### Graphics & Multimedia

- [Privacy Blurring Tools](https://awesome-repositories.com/f/graphics-multimedia/image-editing-processing/image-processing/privacy-blurring-tools.md) — Uses text recognition to find sensitive values in recorded screenshots, including values split across words, and blurs exactly those regions. ([source](https://github.com/microsoft/skill-recorder/blob/main/evals/README.md))
- [Video Recording Imports](https://awesome-repositories.com/f/graphics-multimedia/video-recording-imports.md) — Imports an existing MP4 or WebM demonstration, validates its limits, and analyzes its frames and speech instead of recording live. ([source](https://github.com/microsoft/skill-recorder/blob/main/README.md))

### System Administration & Monitoring

- [Agent Session Reconstruction](https://awesome-repositories.com/f/system-administration-monitoring/ai-session-monitoring/session-replays/replayable-session-logs/agent-session-reconstruction.md) — Runs a multi-turn model session that reconstructs recorded events and frames into one overall intent and an ordered list of steps.

### Testing & Quality Assurance

- [Model Output Quality Evaluations](https://awesome-repositories.com/f/testing-quality-assurance/model-output-quality-evaluations.md) — Scores inferred intents, steps, plans, and tool choices against rubrics and frozen scenarios offline, and measures redaction recall and precision, to expose regressions and variance.