Capability universe
Capabilities
A curated, public-safe catalogue of 120 of the 342 capabilities in the JARVIS registry, plus work from the post-LM build and the unmerged Advanced Systems branch. Each one states how far it has been proven and what it cannot do yet.
Capabilities that touch private data (email, calendar, finance, health, credentials, biometrics) are left out of this catalogue. How statuses are assigned
Families
By rung
- 8 LIVE-PROVEN , rung 6 of 8
- 4 PRODUCTION-REACHABLE , rung 5 of 8
- 9 INTEGRATED , rung 4 of 8
- 62 TESTED , rung 3 of 8
- 31 IMPLEMENTED , rung 2 of 8
- 6 CONCEPT , rung 1 of 8
- Load STEP designs into the spatial scene Open a real STEP CAD file and see it in JARVIS's 3D engineering scene.Family: 3d INTEGRATED , rung 4 of 8 Evidence: CALCULATION Recorded
- Spatial engineering workspace (scene) A persistent 3D workspace where engineering models live and can be compared, labelled, restored and spun. Advanced Systems branch, not mergedFamily: 3d INTEGRATED , rung 4 of 8 Evidence: OBSERVED Recorded
- Gesture-controlled 3D engineering interface A gesture-driven 3D engineering workbench.Family: 3d TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Hand landmark tracking Tracks hand landmarks from the webcam.Family: 3d TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Intentional gesture recognition Recognises intentional hand gestures.Family: 3d TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Low-confidence safe failure When perception is unsure, it fails safe.Family: 3d TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Spatial computer control Controls the computer spatially.Family: 3d TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Pose & activity context Understands body pose and activity context.Family: 3d IMPLEMENTED PARTIAL , rung 2 of 8 Evidence: MEASURED Recorded
- Spatial HUD projection Projects the room model onto the HUD.Family: 3d IMPLEMENTED BLOCKED , rung 2 of 8 Evidence: NONE Recorded
- Bounded specialist decomposition Big tasks are split among bounded specialist roles.Family: Agents TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Explainable action plans Explainable action plans.Family: Agents TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Independent verification of specialist results Specialist results are independently checked before they are trusted.Family: Agents TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Single JARVIS identity over silent specialists Many specialists may work behind the scenes, but you talk to one JARVIS.Family: Agents TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Stalled/looping agent detection A stalled or looping agent is detected.Family: Agents TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Browser DOM scene with frames and shadow roots; stale-target refusal JARVIS reads a web page's structure, including embedded frames and shadow DOM, and refuses to click something that moved or changed. Advanced Systems branch, not mergedFamily: Browser INTEGRATED , rung 4 of 8 Evidence: OBSERVED Recorded
- Screen regions tied to real UI/DOM elements Screen regions tied to real UI/DOM elements.Family: Browser TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Detach browser tab to new window Detach a browser tab into a new window.Family: Browser CONCEPT , rung 1 of 8 Evidence: NONE Recorded
- Bounded capability discovery over the body interface JARVIS can look up what it can do right now, including each command's schema, and the lookup itself cannot do anything. Advanced Systems branch, not mergedFamily: Cognition INTEGRATED , rung 4 of 8 Evidence: TESTED Recorded
- Calibrated uncertainty with measured calibration (Brier/ECE reported) Confidence is calibrated and measured, not asserted.Family: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Epistemic marking JARVIS marks how sure it is: confirmed, inferred, incomplete, or unknown.Family: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Evidence-based pushback JARVIS pushes back, with evidence, when you say something the evidence contradicts.Family: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Reflective tool-use controller After using a tool, JARVIS checks whether the result was actually verified and revises the plan from receipts. Advanced Systems branch, not mergedFamily: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Risk & uncertainty escalation Risky or uncertain requests are escalated instead of guessed.Family: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Route selection (deterministic/fast/deep/coding/vision/research) Each request is routed to the right kind of thinking: instant, fast, deep, coding, vision or research.Family: Cognition TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Deixis & pronoun resolution "It", "that" and "the one from earlier" resolve to the right thing.Family: Cognition IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Units & dimensional analysis with unit-error rejection Engineering maths checks units and rejects unit errors.Family: Engineering LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Governed FreeCAD STEP operations (booleans, split, offset, mirror, transform, fillet, faces, face extension, sealed hollow) Edit real CAD geometry through fixed, isolated FreeCAD scripts, with a receipt for every operation. Advanced Systems branch, not mergedFamily: Engineering INTEGRATED , rung 4 of 8 Evidence: CALCULATION Recorded
- Recorded engineering trade spaces and calculation receipts Compare design options against constraints and see the trade-off frontier, with every number stamped and archived. Advanced Systems branch, not mergedFamily: Engineering INTEGRATED , rung 4 of 8 Evidence: CALCULATION Recorded
- PROMETHEUS Feasibility reasoning for ambitious ideas.Family: Engineering TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Aerodynamics/CFD orchestration Orchestrates aerodynamics / CFD work.Family: Engineering IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Bounded optimization Bounded optimisation.Family: Engineering IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Design of experiments Designs experiments.Family: Engineering IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Digital twin maintenance Maintains a digital twin of a physical system.Family: Engineering IMPLEMENTED BLOCKED , rung 2 of 8 Evidence: NONE Recorded
- Equation discovery Searches for equations that fit data.Family: Engineering IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Local solver execution Runs engineering solvers locally.Family: Engineering IMPLEMENTED BLOCKED , rung 2 of 8 Evidence: NONE Recorded
- CAD adapters Connects to CAD tools.Family: Engineering CONCEPT , rung 1 of 8 Evidence: NONE Recorded
- Powered-armour control sandbox A powered-armour control sandbox (simulation only).Family: Engineering CONCEPT , rung 1 of 8 Evidence: NONE Recorded
- Strict labeling of calculation vs simulation vs estimate vs measurement vs hypothesis Strictly labels calculation vs simulation vs estimate vs measurement vs hypothesis.Family: Engineering CONCEPT , rung 1 of 8 Evidence: NONE Recorded
- STEP to verified slicing mesh and slicer estimates Turn a CAD model into a sliced print plan with time and filament estimates, without touching the printer. Advanced Systems branch, not mergedFamily: Fabrication INTEGRATED , rung 4 of 8 Evidence: OBSERVED Recorded
- Fabrication workshop: installed slicer, printer staging and monitoring Fabrication workshop: installed slicer, printer staging and monitoring.Family: Fabrication TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Print readiness (READY / NOT READY / WHY) Before printing, JARVIS checks nine readiness conditions and explains any failure. Advanced Systems branch, not mergedFamily: Fabrication TESTED , rung 3 of 8 Evidence: TESTED Recorded
- File create/edit/organize/verify Create, edit, move and verify files in approved folders.Family: Files TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Local document intelligence Local document intelligence.Family: Files TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Persistent draggable, resizable HUD workspace Persistent draggable, resizable HUD workspace.Family: Hud PRODUCTION-REACHABLE , rung 5 of 8 Evidence: TESTED Recorded
- Accessibility pass Accessibility pass on the HUD.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Approval queue An approval queue on the HUD.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Degraded & stale labeling Stale and degraded data are visibly labelled.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- E-stop control An E-stop control on the HUD.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Truthful binding to canonical sources Every HUD value is bound to a canonical source.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Verified-action timeline on the HUD Verified-action timeline on the HUD.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Zero synthetic/placeholder data The HUD never shows made-up or placeholder data.Family: Hud TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Spatial rendering Renders a spatial view of the room on the HUD.Family: Hud IMPLEMENTED PARTIAL , rung 2 of 8 Evidence: TESTED Recorded
- Local image generation and viewing as a governed mission Local image generation and viewing as a governed mission.Family: Media PRODUCTION-REACHABLE , rung 5 of 8 Evidence: TESTED Recorded
- Bounded local image generation Generates images locally, on the owner's own GPU.Family: Media TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Resolve ambiguous requests ("something loud", "the thing from yesterday") Understands vague music requests like "something loud".Family: Media IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Windows SMTC transport control Controls whatever app is playing media via Windows media keys.Family: Media IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Governed Obsidian projection of project memory Project knowledge can be viewed as a human-readable Obsidian vault. Advanced Systems branch, not mergedFamily: Memory INTEGRATED , rung 4 of 8 Evidence: OBSERVED Recorded
- Memory consolidation, supersession and forgetting Memory consolidation, supersession and forgetting.Family: Memory TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Corruption detection with fail-closed refusal to substitute empty state If a memory store is corrupted, JARVIS refuses to pretend it is empty.Family: Memory IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Evidence store Evidence behind claims and actions is stored alongside them.Family: Memory IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Governed forgetting with owner-visible purge Forgetting is governed, visible to the owner, and actually deletes.Family: Memory IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Local hybrid retrieval (BM25+vector+RRF+rerank) Local search combines keywords, meaning and re-ranking.Family: Memory IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Memory router (the only write path) All memory writes go through one gate.Family: Memory IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Simulate a task before executing it Simulate a task before executing it.Family: Missions PRODUCTION-REACHABLE , rung 5 of 8 Evidence: TESTED Recorded
- Compensation & rollback of partial effects Partial effects of a failed mission are compensated or rolled back.Family: Missions TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Pause-for-approval and continue Missions pause for approval and continue afterwards.Family: Missions TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Request→durable mission A long request becomes a durable mission, not a fragile chat turn.Family: Missions TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Survive app restart Missions survive an app restart.Family: Missions TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Survive machine reboot Missions survive a full machine reboot.Family: Missions IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Evidence-backed causal project model Evidence-backed causal project model.Family: Projects TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Never auto-push Never pushes code to a remote on its own.Family: Projects IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Claim-to-evidence graph Keeps a graph of which evidence supports which claim.Family: Research TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Research reports with confidence and open questions Research reports state confidence and open questions.Family: Research TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Supporting AND contradicting evidence collection Collects evidence against a claim as well as for it.Family: Research TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Citation-entailment verification (does the source actually support the claim) Checks that a cited source actually supports the sentence it's cited for.Family: Research IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Counterevidence search before conclusion Looks for counter-evidence before concluding.Family: Research IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- First-class "Learn X" mission "Learn X for me" as a first-class mission.Family: Research IMPLEMENTED BLOCKED , rung 2 of 8 Evidence: NONE Recorded
- Machine epistemology court An internal "court" argues evidence for and against a claim.Family: Research IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Lawful video analysis (transcript + frames + timestamps) Analyses videos lawfully from transcript, frames and timestamps.Family: Research CONCEPT , rung 1 of 8 Evidence: NONE Recorded
- Async event bus An internal message bus lets every part of JARVIS announce what it is doing.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Correlation IDs across every surface Every request carries one tracking ID so its whole journey can be traced.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- E-stop (hotkey/HUD/voice) An emergency stop halts JARVIS from a hotkey, the HUD, or by voice.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Health & readiness probes JARVIS can report whether it is healthy and ready.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Loopback-only binding assertion Every JARVIS service listens only on the local machine.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Policy engine (fail-closed) Every action is checked against policy, and anything unclear is refused.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Prompt-injection detector Text from web pages, documents or tools can't smuggle in instructions.Family: System LIVE-PROVEN , rung 6 of 8 Evidence: OBSERVED Recorded
- Failure Atlas (diagnosis history and cross-trajectory patterns) JARVIS keeps an atlas of past failures and the patterns they share, so it can recognise a repeat. Advanced Systems branch, not mergedFamily: System INTEGRATED , rung 4 of 8 Evidence: OBSERVED Recorded
- Approval expiry/replay/object-swap defense An approval can't be reused, expire-dodged, or swapped onto a different object.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Audit trail (append-only, tamper-evident) A tamper-evident, append-only record of what JARVIS did.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Automatic bounded recovery Automatic bounded recovery.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Causality debugger A causality debugger for "what happened when I said that".Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Idempotency keys Repeating the same request doesn't repeat its side effects.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Proof-carrying action kernel Every action carries proof of why it was allowed.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Provider egress allowlist gateway Outbound network calls can only go to explicitly allowed providers.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Resource governor (CPU/GPU/RAM admission) JARVIS rations CPU, GPU and memory so heavy work can't starve the conversation.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Self-healing (restart, reconnect, re-index, recover, fall back) Heals itself: restart, reconnect, re-index, recover, fall back.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Shared failure taxonomy Shared failure taxonomy.Family: System TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Encrypted, integrity-sealed state snapshots Encrypted, integrity-sealed snapshots of JARVIS's state.Family: System IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Improvement proposals requiring owner approval Self-improvement is proposed, never self-approved.Family: System IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- At-risk deadline detection Spots deadlines at risk.Family: Time TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Interrupt vs ambient-HUD vs hold-for-briefing arbitration Decides whether to interrupt, show quietly on the HUD, or hold for the briefing.Family: Time TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Priority summarization Summarises what matters most right now.Family: Time TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Quiet hours Respects quiet hours.Family: Time TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Barge-in stop ≤120 ms You can interrupt JARVIS mid-sentence and it stops quickly.Family: Voice TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Preserve-heard / cancel-unheard When interrupted, JARVIS remembers what you actually heard and drops the rest.Family: Voice TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Semantic end-of-turn JARVIS decides when you've finished talking from meaning, not only silence.Family: Voice TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Truthful text fallback If speech output is unavailable, JARVIS says so in text instead of failing silently.Family: Voice TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Clause-by-clause streaming TTS Replies are spoken clause by clause as they are generated.Family: Voice IMPLEMENTED PARTIAL , rung 2 of 8 Evidence: MEASURED Recorded
- Speculative but reversible preparation of the workspace Speculative but reversible preparation of the workspace.Family: Windows PRODUCTION-REACHABLE , rung 5 of 8 Evidence: TESTED Recorded
- Application-state understanding with fresh identity Application-state understanding with fresh identity.Family: Windows TESTED , rung 3 of 8 Evidence: TESTED Recorded
- OCR text extraction Reads text from the screen or images.Family: Windows TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Postcondition verification After acting, JARVIS checks that the result actually happened.Family: Windows TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Rollback on observed≠requested If what happened isn't what was asked, JARVIS rolls it back.Family: Windows TESTED , rung 3 of 8 Evidence: TESTED Recorded
- UI Automation-first interaction Operates apps through Windows UI Automation first, not screen coordinates.Family: Windows TESTED , rung 3 of 8 Evidence: TESTED Recorded
- Mismatch rollback A mismatched gesture action is rolled back.Family: Windows IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Move window between monitors Move a window to another monitor.Family: Windows IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Open/close apps Open and close applications by request.Family: Windows IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Post-action geometry verification After a gesture moves a window, JARVIS verifies where it landed.Family: Windows IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Save & restore full workspace layouts Save and restore a whole workspace layout.Family: Windows IMPLEMENTED , rung 2 of 8 Evidence: TESTED Recorded
- Virtual desktop control Control Windows virtual desktops.Family: Windows CONCEPT , rung 1 of 8 Evidence: NONE Recorded
No capability matches these filters.
Clear a filter or try a broader search term.