Reflexio Docs
Web Portal (Enterprise)

Basic Usage

Learn how to navigate the Reflexio Web Portal, view data, and perform common operations.

Basic Usage

Enterprise Feature

This feature requires Reflexio Enterprise (hosted at reflexio.com) or a self-hosted enterprise deployment. It is not available in the open-source version.

This guide walks you through the core features of the Reflexio Web Portal. Learn how to navigate the interface, view your data, and perform common operations.


Dashboard Page

The Dashboard provides a high-level overview of your Reflexio system at a glance.

Dashboard Overview

Key Features

  • Real-time statistics — View current counts for all major data types
  • Quick navigation — Click on any card to navigate to the detailed page
  • System health — Monitor overall system activity at a glance

Interactions Page

The Interactions page displays all recorded conversations between users and your agent.

Interactions Page

Viewing Interactions

  1. Navigate to the Interactions page from the sidebar
  2. Browse the list of interaction records
  3. Click on any interaction row to expand and view details

Use the filter panel to narrow down results:

FilterDescription
SearchSearch by content, user ID, or request ID
User IDFilter by specific user
SourceFilter by interaction source (e.g., API, manual)
Date RangeFilter by time period

User Profiles Page

The Profiles page shows extracted user profiles and allows you to manage them.

Profiles Page

Viewing Profiles

  1. Navigate to the Profiles page from the sidebar
  2. Browse the list of extracted profiles
  3. Click on a profile row to expand and view full details

Filtering Profiles

FilterDescription
SearchSearch by profile content or user ID
User IDView profiles for a specific user
ExtractorFilter by extractor name
StatusFilter by current, pending, or archived

Profile Status Tabs

Profiles are organized into three status categories:

TabDescription
CurrentActive profiles in use
PendingNew profiles awaiting review
ArchivedPreviously used profiles

Managing Profiles

Rerun Profile Extraction:

Rerun Extraction Modal
  1. Click Rerun Extraction on the Current tab
  2. Select the extractor name
  3. Optionally set a date range
  4. Click Rerun to start extraction

Adopt Pending Profiles:

  1. Switch to the Pending tab
  2. Review the pending profiles
  3. Click Adopt All Pending Profiles to promote them to current status

Restore Archived Profiles:

  1. Switch to the Archived tab
  2. Click Restore All Archived Profiles to move them back to current

Playbook Page

The Playbook page allows you to view, manage, and analyze agent playbook data.

Playbook Page

Understanding Playbook Types

Reflexio handles two types of playbook entries:

TypeDescription
User PlaybooksIndividual playbook entries extracted from interactions
Agent PlaybooksConsolidated insights from clustering user playbooks

Viewing Playbooks

The page has four tabs:

TabDescription
AggregatedView clustered playbook summaries
Current RawView active user playbook entries
Pending RawView newly generated user playbooks
Archived RawView archived user playbooks

Filtering Playbooks

FilterDescription
SearchSearch by playbook content or metadata
Agent VersionFilter by agent version
Playbook TypeFilter by playbook name
StatusFilter aggregated by approved/rejected/pending

Managing Agent Playbooks

Approve or Reject Playbook:

  1. Expand an agent playbook item
  2. Click Approve or Reject to update its status
  3. Status updates are saved immediately

Run Playbook Aggregation:

  1. Click Run Aggregation on the Aggregated tab
  2. Enter the Agent Version (required)
  3. Enter the Playbook Name (required)
  4. Click Run Aggregation to cluster user playbooks

Managing User Playbooks

Rerun Playbook Generation:

Rerun Playbook Modal
  1. Switch to the Current Raw tab
  2. Click Rerun Generation
  3. Enter the Agent Version (required)
  4. Optionally enter playbook name and date range
  5. Click Rerun Playbook Generation

Adopt Pending User Playbooks:

  1. Switch to the Pending Raw tab
  2. Click Adopt Pending User Playbooks
  3. Confirm the action in the dialog

This promotes pending user playbooks to current and archives existing current user playbooks.


Evaluation Page

The Evaluation page displays agent success evaluation results and performance metrics.

Evaluation Page

Statistics Overview

View key metrics at a glance:

MetricDescription
Total EvaluationsNumber of evaluations completed
Success RatePercentage of successful evaluations
Regular vs ShadowWin rate comparing regular vs shadow responses

Viewing Evaluation Details

Click on a failed evaluation or one with comparison data to expand:

Failure Details Tab:

Evaluation Failure Details

Shadow Comparison Tab:

Evaluation Shadow Comparison

Filtering Evaluations

FilterDescription
SearchSearch by request ID, version, or failure type
Agent VersionFilter by specific version
StatusShow only successes or failures

Settings Page

The Settings page allows you to configure the Reflexio system.

Settings Page

General Settings Tab

Storage Configuration:

Configure where Reflexio stores data:

Storage TypeConfiguration
LocalSet directory path
AWS S3Set region, path, access key, secret key
SupabaseSet URL, API key, database URL

Agent Context:

Define your agent's working environment:

  1. Enter a description of the agent's purpose
  2. Describe available tools and capabilities
  3. Define the action space

Extraction Parameters:

ParameterDescription
Batch SizeNumber of interactions per extraction batch
Batch IntervalNew interactions required before next extraction batch

Extractor Settings Tab

Profile Extractors:

Profile Extractor Config

Configure how user profiles are extracted:

  1. Click Add Profile Extractor
  2. Enter an Extractor Name (e.g., user_preferences)
  3. Toggle Auto/Manual mode for trigger type
  4. Define the Profile Content prompt
  5. Optionally add context, metadata prompts, and source filters
  6. Click Save Configuration

Agent Playbook:

Configure playbook collection:

  1. Click Add Agent Playbook
  2. Enter a Playbook Name (e.g., task_completion)
  3. Define the Playbook Definition prompt
  4. Set Min Playbook Threshold for clustering
  5. Set Refresh Count for aggregation trigger
  6. Click Save Configuration

Agent Success Evaluations:

Define success criteria for evaluations:

  1. Click Add Success Evaluation
  2. Enter an Evaluation Name
  3. Define the Success Definition prompt
  4. Adjust the Sampling Rate (percentage of interactions to evaluate)
  5. Add available tools and actions
  6. Click Save Configuration

Workflow Visualization Tab

Workflow Visualization

View a visual diagram of your configuration:

  • See how requests flow through the system
  • Understand the relationship between extractors
  • Click on nodes for detailed information

Saving Configuration

  1. Make your changes in any tab
  2. Click Save Configuration in the header or footer
  3. Wait for the success confirmation message

Important

Always save your configuration after making changes. Unsaved changes will be lost if you navigate away.


Quick Reference

Common Actions

ActionWhereSteps
View interaction detailsInteractionsClick on a row
Filter by userAny list pageSelect user from dropdown
Approve playbookPlaybooks > AggregatedExpand row, click Approve
Rerun extractionProfilesClick Rerun Extraction
Add extractorSettings > ExtractorsClick Add Profile Extractor
View failure detailsEvaluationsClick on failed evaluation

Tips for Effective Use

  1. Start with Dashboard — Get an overview before diving into details
  2. Use filters liberally — Narrow results to find what you need quickly
  3. Review pending items regularly — Adopt pending profiles and playbooks
  4. Monitor evaluations — Track success rates to identify improvement areas
  5. Experiment in Settings — Test different extractor configurations