MotteAW - Agent Watch

Real-time agent monitoring and debugging

MotteAW provides comprehensive monitoring, debugging, and analytics for multi-agent systems with real-time streaming interfaces and historical performance analysis.

Core Components

Live Monitoring

Real-time streaming of agent activities, API calls, and system events with WebSocket connections.

  • • Agent execution tracking
  • • API call monitoring
  • • Error detection and alerts
  • • Performance metrics

Analytics Dashboard

Comprehensive analytics with customizable dashboards and historical trend analysis.

  • • Performance trends
  • • Usage statistics
  • • Cost analysis
  • • Success/failure rates

Alert System

Intelligent alerting with configurable thresholds, notification channels, and escalation policies.

Debug Tools

Advanced debugging capabilities with request/response inspection, trace analysis, and replay functionality.

Monitoring Capabilities

Metric TypeDescriptionUpdate FrequencyRetention
Response TimeAgent execution latencyReal-time30 days
Success RateSuccessful vs failed requests1 minute90 days
Token UsageAPI token consumptionReal-time1 year
Error RateError frequency by typeReal-time90 days
Memory UsageMemory bank utilization5 minutes30 days

Alert Configuration

Threshold-Based Alerts

{
  "alert_name": "High Error Rate",
  "condition": {
    "metric": "error_rate",
    "operator": "greater_than",
    "threshold": 0.05, // 5%
    "window": "5m"
  },
  "notifications": [
    {
      "type": "email",
      "recipients": ["admin@company.com"]
    },
    {
      "type": "slack",
      "channel": "#alerts"
    }
  ],
  "severity": "high"
}

Configure alerts based on metric thresholds with multiple notification channels.

Anomaly Detection

{
  "alert_name": "Response Time Anomaly",
  "condition": {
    "type": "anomaly",
    "metric": "response_time",
    "sensitivity": "medium",
    "baseline_window": "7d",
    "detection_window": "1h"
  },
  "auto_resolve": true,
  "cooldown": "30m"
}

Machine learning-based anomaly detection for unusual patterns in agent behavior.

Debug Features

Request Tracing

Complete request lifecycle tracking from input to output with detailed timing information and intermediate steps.

Response Inspection

Detailed inspection of API responses, model outputs, and data transformations with syntax highlighting.

Replay Functionality

Replay historical requests for debugging and testing with the ability to modify parameters and compare results.

Performance Profiling

Detailed performance analysis with bottleneck identification and optimization recommendations.

Dashboard Widgets

Real-time Metrics

  • • Live request counter
  • • Current response time
  • • Active agent count
  • • Error rate gauge
  • • Token usage meter

Historical Charts

  • • Response time trends
  • • Request volume over time
  • • Success/failure ratios
  • • Cost analysis charts
  • • Agent performance comparison

System Health

  • • Service status indicators
  • • Database connection health
  • • API endpoint availability
  • • Memory bank status
  • • Queue depth monitoring

Custom Widgets

  • • Business-specific KPIs
  • • Custom query results
  • • Third-party integrations
  • • Compliance metrics
  • • User-defined alerts

API Endpoints

Get Metrics

GET /api/monitoring/metrics?metric=response_time&window=1h&granularity=1m

Response:
{
  "metric": "response_time",
  "window": "1h",
  "data": [
    {"timestamp": "2024-01-15T10:00:00Z", "value": 245.5},
    {"timestamp": "2024-01-15T10:01:00Z", "value": 238.2},
    ...
  ],
  "summary": {
    "avg": 242.1,
    "min": 198.3,
    "max": 312.7,
    "p95": 289.4
  }
}

Retrieve historical metrics with configurable time windows and granularity.

Create Alert

POST /api/monitoring/alerts
Content-Type: application/json

{
  "name": "High Response Time",
  "condition": {
    "metric": "response_time",
    "operator": "greater_than",
    "threshold": 1000,
    "window": "5m"
  },
  "notifications": [
    {"type": "email", "recipients": ["admin@company.com"]}
  ]
}

Create custom alerts with flexible conditions and notification preferences.

WebSocket Stream

// Connect to real-time stream
const ws = new WebSocket('wss://api.motte.ai/monitoring/stream');

ws.onmessage = (event) => {
  const data = JSON.parse(event.data);
  console.log('Real-time update:', data);
};

// Subscribe to specific metrics
ws.send(JSON.stringify({
  action: 'subscribe',
  metrics: ['response_time', 'error_rate', 'token_usage']
}));

Real-time streaming of metrics and events via WebSocket connections.