Skip to main content

AgentCore

AgentCore handles tool execution for the AI Assistant, powered by Amazon Bedrock AgentCore Runtime and Gateway. Unlike v1's single-EC2 embedded approach, v2 splits everything out serverless: Runtime + 9 section Gateways + Memory + Code Interpreter.

AI Assistant routing badges
Customer-session point

8 AWS-domain Gateways + external-obs (external observability) = 9 routed sections · 160 MCP tools across the full catalog (the 27 Lambda targets — vendor-hosted mcpServer targets excluded) · 30 Lambda slices (21 gated on agentcore_enabled, 9 on integrations_enabled, both off by default) run serverless. The classifier routes each question to 1-3 routes and calls them in parallel, then synthesizes. → Why AWSops

Architecture

AgentCore Architecture

AI Routing Flow

Deployment Requirements

ItemRequirement
Dockerarm64 required (docker buildx --platform linux/arm64 --load; make agentcore builds and pushes)
agent.pyGateway URLs are injected via the GATEWAYS_JSON env (no per-account hardcoding)
Code Interpreter / MemoryNo hyphens in name, underscores only
Memory StoreMax 365-day retention (eventExpiryDuration)
Config source of truthSSM /ops/awsops-v2/agentcore/{runtime_arn,interpreter_id,memory_id} — written by provision.py, read by the web BFF at runtime (never exposed in the UI)
Runtime updatesRe-running the idempotent provisioner (scripts/v2/agentcore/provision.py) applies changes — a just-created Gateway not yet READY can make the first target creation fail; re-run resolves it

AgentCore Runtime

Configuration

ItemDescription
EngineStrands Agent Framework
ContainerDocker arm64 (stored in ECR, via make agentcore)
Execution EnvironmentAgentCore managed service (Bedrock AgentCore Runtime)
ModelClaude Haiku 4.5 (ADR-038 routing classifier) / the Runtime itself only ever runs Sonnet 4.6 (hardcoded in agent/agent.py). Opus 4.8 isn't used by the Runtime — it's an optional Deep-tier choice in the separate AI Diagnosis (async worker) feature

Status

  • READY: Operating normally
  • CREATING: Being created
  • UPDATING: Being updated
  • FAILED: Error state

Gateway Details

v2 has 8 AWS-domain Gateways (awsops-v2-{network,container,data,security,cost,monitoring,iac,ops}-gateway) plus external-obs — a routed section hosting external-observability/integration connectors, chat-aliased to the observability routing key. Tool counts below are from the full catalog (scripts/v2/agentcore/catalog.py); activation is gated behind the agentcore_enabled/integrations_enabled flags (off by default on new installs). The live environment has the fleet fully deployed — all 9 gateways hold READY MCP targets and all 16 chat section keys are active (2026-08-02).

Network Gateway (17 tools)

Provides VPC, ENI, Reachability, Flow Logs, TGW, VPN, and Network Firewall tools.

CategoryTools
flow-monitorquery_flow_logs
reachability-readcheck_reachability
network-mcpget_path_trace_methodology, find_ip_address, get_eni_details, list_vpcs, get_vpc_network_details, get_vpc_flow_logs, describe_network, list_transit_gateways, get_tgw_details, get_tgw_routes, get_all_tgw_routes, list_tgw_peerings, list_vpn_connections, list_network_firewalls, get_firewall_rules

Container Gateway (19 tools)

Provides EKS, ECS, and Istio service-mesh tools.

CategoryTools
istio-readmesh_overview, list_virtual_services, list_destination_rules, list_istio_gateways, list_service_entries, list_authorization_policies, list_peer_authentications
eks-mcplist_eks_clusters, get_eks_vpc_config, get_eks_insights, get_cloudwatch_logs, get_cloudwatch_metrics, get_eks_metrics_guidance, get_policies_for_role, search_eks_troubleshoot_guide, generate_app_manifest
ecs-mcpecs_resource_management, ecs_troubleshooting_tool, wait_for_service_ready

IaC Gateway (12 tools)

Provides Infrastructure as Code tools.

CategoryTools
iac-mcpvalidate_cloudformation_template, check_cloudformation_template_compliance, troubleshoot_cloudformation_deployment, search_cdk_documentation, search_cloudformation_documentation, cdk_best_practices, read_iac_documentation_page
terraform-mcpSearchAwsProviderDocs, SearchAwsccProviderDocs, SearchSpecificAwsIaModules, SearchUserProvidedModule, terraform_best_practices

Data Gateway (24 tools)

Provides AWS database and streaming service tools.

CategoryTools
rds-mcplist_db_instances, list_db_clusters, describe_db_instance, describe_db_cluster, execute_sql, list_snapshots
dynamodb-mcplist_tables, describe_table, query_table, get_item, dynamodb_data_modeling, compute_performances_and_costs
msk-mcplist_clusters, get_cluster_info, get_configuration_info, get_bootstrap_brokers, list_nodes, msk_best_practices
valkey-mcplist_cache_clusters, describe_cache_cluster, list_replication_groups, describe_replication_group, list_serverless_caches, elasticache_best_practices

Security Gateway (14 tools)

Provides IAM and security analysis tools. (Deployed in P1f.)

ToolDescription
list_users / get_userList/detail IAM users
list_roles / get_role_detailsList/detail IAM roles
list_groups / get_groupList/detail IAM groups
list_policiesList policies
list_user_policies / list_role_policiesList user/role policies
get_user_policy / get_role_policyUser/role inline policy
list_access_keysList Access Keys
simulate_principal_policyPolicy simulation
get_account_security_summaryAccount security summary

Monitoring Gateway (36 tools)

Provides CloudWatch and CloudTrail (AWS-native), plus OpenSearch and the Loki/Tempo/Mimir observability stack (Prometheus and ClickHouse are owned by External-Obs — ADR-004).

CategoryTools
cloudwatch-mcp (11)Metrics/alarms/log-insights queries
cloudtrail-mcp (5)lookup_events, list_event_data_stores, lake_query, get_query_status, get_query_results
opensearch-mcp (4)OpenSearch domain/index queries
loki-mcp / tempo-mcp / mimir-mcp (loki 5 · tempo 5 · mimir 6, integrations_enabled)LogQL/TraceQL queries — Loki/Tempo/Mimir stay on this Gateway (ADR-004; Prometheus·ClickHouse moved to External-Obs)

Cost Gateway (14 tools)

Provides cost analysis, forecasting, and FinOps tools.

CategoryTools
cost-mcp (9)get_today_date, get_cost_and_usage, get_cost_and_usage_comparisons, get_cost_comparison_drivers, get_cost_forecast, get_dimension_values, get_tag_values, get_pricing, list_budgets
finops-mcp (5)Compute Optimizer rightsizing, RI/SP recommendations, Cost Optimization Hub, Trusted Advisor

Ops Gateway (11 tools)

Provides AWS documentation search, operations helpers, and inventory query tools.

CategoryTools
core-helpersprompt_understanding, suggest_aws_commands
inventory-readfind_unused_resources, get_topology, query_inventory, inventory_summary
aws-knowledgesearch_documentation, read_documentation, recommend, list_regions, get_regional_availability

External-Obs (13 tools, routing key: observability)

The 9th routed section, hosting external-observability/integration connectors (ADR-004, amended 2026-06-24). The catalog defines notion-mcp (3 tools) here, gated on integrations_enabled (off by default). The Prometheus (6 tools) and ClickHouse (4 tools) connector targets also live on this section (catalog.pyprometheus-mcp-target/clickhouse-mcp-target with gateway=external-obs).

Code Interpreter

Provides a sandbox environment for Python code execution.

Features

  • Isolated environment: Secure Python execution
  • Data analysis: Library support for pandas, numpy, etc.
  • Visualization: Chart generation with matplotlib, plotly, etc.
  • File processing: Data parsing for JSON, CSV, etc.

Usage Examples

"Visualize AWS cost data as a monthly trend chart"
"Parse this JSON data and calculate statistics"

Routing Display (AI Assistant)

Instead of v1's separate "AgentCore" dashboard page (call statistics, config lookup), v2 shows routing information inline inside the AI Assistant chat screen.

  • Each answer shows a badge for which section (Gateway) handled it.
  • Answers synthesized from multiple domains in parallel show "via" chips, one per contributing Gateway (e.g. multi:network+data).
  • Up to two alternate-route chips let you re-ask via a different route.
  • The chat rail lists recent conversation threads (no full-text search yet).

The AgentCore Runtime ARN, Memory ID, and similar config values live only in SSM and are never exposed in the UI (operators check via terraform output / SSM).

Known Limitations

ItemLimitation
Docker architecturearm64 required
Code Interpreter / Memory nameNo hyphens, underscores only
Conversation history retentionMaximum 365 days
AgentCore responseReturns final text only (tool inference streamed with a typing effect)
Tool activation flagsThe 30 slices are gated on agentcore_enabled (21) / integrations_enabled (9) — the live environment has the fleet fully deployed (2026-08-02); new installs default to off
Vendor mcpServer targetsFor external-obs's vendor-hosted mcpServer targets (Datadog · Dynatrace · New Relic), capability=read is not enforced at the protocol level (ADR-017) — the read-only guarantee applies to Lambda targets; unset endpoints SKIP. At runtime a fail-closed tool allowlist (OFFICIAL_MCP_TOOL_ALLOWLIST_JSON — only catalog-transcribed read tools pass, agent/agent.py) compensates

Next Steps