openeye agent

    Agentic perception loop — continuously perceive, reason, and act. The agent maintains observation memory and can use VLM reasoning to pursue goals.

    Subcommands

    CommandDescription
    agent runRun the agentic loop locally on camera or video
    agent startStart the agentic loop on a running server
    agent stopStop the agentic loop on a running server
    agent statusShow agent status (running, tick count, plan, goal)
    agent memoryShow recent observations from memory
    agent recall QUERYQuery memory with natural language

    Local Agent Loop

    openeye agent run --model yolov8 --goal "monitor workspace safety"
    openeye agent run --model yolov8 --video demo.mp4 --max-ticks 20
    openeye agent run --vlm
    FlagDescription
    --model, -m <name>Detection model (default: yolov8)
    --goal, -g <text>Goal for the agent to pursue (default: "monitor the scene")
    --hz <float>Loop frequency in Hz (default: 1.0)
    --video <path>Video file input (fallback if no camera)
    --max-ticks <n>Stop after N ticks (default: run until stopped)
    --vlmEnable VLM reasoning. Uses NEBIUS_MODEL (default Qwen/Qwen2.5-VL-72B-Instruct) with NEBIUS_API_KEY; a lowercase OpenRouter-style model ID uses OPENROUTER_API_KEY instead

    Server Agent Control

    These talk to a running openeye serve at OPENEYE_SERVER_URL (default http://localhost:8000) unless you pass --server, -s <url>.

    openeye agent start --goal "detect hazards"
    openeye agent stop
    openeye agent status
    CommandFlags
    agent start--goal, -g <text> (default: "monitor the scene"), --server, -s
    agent stop--server, -s
    agent status--server, -s

    Memory Queries

    openeye agent memory --limit 10
    openeye agent recall "when did a person enter the workspace?"
    CommandFlags
    agent memory--limit, -n <n> (default: 10), --server, -s
    agent recall QUERY--limit, -n <n> (default: 5), --server, -s