As virtual reality systems become more commonplace the need for VR applications will increase. Agents are typically used to populate VR environments with autonomous creatures. Although systems exists incorporating agent and virtual environments, few support programming tools for specifying agent behavior. The paper presents the design of a system called HAVEN which uses a visual programming language to allow programmers to specify agent behavior from within a virtual environment. The system allows users to specify by example agent actions from low-level movement to higher level reactive rules and plans. Other details about the overall design of the system are also presented.