The DRL (Delayed Reinforcement Learning) problem is classical in Reinforcement Learning theory. There were several agent architectures solving that problem, including connectionist architectures. This work describes an early connectionist agent architecture, the CAA architecture, that solved the problem using the concept of emotion in its learning rule. The CAA architecture is compared to another classical DRL solving architecture, the Actor/Critic architecture. Possible implication to Reinforcement Learning theory is pointed out.