A better network or a longer look ahead?
Evolving a network changes its structure. Looking farther ahead changes how an agent evaluates future moves. Each addresses a different limitation.
Read on through a shared source
Can a network evolve its own wiring? →First follow activations through a fixed network. In MarI/O, selection changes the connections themselves. Following a signal and searching for a useful topology are different operations.Reward and fitness both give feedback. What changes? →In reinforcement learning, rewards inform action choices. MarI/O uses a fitness score to select entire networks across generations.How do game agents improve beyond their starting point? →AlphaGo imitates games and then plays against itself. MarI/O selects and reproduces networks according to game progress.
Compare the passages
without presupposing the best structure for the neurons and their connectionsthis algorithm does not think very far ahead