HackerComputer program that learns to play classic NES games
suckerpinchYouTube ↗
Further reading 2
What if the best-scoring move is to pause the game? →Optimizing a score can reveal what its designer forgot to ask for.What improved when a game agent got better? →A rising score might reflect a better network, deeper search or a loophole. Trace what the agent observes, what it tries and why the resulting move earns a reward.This video helps answer · A better network or a longer look ahead?
Caption notes
Learn a progress measure from NES memory traces, then search for inputs that increase it. Looking ahead helps avoid locally attractive but unproductive moves.
Original passages · 5
It's just looking at RAMs and it's trying to find sequences of inputskeep track of a bunch of random future inputs that we might executeplaying Tetris well requires some thinking ahead, and this algorithm does not think very far ahead.this is a really simple, mathematically elegant and stupid techniquethis algorithm does not think very far ahead