Visual perception requires not only making inferences from observations, but also making decisions about what to observe. Though much of the computer vision literature implicitly assumes a well-captured visual observation as input, in reality a single view of a complex visual environment---or even multiple arbitrarily chosen views---may provide too little in