The More you Know, The Less you Need