Encoding the World