In order to pursue the artificial realization of "human" or "intelligent" information processing, researchers need to develop a system of representing and interpreting knowledge. This text collects the results of 10 years of research at six laboratories, focusing on the theoretical and algorithmic foundations of real world intelligence.