Visual intelligence is a cornerstone of intelligence, for both humans and machines. In this talk, I go over a number of research work by our group on the topics of visual perception and robotic learning. The guiding principle of our work is inspired by the Gibsonian belief that perceptual and robotic learning should be based on an ecology approach, solving tasks and problems approximating the real-world setting and scale.