Here are some of the research projects I have been working on.
SeGAN: Segmenting and Generating the Invisible
K Ehsani, R Mottaghi, A Farhadi (CVPR18, spotlight)
Humans have strong ability to make inferences about the appearance of the invisible and occluded parts of scenes. For example, when we look at the scene on the left we can make predictions about what is behind the coffee table, and can even complete the sofa based on the visible parts of the sofa, the coffee table, and what we know
in general about sofas and coffee tables and how they occlude each other.
SeGAN can learn to
Generate the appearance of the occluded parts of objects,
Segment the invisible parts of objects,
Although trained on synthetic photo realistic images reliably segment natural images,
By reasoning about occluder-occludee relations infer depth layering.