The Loris Bite

 This technology blew my mind. PhotoSketch is a program that allows users to create images, using a sketch pad and text labels, that are compiled from images that are found on the internet. Once the sketch has been drawn and all elements, including the background, have been text labeled, PhotoSketch searches for matches for the labeled items.

PhotoSketch: Internet Image Montage on Vimeo.

The filtering system is what's really impressive. First, the salient region filter detects the general space that the scene item takes up in its original picture. The grab-cut algorithm is then used to cut the scene item from its image. The contour filter is then applied to remove all of the scene items that do not match the shape of the sketch drawn by the user. Last, the content filter is applied. The content filter uses feature space clustering and color matching to eliminate unsuitable matches.

Once the program has finished filtering, it produces several final images for the user to choose from. The program of course has its querks, but it works well enough!

They took down their site, but hopefully it will be back up soon!