Some datasets

• MIT CSAIL LabelMe, open annotation tool related tech report

• PASCAL Visual Object Classes challenges (2005-2007)

• Wordnet

• Caltech101

• Caltech256

• TREC Video Retrieval Evaluation

• Oxford buildings dataset

• Photo-tourism patches

• CMU Face databases

• ETH-80

• Graz 02

• MIT Objects and Scenes

• NYU NORB dataset

• Columbia COIL

• Oxford flowers dataset

• SFU activity dataset (sports)

• Princeton events dataset

• Weizmann activity videos

• Reuters

• Dataset list from the Computer Vision Homepage

• Image Parsing