Human Generated Data

Title

Untitled (formal family portrait in front of painted backdrop)

Date

1938

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4285

Human Generated Data

Title

Untitled (formal family portrait in front of painted backdrop)

People

Artist: Durette Studio, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99
Human 99
Person 98.7
Person 98.7
Person 98.3
Person 98.1
Person 95.3
Person 93.4
Person 90.7
Person 90.6
Person 88.4
Home Decor 87.7
Person 87.5
Asphalt 84.7
Tarmac 84.7
Person 82.1
People 78.2
Clothing 78.2
Apparel 78.2
Stage 73.2
Person 71.4
Crowd 70.9
Shorts 68.6
Face 66.5
Overcoat 65.5
Coat 65.5
Suit 65.5
Road 64.6
Transportation 62.7
Indoors 61.7
Vehicle 61.6
Person 58.9
Automobile 58.2
Car 58.2
Room 56.9
Sports Car 56
Art 55.7
Person 53

Clarifai
created on 2019-06-01

people 99.2
many 98.9
group together 97.8
monochrome 97.5
group 95.8
adult 94.5
crowd 94
administration 92.3
street 89.5
black and white 88.1
man 88
home 84.2
leader 82.1
city 81.3
woman 79.4
school 79.1
chair 78.7
ceremony 73.3
light 73.3
spectator 72.2

Imagga
created on 2019-06-01

picket fence 45.4
fence 40.1
snow 35.1
barrier 28.3
structure 24.5
winter 22.1
balcony 19.7
obstruction 18.9
architecture 16.5
cold 15.5
windowsill 15.2
trees 15.1
travel 14.8
tree 14.6
house 14.3
landscape 14.1
light 14
scene 13.8
home 13.5
outdoor 13
weather 12.8
city 12.5
sill 12.2
building 12
grunge 11.9
old 11.8
night 11.5
wall 11.3
wood 10.8
transportation 10.7
railing 10.6
residential 10.5
sky 10.2
water 10
scenery 9.9
park 9.9
vacation 9.8
season 9.3
holiday 9.3
street 9.2
structural member 9.1
tourism 9.1
decoration 9
design 9
summer 9
outdoors 9
rural 8.8
urban 8.7
ice 8.6
fountain 8.4
historic 8.2
transport 8.2
window 8.2
new 8.1
graffito 7.9
scenic 7.9
residence 7.9
snowing 7.9
covered 7.8
storm 7.7
row 7.4
vintage 7.4
speed 7.3
paint 7.2
road 7.2
history 7.2
cool 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

window 98.5
wedding dress 88.5
wedding 79.8
bride 78.3
ceremony 74.6
person 56.3

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 50.2%
Angry 49.5%
Happy 49.6%
Confused 49.6%
Sad 49.6%
Calm 50.1%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.7%
Calm 50.2%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 49.6%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 50.3%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Confused 49.6%
Happy 49.8%
Calm 49.7%
Disgusted 49.5%
Sad 49.7%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.6%
Happy 50.1%
Sad 49.7%
Disgusted 49.5%
Confused 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Angry 49.6%
Disgusted 49.6%
Confused 49.6%
Calm 49.6%
Sad 50%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 35-53
Gender Female, 50.1%
Angry 49.6%
Sad 49.6%
Happy 49.6%
Calm 49.6%
Confused 49.5%
Disgusted 50.1%
Surprised 49.5%

AWS Rekognition

Age 35-55
Gender Female, 50.1%
Angry 49.7%
Surprised 49.6%
Disgusted 50%
Sad 49.6%
Calm 49.6%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 10-15
Gender Female, 50.4%
Sad 49.9%
Surprised 49.6%
Happy 49.6%
Angry 49.6%
Calm 49.7%
Confused 49.6%
Disgusted 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.5%
Sad 49.7%
Surprised 49.6%
Disgusted 49.5%
Angry 49.6%
Calm 50%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 50.3%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Calm 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Angry 49.5%
Surprised 49.5%
Calm 49.7%
Sad 50%
Confused 49.6%
Disgusted 49.5%
Happy 49.7%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Calm 49.6%
Surprised 49.5%
Disgusted 49.6%
Happy 49.7%
Sad 49.9%
Confused 49.5%
Angry 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.6%
Calm 49.7%
Angry 49.6%
Sad 49.6%
Happy 49.7%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Sad 50.4%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Surprised 49.5%
Calm 50.2%
Disgusted 49.7%
Confused 49.5%
Sad 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.6%
Confused 49.6%
Angry 49.6%
Sad 49.7%
Calm 49.8%
Surprised 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-44
Gender Male, 50.2%
Happy 49.6%
Confused 49.7%
Angry 49.7%
Sad 49.8%
Calm 49.7%
Surprised 49.6%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.6%
Disgusted 49.8%
Angry 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Sad 49.7%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Surprised 49.5%
Disgusted 49.8%
Calm 49.5%
Happy 49.6%
Sad 49.9%
Angry 49.5%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.7%
Calm 49.5%
Confused 49.5%
Sad 50.1%
Surprised 49.5%
Angry 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.9%
Angry 49.5%
Sad 49.9%
Surprised 49.5%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 49.8%
Surprised 49.5%
Calm 50%
Confused 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.2%
Disgusted 49.7%
Sad 49.6%
Happy 49.6%
Surprised 49.5%
Calm 49.5%
Angry 50%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.7%
Happy 49.5%
Confused 49.6%
Calm 50%
Surprised 49.6%
Sad 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.5%
Happy 49.5%
Calm 49.7%
Disgusted 49.5%
Sad 50%
Angry 49.7%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.7%
Surprised 49.6%
Disgusted 49.6%
Sad 49.7%
Calm 49.7%
Happy 49.8%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Happy 49.5%
Disgusted 49.7%
Angry 49.6%
Calm 50.1%
Sad 49.6%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.5%
Disgusted 49.7%
Sad 49.8%
Happy 49.7%
Confused 49.5%
Surprised 49.6%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.5%
Happy 49.6%
Confused 49.5%
Sad 49.6%
Calm 50.2%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.5%
Confused 49.5%
Surprised 49.5%
Happy 50%
Sad 49.9%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Sad 49.8%
Happy 49.6%
Surprised 49.6%
Calm 49.6%
Disgusted 49.6%
Confused 49.8%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Sad 50.2%
Confused 49.5%
Disgusted 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.6%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 50.1%
Calm 49.5%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Happy 49.7%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.6%
Angry 49.6%
Calm 49.7%
Surprised 49.6%
Confused 49.6%
Sad 49.7%

AWS Rekognition

Age 16-27
Gender Female, 50%
Disgusted 49.6%
Calm 49.6%
Angry 49.6%
Sad 49.9%
Surprised 49.6%
Happy 49.5%
Confused 49.7%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Happy 49.5%
Calm 49.7%
Angry 49.6%
Confused 49.5%
Surprised 49.5%
Sad 50%
Disgusted 49.6%

AWS Rekognition

Age 38-57
Gender Female, 50.1%
Sad 49.8%
Surprised 49.6%
Happy 49.7%
Angry 49.6%
Calm 49.8%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Calm 49.5%
Disgusted 49.6%
Confused 49.5%
Sad 50.1%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Happy 49.5%
Confused 49.5%
Disgusted 50.2%
Sad 49.6%
Calm 49.6%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Sad 49.8%
Angry 49.7%
Disgusted 49.6%
Surprised 49.6%
Happy 49.6%
Calm 49.7%
Confused 49.6%

AWS Rekognition

Age 4-7
Gender Male, 50.4%
Disgusted 49.6%
Sad 50.3%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Angry 49.6%
Calm 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Confused 49.6%
Calm 49.7%
Sad 49.8%
Disgusted 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Sad 49.6%
Surprised 49.6%
Disgusted 49.5%
Angry 49.6%
Calm 50.2%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.6%
Angry 49.6%
Happy 49.6%
Confused 49.6%
Calm 50%
Surprised 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.6%
Angry 49.5%
Calm 50.2%
Confused 49.5%
Disgusted 49.5%
Happy 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Surprised 49.5%
Calm 49.6%
Disgusted 49.6%
Confused 49.5%
Sad 50.1%
Happy 49.6%
Angry 49.5%

AWS Rekognition

Age 14-25
Gender Female, 50.4%
Confused 49.5%
Disgusted 49.5%
Calm 49.7%
Angry 49.5%
Sad 49.7%
Happy 49.9%
Surprised 49.5%

AWS Rekognition

Age 19-36
Gender Male, 50.2%
Sad 49.5%
Calm 49.6%
Surprised 49.5%
Angry 49.5%
Disgusted 50.3%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Sad 50.4%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Sad 50%
Angry 49.8%
Happy 49.6%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.5%
Sad 49.8%
Confused 49.5%
Disgusted 49.6%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Calm 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Confused 49.6%
Surprised 49.6%
Angry 49.6%
Calm 49.6%
Disgusted 49.7%
Sad 49.9%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.6%
Calm 49.8%
Confused 49.6%
Sad 49.7%
Surprised 49.5%
Angry 49.9%
Happy 49.5%

AWS Rekognition

Age 38-59
Gender Female, 50.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.1%
Calm 49.7%
Angry 49.5%

AWS Rekognition

Age 16-27
Gender Male, 50.3%
Sad 50.2%
Angry 49.5%
Calm 49.5%
Confused 49.6%
Disgusted 49.6%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.5%
Happy 50.2%
Surprised 49.5%
Calm 49.6%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Confused 49.6%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Disgusted 49.6%
Calm 50%
Sad 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Sad 49.6%
Calm 49.6%
Happy 49.6%
Surprised 49.6%
Disgusted 49.6%
Angry 50.1%

AWS Rekognition

Age 60-80
Gender Female, 50.2%
Disgusted 49.6%
Angry 49.6%
Confused 49.6%
Sad 49.9%
Happy 49.6%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Calm 49.6%
Surprised 49.5%
Sad 49.6%
Confused 49.5%
Disgusted 49.6%
Happy 50%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Confused 49.5%
Surprised 49.5%
Calm 49.7%
Sad 50.1%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Confused 49.5%
Sad 49.7%
Calm 49.8%
Happy 49.8%
Surprised 49.5%
Disgusted 49.7%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Calm 49.7%
Disgusted 49.5%
Confused 49.5%
Sad 50.1%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50%
Disgusted 49.5%
Sad 49.7%
Happy 49.6%
Surprised 49.6%
Angry 49.6%
Calm 49.9%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Sad 49.7%
Angry 49.5%
Happy 50.1%
Confused 49.5%
Calm 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.1%
Disgusted 49.6%
Sad 50.1%
Happy 49.5%
Confused 49.6%
Surprised 49.5%
Angry 49.7%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Disgusted 49.6%
Calm 49.6%
Surprised 49.6%
Angry 49.7%
Happy 49.6%
Sad 49.9%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 49.5%
Sad 50.4%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Calm 50.3%
Sad 49.6%
Disgusted 49.5%

AWS Rekognition

Age 4-7
Gender Male, 50.2%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Sad 50.4%
Surprised 49.5%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.6%
Sad 50.1%
Happy 49.7%
Surprised 49.5%
Calm 49.5%
Angry 49.6%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Disgusted 49.5%
Confused 49.6%
Angry 49.5%
Calm 50.2%
Surprised 49.5%
Happy 49.5%
Sad 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 49.6%
Sad 49.9%
Surprised 49.6%
Happy 49.6%
Calm 49.8%
Disgusted 49.6%
Confused 49.6%

AWS Rekognition

Age 10-15
Gender Female, 50.4%
Sad 49.6%
Angry 49.5%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%
Happy 50.2%
Surprised 49.5%

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people standing in front of a window 75.8%
a group of people in front of a window 74.4%
a person standing in front of a window 71.4%

Text analysis

Amazon

im