Human Generated Data

Title

Untitled (rephotographed vintage portrait of family and young children sitting outside house)

Date

c. 1950-1960

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11145

Human Generated Data

Title

Untitled (rephotographed vintage portrait of family and young children sitting outside house)

People

Artist: Claseman Studio, American 20th century

Date

c. 1950-1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Human 99.7
Person 99.7
Person 99.6
Person 99.1
Person 97.5
Person 96.4
Person 95.1
Person 94.8
Person 91.6
Housing 90.5
Building 90.5
People 88.8
Person 87.6
Person 86.4
Person 86
Person 83.6
Clothing 76.6
Apparel 76.6
Person 75.3
Person 67.9
Person 64.4
Porch 63.7
Dress 57
Home Decor 57
Drawing 56.7
Art 56.7

Clarifai
created on 2019-03-26

people 99.9
group 98.2
group together 97.3
child 95.8
adult 95.7
many 95.2
man 94
woman 93.6
wear 85.6
several 80.4
education 80.2
boy 79.9
outfit 79.5
recreation 78.1
war 78
military 77.6
music 77.1
vehicle 76.2
street 75.7
one 74.7

Imagga
created on 2019-03-26

graffito 29.2
mobile home 28.8
negative 27.5
structure 24.9
housing 23.7
trailer 22.9
decoration 21.4
film 20.9
grunge 18.7
wheeled vehicle 18
picket fence 17.1
old 16.7
vintage 16.5
fence 16.4
black 15
vehicle 15
photographic paper 14.7
texture 14.6
art 13
dirty 12.6
antique 12.1
barrier 11.6
trees 11.6
daily 11
city 10.8
man 10.7
grungy 10.4
pattern 10.3
dark 10
water 10
paint 10
aged 10
retro 9.8
photographic equipment 9.8
snow 9.4
world 9.4
kin 9.3
tree 9.2
street 9.2
lake 9.1
landscape 8.9
people 8.9
wall 8.9
building 8.8
mask 8.6
dirt 8.6
frame 8.3
sky 8.3
history 8
light 8
forest 7.8
travel 7.7
fog 7.7
wallpaper 7.7
newspaper 7.6
house 7.5
weather 7.3
design 7.3
rough 7.3
industrial 7.3
border 7.2
color 7.2
cool 7.1
obstruction 7.1
architecture 7
textured 7

Google
created on 2019-03-26

Microsoft
created on 2019-03-26

window 92.1
child 66.2
old 66.2
boy 40
school 26.8
black and white 11.6

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 50.8%
Disgusted 45.3%
Angry 46.1%
Happy 45.4%
Confused 45.9%
Calm 46.6%
Sad 49.9%
Surprised 45.7%

AWS Rekognition

Age 20-38
Gender Male, 50.8%
Disgusted 45.1%
Angry 45.2%
Surprised 45.1%
Calm 49.9%
Happy 49.2%
Sad 45.3%
Confused 45.1%

AWS Rekognition

Age 45-65
Gender Female, 53%
Angry 46.2%
Calm 46.1%
Confused 46%
Happy 46.2%
Disgusted 46.3%
Sad 47%
Surprised 47.2%

AWS Rekognition

Age 26-44
Gender Female, 51.8%
Angry 46%
Happy 46.3%
Sad 47.7%
Calm 47.9%
Confused 45.5%
Disgusted 46%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Angry 45.3%
Disgusted 45.1%
Surprised 45.5%
Calm 51.9%
Sad 45.8%
Happy 45.6%
Confused 45.7%

AWS Rekognition

Age 16-27
Gender Male, 54.4%
Sad 48.4%
Calm 48.2%
Confused 46.2%
Disgusted 45.2%
Angry 45.2%
Happy 46.2%
Surprised 45.6%

AWS Rekognition

Age 27-44
Gender Male, 51.6%
Angry 45.6%
Happy 45%
Disgusted 45.1%
Surprised 45.4%
Calm 47.4%
Sad 50.6%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Angry 46.3%
Happy 45.5%
Disgusted 46.6%
Sad 50.4%
Calm 45.4%
Confused 45.5%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Calm 48.7%
Confused 45.4%
Surprised 45.5%
Sad 49.5%
Angry 45.4%
Disgusted 45.2%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Disgusted 45.3%
Happy 45.3%
Angry 45.5%
Sad 47.7%
Calm 50.3%
Confused 45.4%
Surprised 45.5%

AWS Rekognition

Age 23-38
Gender Male, 50.3%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Confused 49.6%
Calm 50.2%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 51.4%
Disgusted 45.1%
Happy 45.2%
Surprised 45.3%
Angry 45.4%
Sad 47.8%
Confused 45.5%
Calm 50.7%

AWS Rekognition

Age 14-25
Gender Female, 54.3%
Sad 51.7%
Happy 45.7%
Disgusted 45.1%
Calm 46.7%
Angry 45.3%
Confused 45.3%
Surprised 45.2%

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people standing in front of a window 60.4%
a group of people in front of a window 57.9%
a group of people standing next to a window 57.8%

Text analysis

Amazon

W