Human Generated Data

Title

Untitled (studio portrait of two girls standing with matching white outfits)

Date

c. 1905-1915, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6013

Human Generated Data

Title

Untitled (studio portrait of two girls standing with matching white outfits)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.5
Person 99.5
Person 99.4
Person 98.6
Person 98.2
Person 97.6
Clothing 96.8
Apparel 96.8
Person 96.3
Stage 91.1
Furniture 84.2
Dress 84.1
Performer 82.7
Room 69.9
Indoors 69.9
Face 66
Photo 64.8
Photography 64.8
Portrait 64.8
Flooring 63.3
Female 63.2
Crowd 62.3
Leisure Activities 61.8
Chair 61.4
Dance 60.9
Footwear 60.4
Shoe 60.4
Shorts 60
Robe 57.5
Evening Dress 57.5
Gown 57.5
Fashion 57.5
People 56.4
Audience 55.2

Clarifai
created on 2019-11-16

people 99.9
group 98.9
woman 97.5
wear 97.1
group together 96.8
adult 95.8
man 95
music 94.8
many 92.1
child 91.9
stage 91.8
actress 91.2
theater 88.1
family 85.9
actor 85.5
musician 85.1
leader 82.4
outfit 82.4
singer 82.2
several 81

Imagga
created on 2019-11-16

kin 42.4
man 29.6
people 29
male 24.1
musical instrument 23.4
person 20
men 19.7
adult 19.2
businessman 18.5
business 17.6
women 15.8
outfit 15.8
silhouette 15.7
couple 15.7
wind instrument 15.2
sitting 13.7
group 12.9
percussion instrument 12.8
sax 12.7
city 12.5
walking 12.3
wall 12
brass 11.8
dark 11.7
chair 11.6
portrait 11
black 10.8
trombone 10.6
urban 10.5
office 10.4
world 10.4
professional 9.7
worker 9.3
executive 9.2
holding 9.1
marimba 9
sunset 9
job 8.8
body 8.8
happy 8.8
standing 8.7
lifestyle 8.7
happiness 8.6
corporate 8.6
fashion 8.3
street 8.3
indoor 8.2
suit 8.1
home 8
interior 8
love 7.9
together 7.9
stringed instrument 7.9
life 7.8
full length 7.8
performer 7.7
walk 7.6
tie 7.6
human 7.5
fun 7.5
sibling 7.4
light 7.3
window 7.3
cheerful 7.3
lady 7.3
looking 7.2
romance 7.1
handsome 7.1
singer 7
indoors 7
grandfather 7
modern 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

wall 98.4
clothing 96.3
standing 92
person 91.8
footwear 91.1
woman 85.1
text 77.5
black and white 76.3
posing 65.7
smile 63.9
man 61.7
dress 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 54.6%
Calm 45.3%
Sad 53.8%
Happy 45%
Angry 45.7%
Fear 45.1%
Surprised 45%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 5-15
Gender Female, 53.9%
Happy 45%
Disgusted 45%
Fear 45%
Calm 54.5%
Confused 45.1%
Sad 45.3%
Surprised 45%
Angry 45%

AWS Rekognition

Age 11-21
Gender Female, 54.8%
Happy 45%
Fear 45.1%
Sad 46.1%
Confused 45.8%
Disgusted 45.1%
Angry 45.5%
Calm 52.3%
Surprised 45.1%

AWS Rekognition

Age 28-44
Gender Male, 54.7%
Disgusted 45%
Sad 45.1%
Fear 45%
Angry 45.1%
Confused 45.1%
Happy 45%
Calm 54.6%
Surprised 45.1%

AWS Rekognition

Age 12-22
Gender Female, 54.8%
Calm 54.8%
Angry 45%
Disgusted 45%
Happy 45%
Sad 45.1%
Confused 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 16-28
Gender Female, 51.9%
Surprised 45.1%
Happy 53.5%
Confused 45%
Sad 45.3%
Angry 45.5%
Fear 45.1%
Disgusted 45.1%
Calm 45.4%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 61.4%
Shoe 60.4%

Captions

Microsoft

a group of people standing in front of a building 88.7%
a group of people posing for a photo 86.9%
a person standing in front of a group of people posing for a photo 75.3%