Human Generated Data

Title

Untitled (portrait of members of clergy on steps and porch of house)

Date

1937

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3975

Human Generated Data

Title

Untitled (portrait of members of clergy on steps and porch of house)

People

Artist: Durette Studio, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 98.9
Person 98.9
Person 98.5
Person 98.5
Person 98.3
Person 98.1
Person 98.1
Person 97.2
Apparel 97.1
Clothing 97.1
Person 97
Person 96.7
Person 86.7
People 82.4
Person 80.4
Person 76.2
Priest 76.1
Face 68.1
Female 64.4
Dress 63.5
Photography 63.4
Portrait 63.4
Photo 63.4
Robe 63.2
Fashion 63.2
Home Decor 59.5
Building 57.2
Housing 57.2
Sleeve 57.2
Smile 57
Gown 56.2
Bishop 55.7
Costume 55.6
Tie 55.5
Accessories 55.5
Accessory 55.5

Clarifai
created on 2019-06-01

people 99.5
group 99.1
wedding 97.8
woman 97.4
adult 95.9
group together 95.6
man 94.8
veil 92.5
many 91.9
wear 91.9
leader 91.4
bride 90.2
groom 87.7
ceremony 85.7
indoors 83.2
several 83
room 80.1
outfit 78
gown (clothing) 76.8
education 76.7

Imagga
created on 2019-06-01

kin 47.5
people 29.5
nurse 25.4
man 24.2
adult 24
male 21.3
happy 20
clothing 18.7
person 18.6
men 17.2
women 16.6
businessman 15.9
business 15.8
catholic 15.7
couple 15.7
happiness 14.9
family 14.2
portrait 14.2
day 14.1
group 13.7
home 12.8
gown 12.3
smiling 12.3
corporate 12
human 12
two 11.9
old 11.8
love 11.8
vestment 11.7
smile 11.4
professional 11.2
bride 10.7
statue 10.7
standing 10.4
walking 10.4
groom 10.2
life 10.1
businesswoman 10
building 9.8
indoors 9.7
together 9.6
businesspeople 9.5
lifestyle 9.4
senior 9.4
clothes 9.4
mature 9.3
church 9.2
office 9.2
house 9.2
tourism 9.1
suit 9
team 9
history 8.9
new 8.9
mother 8.9
40s 8.8
30s 8.6
face 8.5
casual 8.5
travel 8.4
modern 8.4
monument 8.4
wedding 8.3
outdoors 8.2
tourist 8.2
religion 8.1
looking 8
metropolitan 7.9
color 7.8
colleagues 7.8
full length 7.8
world 7.7
attractive 7.7
married 7.7
elderly 7.7
room 7.6
daughter 7.6
health 7.6
adults 7.6
city 7.5
company 7.4
worker 7.4
cheerful 7.3
holiday 7.2
job 7.1
medical 7.1
architecture 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

window 98.6
wedding dress 97.9
bride 95.5
dress 91.1
wedding 84.3
clothing 81.9
woman 80.3
person 79.1
white 66.2

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Disgusted 46.2%
Confused 45.5%
Angry 45.6%
Calm 47.6%
Surprised 45.6%
Happy 48.6%
Sad 45.9%

AWS Rekognition

Age 49-69
Gender Female, 52.5%
Disgusted 45.1%
Calm 45.1%
Angry 45.5%
Sad 53.5%
Surprised 45.3%
Happy 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Confused 45.4%
Disgusted 45.2%
Calm 52.4%
Angry 45.6%
Sad 45.6%
Happy 45.4%
Surprised 45.5%

AWS Rekognition

Age 27-44
Gender Male, 51.4%
Happy 45.7%
Disgusted 45.9%
Angry 46.5%
Calm 45.8%
Sad 49.1%
Confused 45.9%
Surprised 46.1%

AWS Rekognition

Age 38-59
Gender Male, 53.1%
Surprised 45.3%
Disgusted 45.3%
Calm 51.5%
Happy 45.2%
Sad 46%
Angry 45.9%
Confused 45.6%

AWS Rekognition

Age 38-59
Gender Male, 52.7%
Happy 45.2%
Sad 48.8%
Confused 46%
Angry 45.9%
Disgusted 45.7%
Surprised 45.7%
Calm 47.7%

AWS Rekognition

Age 26-44
Gender Female, 54.3%
Disgusted 45.3%
Happy 45.1%
Surprised 45.1%
Sad 52.5%
Angry 46.4%
Confused 45.1%
Calm 45.5%

AWS Rekognition

Age 14-23
Gender Female, 54.2%
Happy 45.7%
Surprised 45.8%
Angry 46.5%
Confused 45.2%
Calm 45.3%
Sad 48.6%
Disgusted 48%

AWS Rekognition

Age 14-25
Gender Female, 51.4%
Angry 45.4%
Happy 45.5%
Confused 45.5%
Calm 46.8%
Surprised 45.5%
Sad 50.9%
Disgusted 45.5%

AWS Rekognition

Age 27-44
Gender Female, 52.7%
Angry 45.6%
Happy 50.7%
Confused 45.5%
Calm 46.4%
Disgusted 45.3%
Sad 46%
Surprised 45.5%

AWS Rekognition

Age 17-27
Gender Female, 54.3%
Sad 46%
Surprised 45.7%
Disgusted 45.5%
Angry 45.4%
Calm 50.9%
Happy 45.8%
Confused 45.7%

AWS Rekognition

Age 35-52
Gender Female, 50.6%
Surprised 45.8%
Happy 45.6%
Disgusted 45.9%
Calm 47.5%
Sad 47.5%
Confused 45.9%
Angry 46.8%

AWS Rekognition

Age 60-90
Gender Female, 51.9%
Happy 45.1%
Disgusted 45.5%
Angry 45.4%
Calm 48.2%
Surprised 45.3%
Confused 46.3%
Sad 49.1%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Surprised 49.6%
Calm 50%
Disgusted 49.7%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Angry 45.4%
Happy 45.5%
Calm 47%
Surprised 45.6%
Sad 50.7%
Confused 45.5%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.6%
Happy 50.2%
Surprised 49.5%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 16-27
Gender Female, 54.3%
Happy 45.2%
Sad 45.9%
Surprised 46.1%
Confused 45.7%
Disgusted 45.2%
Calm 51.7%
Angry 45.2%

AWS Rekognition

Age 17-27
Gender Female, 53.4%
Sad 49.6%
Angry 46.2%
Calm 45.5%
Confused 45.5%
Disgusted 46.7%
Happy 45.7%
Surprised 45.7%

AWS Rekognition

Age 29-45
Gender Female, 50.5%
Disgusted 49.6%
Calm 50%
Surprised 49.5%
Angry 49.6%
Happy 49.7%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Male, 52.1%
Surprised 45.7%
Calm 48.9%
Disgusted 45.3%
Confused 46.4%
Sad 47.5%
Happy 45.4%
Angry 45.7%

Feature analysis

Amazon

Person 98.9%
Tie 55.5%

Captions

Microsoft

a group of people standing in front of a window 90.8%
a group of people standing in front of a building 90.7%
a group of people standing next to a window 90.4%