Human Generated Data

Title

Untitled (outdoor portrait with group standing and two nuns seated)

Date

c. 1910, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5948

Human Generated Data

Title

Untitled (outdoor portrait with group standing and two nuns seated)

People

Artist: Durette Studio, American 20th century

Date

c. 1910, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.8
Apparel 99.8
Person 99.1
Human 99.1
Person 96.3
Person 95.8
Person 95.7
Overcoat 93.1
Person 88.9
Sleeve 88.8
Person 88
Long Sleeve 82.9
Suit 78
People 74.8
Tuxedo 73.7
Fashion 73
Accessories 72
Accessory 72
Tie 72
Helmet 70.8
Coat 70.1
Indoors 67.1
Room 63.4
Court 63.4
Tie 62.6
Person 61.6
Portrait 59.8
Photo 59.8
Face 59.8
Photography 59.8
Cloak 59.5
Evening Dress 59.4
Robe 59.4
Gown 59.4
Military 57
Military Uniform 57
Officer 57
Female 55.7
Suit 50.1

Clarifai
created on 2019-11-16

people 99.9
group 98.4
adult 97.9
leader 97.5
group together 97.4
administration 96.6
man 95.9
wear 95.1
woman 94.8
portrait 94
four 92.7
five 91
several 89.9
three 88.8
actor 87.9
outfit 87.5
chair 84.6
military 83.2
uniform 82
two 79.6

Imagga
created on 2019-11-16

kin 87.7
groom 46.6
people 27.9
couple 26.1
bride 25.5
dress 23.5
love 22.9
man 22.2
wedding 22.1
happiness 21.1
black 19.1
person 18.9
male 18.5
happy 17.5
adult 16.6
silhouette 15.7
married 15.3
bouquet 15.1
marriage 14.2
together 14
attractive 14
fashion 13.6
two 13.5
men 12.9
group 12.1
youth 11.9
women 11.9
pose 11.8
bridal 11.7
portrait 11.6
gown 11
lifestyle 10.8
sunset 10.8
husband 10.7
pretty 10.5
sexy 10.4
wife 10.4
clothing 10.4
style 10.4
celebration 10.4
summer 10.3
romantic 9.8
family 9.8
outdoor 9.2
hand 9.1
romance 8.9
commitment 8.8
wed 8.8
ceremony 8.7
brunette 8.7
flowers 8.7
model 8.5
smile 8.5
evening 8.4
future 8.4
sky 8.3
attendant 8.2
fun 8.2
water 8
dance 7.8
party 7.7
dusk 7.6
walk 7.6
dark 7.5
human 7.5
friendship 7.5
girls 7.3
business 7.3
gorgeous 7.2
smiling 7.2
art 7.1
businessman 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 99.3
posing 96.3
standing 93.1
text 89.3
clothing 89
smile 86.5
man 72.8
dress 69.4
suit 61.9
clothes 17.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-68
Gender Male, 54.7%
Disgusted 45%
Calm 45.4%
Angry 54.4%
Confused 45%
Fear 45%
Sad 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 29-45
Gender Male, 54.7%
Fear 45%
Angry 45.7%
Calm 54.2%
Surprised 45%
Happy 45%
Confused 45%
Sad 45%
Disgusted 45%

AWS Rekognition

Age 48-66
Gender Female, 54%
Calm 48.1%
Sad 45.5%
Happy 45.1%
Angry 51.1%
Surprised 45%
Confused 45.1%
Disgusted 45.1%
Fear 45%

AWS Rekognition

Age 42-60
Gender Female, 50.2%
Calm 54.1%
Angry 45.1%
Disgusted 45%
Happy 45.2%
Sad 45.6%
Confused 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 31-47
Gender Male, 50.5%
Fear 45.2%
Calm 47.2%
Disgusted 45.5%
Angry 50.7%
Surprised 45.2%
Happy 45.3%
Sad 45.6%
Confused 45.4%

AWS Rekognition

Age 39-57
Gender Female, 54.6%
Fear 45%
Happy 45%
Confused 45%
Calm 54.8%
Disgusted 45%
Sad 45.1%
Angry 45%
Surprised 45%

AWS Rekognition

Age 36-52
Gender Male, 53.5%
Calm 53.1%
Disgusted 45%
Surprised 45%
Fear 45%
Happy 46.6%
Angry 45%
Confused 45.1%
Sad 45%

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 78%
Tie 72%
Helmet 70.8%
Coat 70.1%

Captions

Microsoft

a person standing in front of George Ulyett et al. posing for a photo 97.8%
George Ulyett et al. posing for a photo 97.7%
George Ulyett et al. posing for a photo in front of a building 97.6%