Human Generated Data

Title

Untitled (man giving a toast)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.27

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man giving a toast)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.27

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 99.5
Person 99.5
Person 99.3
Plant 99.2
Person 98
Person 97.7
Person 97.6
Blossom 97.5
Flower 97.5
Person 97
Flower Arrangement 95.8
Person 95.4
Flower Bouquet 94.6
Person 94.3
Apparel 93.3
Clothing 93.3
Person 92.5
Person 86.4
Person 84
Person 80.7
Person 71.5
Gown 71.3
Fashion 71.3
Person 70
Coat 69
Overcoat 69
Robe 66.5
People 62.8
Photography 59.9
Photo 59.9
Suit 59
Wedding 58.1
Pattern 56.6
Art 56.6
Floral Design 56.6
Graphics 56.6
Accessory 56.2
Accessories 56.2
Tie 56.2
Wedding Gown 55.8

Clarifai
created on 2019-03-25

people 99.9
group 99.3
adult 98.6
group together 98.2
many 98.2
administration 97.4
leader 97.3
furniture 96.6
woman 96.3
man 96.1
several 93
room 92.7
child 89.3
war 89.2
wear 87.8
chair 87.3
home 87.1
four 86.3
five 84.6
military 84.5

Imagga
created on 2019-03-25

kin 79.8
man 30.2
groom 29.6
male 28.3
people 25.1
couple 23.5
person 20
happy 19.4
adult 18.9
bride 17.4
women 17.4
happiness 17.2
dress 17.1
portrait 16.8
love 15.8
two 15.2
family 15.1
fashion 14.3
room 13.7
home 13.5
men 12.9
wedding 12.9
business 12.7
child 12.7
black 12
smiling 11.6
businessman 11.5
youth 11.1
interior 10.6
marriage 10.4
mother 10.2
teacher 10.2
romantic 9.8
old 9.7
standing 9.6
bouquet 9.4
day 9.4
smile 9.3
indoor 9.1
pretty 9.1
cheerful 8.9
shop 8.9
office 8.8
indoors 8.8
together 8.8
boy 8.7
sitting 8.6
husband 8.6
face 8.5
future 8.4
fun 8.2
outdoors 8.2
sexy 8
lifestyle 7.9
outdoor 7.6
adults 7.6
joy 7.5
relationship 7.5
vintage 7.4
style 7.4
lady 7.3
new 7.3
building 7.3
life 7.2
holiday 7.2
hair 7.1
professional 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.6
wall 96.9
group 95.3
indoor 89.1
people 85.7
black 72.4
posing 51.9
old 43.7
room 43.4
family 25.6
dining room 9.8
dining table 7.5
crowd 0.5
child 0.1
wedding 0.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Male, 54.7%
Surprised 45.5%
Confused 45.4%
Calm 49.6%
Disgusted 45.2%
Angry 45.7%
Happy 46.8%
Sad 46.8%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Happy 50.5%
Disgusted 45.2%
Calm 46.5%
Sad 46.8%
Surprised 45.5%
Confused 45.2%
Angry 45.4%

AWS Rekognition

Age 19-36
Gender Male, 54.5%
Happy 45.2%
Calm 50.9%
Angry 45.6%
Disgusted 45.2%
Confused 45.4%
Surprised 45.7%
Sad 46.9%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Happy 50.3%
Disgusted 45.2%
Confused 45.3%
Surprised 45.3%
Calm 46%
Sad 47.4%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Female, 52.5%
Happy 46.3%
Surprised 45.4%
Sad 45.8%
Confused 45.2%
Angry 45.4%
Disgusted 45.8%
Calm 51%

AWS Rekognition

Age 27-44
Gender Male, 54.7%
Calm 45.1%
Surprised 45.1%
Confused 45%
Sad 45.1%
Angry 45.1%
Happy 54.5%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Female, 50.7%
Surprised 47.1%
Disgusted 45.5%
Calm 45.6%
Sad 45.7%
Confused 45.4%
Happy 50.1%
Angry 45.7%

AWS Rekognition

Age 20-38
Gender Female, 50%
Happy 45%
Confused 45.4%
Disgusted 45.1%
Angry 45.2%
Calm 45.6%
Surprised 45.3%
Sad 53.4%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Happy 45.2%
Calm 47.6%
Sad 50.7%
Angry 45.7%
Confused 45.3%
Surprised 45.2%
Disgusted 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Angry 47.5%
Happy 45.1%
Sad 49.5%
Confused 45.2%
Disgusted 45.1%
Calm 47.5%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Sad 45.8%
Surprised 46.3%
Calm 47.6%
Confused 47.1%
Happy 45.6%
Disgusted 46.3%
Angry 46.4%

AWS Rekognition

Age 17-27
Gender Male, 54.1%
Confused 45.7%
Happy 45.3%
Surprised 45.6%
Disgusted 45.5%
Calm 49.4%
Angry 47.6%
Sad 45.9%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 59%
Tie 56.2%