Human Generated Data

Title

Untitled (groom reads aloud at dinner)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.30
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (groom reads aloud at dinner)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.30

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 99
Apparel 98.9
Clothing 98.9
Person 98.7
Tie 98.2
Accessory 98.2
Accessories 98.2
Person 96.9
Person 96.1
Person 94.5
Suit 90.3
Overcoat 90.3
Coat 90.3
Sitting 85.6
Furniture 85
Indoors 84.6
People 80
Tie 75.6
Room 75.3
Tie 68.6
Tuxedo 67.2
Plant 64.5
Flower 64.2
Blossom 64.2
Female 63.8
Suit 60.3
Meal 59.9
Food 59.9
Senior Citizen 58.7
Flower Arrangement 58.4
Gown 57.5
Fashion 57.5
Living Room 56.6
Waiting Room 56
Robe 55.5
Reception 55.3

Clarifai
created on 2019-03-25

people 100
group 99.7
adult 99.1
administration 98.6
group together 98.5
leader 98.4
four 97.7
woman 96.5
man 96.5
actress 96.4
several 96.2
facial expression 95.9
five 94.1
furniture 93.7
three 92.3
offspring 92.1
sit 91.9
chair 88.9
room 87
many 86.8

Imagga
created on 2019-03-25

groom 100
people 38.5
couple 37.5
man 37
male 30.6
kin 30.3
adult 28.6
happy 26.3
person 26
happiness 25.1
bride 25.1
dress 24.4
love 22.9
wedding 22.1
meeting 21.7
home 20.8
men 19.8
marriage 19
smiling 18.8
portrait 18.8
smile 18.5
business 18.2
attractive 16.8
together 16.7
mother 16.4
businesswoman 16.4
businesspeople 16.1
group 16.1
two 16.1
office 16.1
room 15.9
lifestyle 15.9
businessman 15.9
cheerful 15.5
family 15.1
bouquet 14.3
women 14.2
husband 14.1
brunette 13.9
celebration 13.6
work 13.4
pretty 13.3
indoors 13.2
corporate 12.9
bow tie 12.9
indoor 12.8
team 12.5
romance 12.5
waiter 12
handsome 11.6
married 11.5
lady 11.4
teamwork 11.1
20s 11
day 11
suit 10.9
romantic 10.7
interior 10.6
engagement 10.6
working 10.6
talking 10.5
wife 10.4
adults 10.4
executive 10.4
rose 10.3
presentation 10.2
worker 10.2
communication 10.1
professional 9.9
fashion 9.8
necktie 9.8
gown 9.8
bridal 9.7
colleagues 9.7
success 9.7
sexy 9.6
life 9.6
table 9.5
relationship 9.4
face 9.2
clothing 9.1
dining-room attendant 8.8
veil 8.8
busy 8.7
sitting 8.6
workplace 8.6
laughing 8.5
desk 8.5
modern 8.4
elegance 8.4
human 8.3
successful 8.2
fun 8.2
style 8.2
ceremony 7.8
affectionate 7.7
party 7.7
partner 7.7
mid adult 7.7
flower 7.7
old 7.7
loving 7.6
senior 7.5
outdoors 7.5
manager 7.5
holding 7.4
joyful 7.4
new 7.3
celebrate 7.2
color 7.2
kitchen 7.2
job 7.1

Google
created on 2019-03-25

People 96.6
Photograph 95.8
Snapshot 82
Vintage clothing 77.4
Family 73.6
Classic 63.8
Event 62.7
Retro style 55.3

Microsoft
created on 2019-03-25

person 99.8
wall 99.1
table 98
indoor 95.9
people 91
group 86
old 54.5
posing 49.5
dinner 35
restaurant 20.7
older 20.4
dining table 19.8
wedding 1.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Male, 87.9%
Sad 0.8%
Confused 0.9%
Angry 1.8%
Surprised 2.1%
Calm 0.6%
Disgusted 1.2%
Happy 92.6%

AWS Rekognition

Age 20-38
Gender Female, 98.7%
Happy 96%
Sad 1.5%
Angry 0.8%
Disgusted 0.4%
Surprised 0.8%
Calm 0.2%
Confused 0.2%

AWS Rekognition

Age 26-44
Gender Male, 99.4%
Calm 81.8%
Disgusted 0.5%
Confused 2.6%
Happy 1.5%
Surprised 1.5%
Angry 1.5%
Sad 10.7%

AWS Rekognition

Age 49-69
Gender Male, 98.2%
Calm 27%
Happy 3%
Sad 46.7%
Angry 6.1%
Disgusted 2.6%
Confused 12.4%
Surprised 2.1%

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Disgusted 0.9%
Confused 1.1%
Surprised 0.7%
Angry 1.3%
Happy 92.4%
Sad 3.2%
Calm 0.4%

AWS Rekognition

Age 14-25
Gender Female, 95.8%
Sad 0.3%
Angry 0.5%
Surprised 0.2%
Happy 98.1%
Calm 0.1%
Confused 0.3%
Disgusted 0.4%

AWS Rekognition

Age 35-52
Gender Male, 97.7%
Disgusted 0.4%
Surprised 1.3%
Confused 2.4%
Angry 57.9%
Sad 24.4%
Calm 13.2%
Happy 0.4%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.7%
Person 99.7%
Person 99.5%
Person 99%
Person 98.7%
Person 96.9%
Person 96.1%
Person 94.5%
Tie 98.2%
Tie 75.6%
Tie 68.6%
Suit 90.3%
Suit 60.3%

Categories

Imagga

people portraits 97.4%
paintings art 2.4%