Human Generated Data

Title

Untitled (wedding guests holding hands at dinner table)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.39

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests holding hands at dinner table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Apparel 99.9
Clothing 99.9
Human 97.7
Person 97
Person 91.6
Tie 89.8
Accessories 89.8
Accessory 89.8
Dessert 87.8
Food 87.8
Creme 87.8
Cream 87.8
Icing 87.8
Cake 87.8
Plant 85.1
Blossom 84.8
Flower 84.8
Face 84.3
Meal 83.5
Coat 78
Overcoat 78
Suit 78
Flower Arrangement 77.3
Flower Bouquet 73.1
Female 71.8
Art 71.2
Photography 66
Photo 66
Portrait 66
Fashion 60.1
Gown 59.8
Robe 59.6
Dish 59.5
Bonnet 58.1
Woman 57.6
Hat 50.9

Clarifai
created on 2019-03-25

people 100
adult 99.5
group 99.5
two 99.5
three 99
leader 98.7
four 98.7
administration 98.2
man 98.2
group together 95.4
portrait 95.4
furniture 95.1
woman 94.6
several 94.3
facial expression 94
actress 91.8
outfit 90.2
sit 89.7
offspring 89.1
five 88.7

Imagga
created on 2019-03-25

people 30.1
person 29
portrait 27.8
groom 26
adult 25.3
man 24.2
happy 21.9
male 21.2
attractive 20.3
love 19.7
child 19.4
smile 19.2
bride 18.2
smiling 18.1
mother 18
clothing 17.8
wedding 16.6
couple 16.6
face 16.3
dress 16.3
women 15.8
happiness 15.7
cheerful 14.6
businessman 14.1
hat 14.1
business 14
home 13.6
hair 13.5
holding 13.2
kin 13.1
eyes 12.9
married 12.5
family 12.5
table 12.1
fashion 12.1
office 12.1
casual 11.9
work 11.8
gown 11.7
boy 11.3
sitting 11.2
men 11.2
old 11.1
expression 11.1
businesswoman 10.9
cute 10.8
toilet tissue 10.7
indoors 10.5
human 10.5
parent 10.5
brunette 10.5
mature 10.2
two 10.2
lifestyle 10.1
model 10.1
daughter 9.7
bridal 9.7
looking 9.6
tie 9.5
color 9.5
elegance 9.2
suit 9.2
father 9.2
children 9.1
confident 9.1
pretty 9.1
success 8.9
together 8.8
elderly 8.6
tissue 8.5
black 8.5
meeting 8.5
senior 8.4
room 8.4
world 8.4
studio 8.4
indoor 8.2
nurse 7.9
bonnet 7.9
domestic 7.9
day 7.8
veil 7.8
blond 7.8
corporate 7.7
husband 7.7
businesspeople 7.6
desk 7.6
dad 7.5
one 7.5
paper 7.4
style 7.4
glasses 7.4
headdress 7.4
lady 7.3
aged 7.2
sexy 7.2
celebration 7.2
posing 7.1
job 7.1

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 94.5
old 56.9
posing 51.8
wedding 51.8
family 23.9
black and white 15.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 99.1%
Happy 87.3%
Disgusted 2.6%
Calm 0.5%
Surprised 1.9%
Confused 4.4%
Angry 1.8%
Sad 1.4%

AWS Rekognition

Age 26-43
Gender Female, 99.5%
Sad 4.5%
Disgusted 3.2%
Calm 55.1%
Happy 5.6%
Confused 14.5%
Surprised 11.3%
Angry 5.8%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Tie 89.8%
Hat 50.9%

Captions

Microsoft

a group of people posing for a photo in front of a cake 88.6%
a couple of people that are standing in front of a cake 82.8%
a couple of people posing for a photo in front of a cake 82.7%