Human Generated Data

Title

Untitled (guests seated for dinner at wedding reception)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.25

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (guests seated for dinner at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 100
Apparel 100
Person 99.7
Human 99.7
Person 99.4
Person 99
Person 98.7
Person 98.7
Coat 98.6
Overcoat 98.6
Person 97.4
Person 95.3
Person 93.8
Person 92.6
Fashion 92
Robe 92
Gown 91.9
Tuxedo 91.6
Tie 90.1
Accessory 90.1
Accessories 90.1
Person 90
Wedding 89.8
Plant 88.1
Person 85.8
Person 85.8
Person 81.8
Wedding Gown 80.7
Blossom 80.6
Flower Arrangement 80.6
Flower Bouquet 80.6
Flower 80.6
Bride 78.2
People 76.8
Suit 75.2
Furniture 71.8
Table 71.8
Dining Table 71.8
Person 70.1
Person 63.1
Meal 63
Food 63
Tie 51.2

Clarifai
created on 2019-03-25

people 100
group 99.9
leader 98.5
many 98.5
group together 98.3
adult 98.1
administration 97.9
several 97.4
child 96
five 94.2
four 93.5
woman 93.2
man 92.4
outfit 92.4
furniture 91.4
offspring 90.2
home 88.1
actress 87.9
wear 87.9
military 86.9

Imagga
created on 2019-03-25

kin 42.1
people 31.8
man 31.6
male 29.1
person 28.9
adult 26.3
couple 24.4
teacher 19.4
dress 19
happiness 18.8
businessman 18.5
happy 18.2
room 18.1
family 17.8
men 17.2
business 17
groom 16.3
meeting 16
smiling 15.9
professional 15.6
home 15.1
women 14.2
love 14.2
indoors 14
cheerful 13.8
group 13.7
portrait 13.6
two 13.5
child 13.1
lifestyle 13
table 13
businesswoman 12.7
team 12.5
together 12.3
color 12.2
mother 12
bride 11.5
businesspeople 11.4
husband 11.2
senior 11.2
educator 11.2
life 11.2
smile 10.7
interior 10.6
old 10.4
executive 10.3
face 9.9
student 9.9
holding 9.9
suit 9.9
fashion 9.8
office 9.6
celebration 9.6
wife 9.5
corporate 9.4
wedding 9.2
20s 9.2
romantic 8.9
bouquet 8.9
world 8.7
boy 8.7
married 8.6
sitting 8.6
marriage 8.5
worker 8.5
relationship 8.4
communication 8.4
indoor 8.2
nurse 8.1
new 8.1
success 8
to 8
work 7.8
brunette 7.8
pretty 7.7
attractive 7.7
costume 7.6
fun 7.5
clothing 7.3
romance 7.1
handsome 7.1

Google
created on 2019-03-25

Photograph 96.4
People 95.4
Snapshot 82.9
Vintage clothing 79.2
Event 75.9
Family 72.9
Photography 62.4
Classic 56.7
Black-and-white 56.4
Retro style 51.3
Art 50.2

Microsoft
created on 2019-03-25

person 99.7
wall 98
indoor 92.9
group 88.5
old 85.2
posing 84.9
black 79.5
people 70.8
white 62.4
school 21.9
family 14.2
library 9.2
wedding 8.7
retro 8.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.6%
Angry 2.3%
Sad 2%
Happy 41.1%
Calm 38.9%
Surprised 10.4%
Confused 3.9%
Disgusted 1.5%

AWS Rekognition

Age 19-36
Gender Female, 99.8%
Confused 2%
Sad 0.9%
Angry 2.1%
Happy 92.5%
Calm 0.3%
Disgusted 0.8%
Surprised 1.5%

AWS Rekognition

Age 20-38
Gender Female, 96%
Happy 10.8%
Sad 49.9%
Calm 15.3%
Angry 7.8%
Confused 7.9%
Disgusted 5.2%
Surprised 3.1%

AWS Rekognition

Age 26-44
Gender Male, 95.3%
Confused 11.4%
Calm 70.6%
Happy 1%
Disgusted 1.6%
Surprised 4.1%
Sad 8.7%
Angry 2.6%

AWS Rekognition

Age 10-15
Gender Female, 54.7%
Surprised 45%
Sad 45.1%
Disgusted 45%
Happy 54.8%
Confused 45%
Calm 45%
Angry 45%

AWS Rekognition

Age 16-27
Gender Female, 52.9%
Happy 45%
Confused 45.1%
Sad 46%
Calm 53.8%
Surprised 45%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 55%
Confused 45.5%
Happy 45.1%
Angry 45.7%
Disgusted 45.1%
Sad 53%
Calm 45.4%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Calm 46.7%
Surprised 46.6%
Confused 45.9%
Sad 46.1%
Angry 45.4%
Happy 48.6%
Disgusted 45.6%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Calm 48.4%
Happy 45.1%
Sad 45.1%
Angry 45.1%
Disgusted 51.3%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 97.5%
Sad 15.5%
Confused 8%
Angry 7.6%
Surprised 3.3%
Calm 58%
Disgusted 4.4%
Happy 3.3%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Surprised 45.1%
Angry 45.1%
Disgusted 45.1%
Happy 53.8%
Sad 45.8%
Confused 45.1%
Calm 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Sad 45.6%
Happy 45.4%
Confused 45.3%
Surprised 45.4%
Disgusted 45.2%
Calm 52.9%
Angry 45.3%

AWS Rekognition

Age 35-53
Gender Male, 54.8%
Confused 45.3%
Angry 46.8%
Surprised 45.4%
Sad 47.6%
Happy 45.1%
Calm 49.4%
Disgusted 45.3%

AWS Rekognition

Age 30-47
Gender Male, 54.3%
Calm 47.1%
Sad 47.1%
Disgusted 47.7%
Happy 45.4%
Confused 45.7%
Angry 46.5%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Happy 45.2%
Confused 45.6%
Sad 49.3%
Calm 46.3%
Surprised 45.1%
Angry 48.5%
Disgusted 45.1%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 90.1%
Suit 75.2%
Dining Table 71.8%

Captions

Microsoft

a group of people posing for a photo 96.5%
a black and white photo of a group of people posing for the camera 94%
an old photo of a group of people posing for the camera 93.9%