Human Generated Data

Title

Untitled (receiving line at wedding reception)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.13

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (receiving line at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 99.9
Apparel 99.9
Accessories 99.1
Tie 99.1
Accessory 99.1
Person 98.7
Human 98.7
Person 98.3
Overcoat 97.4
Coat 97.4
Suit 96.4
Person 95
Person 94.8
Person 93.5
Person 93.3
Wedding 91
Robe 89.2
Fashion 89.2
Gown 88.9
Tuxedo 87.9
Suit 82.7
People 78
Wedding Gown 75.1
Suit 67.6
Person 65.8
Plant 65.8
Flower 65.8
Blossom 65.8
Bride 65.2
Flower Arrangement 65.1
Flower Bouquet 58.4

Clarifai
created on 2019-03-25

people 100
group 99.8
group together 99.2
administration 98.7
leader 98.2
adult 97.7
several 97.1
four 96.4
many 96.1
five 95.9
wear 93.8
actress 93.5
man 93
woman 91.5
music 90.7
outfit 90.1
three 89.6
portrait 87.9
movie 87.8
offspring 87.4

Imagga
created on 2019-03-25

groom 60
man 38.3
people 30.1
business 29.8
male 29.1
person 27.3
businessman 26.5
adult 24.1
corporate 24.1
suit 22.7
professional 21.2
office 19.5
happy 19.4
businesswoman 19.1
executive 19.1
couple 18.3
businesspeople 18
meeting 17.9
men 17.2
colleagues 14.6
building 14.4
team 14.3
smile 14.2
happiness 14.1
group 13.7
dress 13.6
love 13.4
work 13.3
career 13.2
portrait 12.9
fashion 12.8
clothing 12.6
worker 12.4
sitting 12
women 11.9
confident 11.8
life 11.7
handsome 11.6
corporation 11.6
bride 11.5
formal 11.5
indoors 11.4
standing 11.3
success 11.3
attractive 11.2
manager 11.2
communication 10.9
teacher 10.6
job 10.6
cheerful 10.6
pretty 10.5
old 10.4
two 10.2
lifestyle 10.1
successful 10.1
indoor 10
family 9.8
businessmen 9.7
bouquet 9.4
smiling 9.4
room 9.4
mature 9.3
wedding 9.2
holding 9.1
employee 9.1
coworkers 8.8
discussion 8.8
kin 8.7
boss 8.6
garment 8.5
casual 8.5
company 8.4
teamwork 8.3
jacket 8.3
black 8
interior 8
gown 7.8
modern 7.7
30s 7.7
partnership 7.7
workplace 7.6
marriage 7.6
tie 7.6
outdoors 7.5
church 7.4
20s 7.3
friendly 7.3
new 7.3
laptop 7.3
home 7.2
staff 7.1
day 7.1
together 7

Google
created on 2019-03-25

Photograph 96.4
People 94.3
Snapshot 83.3
Vintage clothing 74.7
Gentleman 73.5
Event 69.4
Family 69.4
Classic 63.8
Grandparent 53.1
Art 50.2

Microsoft
created on 2019-03-25

person 99.9
standing 88.8
people 78.4
black 75.9
group 70.9
old 70.6
posing 56
dressed 45
clothes 22.4
wedding 12.2
school 2.6
retro 2.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Female, 99.9%
Surprised 2.2%
Angry 2.2%
Sad 2%
Calm 0.6%
Happy 89.2%
Confused 2.6%
Disgusted 1.2%

AWS Rekognition

Age 26-43
Gender Male, 99.2%
Happy 90.4%
Angry 2%
Sad 1.8%
Confused 1.1%
Disgusted 1.6%
Calm 1.1%
Surprised 2%

AWS Rekognition

Age 48-68
Gender Male, 90.4%
Sad 0.7%
Calm 0.6%
Happy 92.5%
Surprised 2.5%
Angry 2%
Disgusted 0.9%
Confused 0.9%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Disgusted 45.1%
Confused 45.2%
Sad 45.5%
Happy 53.5%
Surprised 45.3%
Calm 45.3%
Angry 45.1%

AWS Rekognition

Age 16-27
Gender Female, 52.3%
Confused 45.9%
Angry 46.3%
Surprised 46.5%
Sad 47.2%
Happy 45.3%
Calm 48.4%
Disgusted 45.3%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.1%
Person 98.7%
Suit 96.4%

Captions

Microsoft

a group of people posing for a photo 98.5%
a group of people posing for the camera 98.4%
a group of people posing for a picture 98.3%

Text analysis

Amazon

thrt
Ial thrt
Ial