Human Generated Data

Title

Untitled (two couples dancing)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5339

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples dancing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 98.8
Overcoat 98.1
Suit 98.1
Coat 98.1
Person 97.3
Robe 96.4
Fashion 96.4
Gown 95.8
Accessory 93.7
Accessories 93.7
Tie 93.7
Tuxedo 92
Dress 90.6
Female 89.1
Wedding 87.5
Evening Dress 83.6
Bridegroom 83.4
Wedding Gown 77
Leisure Activities 74.6
Sunglasses 73.6
Woman 73.3
Face 72.4
Blazer 71.7
Jacket 71.7
Bride 71.7
Portrait 68
Photo 68
Photography 68
People 62.9
Sleeve 61.2
Dance Pose 60.9
Indoors 57.4
Man 55.7
Hug 55.4
Flower 55.3
Plant 55.3
Blossom 55.3

Imagga
created on 2022-01-22

person 31.8
man 22.8
fashion 22.6
people 21.7
portrait 19.4
male 19.1
adult 17.4
face 17
costume 16.8
art 15.4
stylish 15.4
style 14.1
model 14
body 13.6
clothing 13.1
attractive 12.6
sport 12.6
posing 12.4
black 12.1
dress 11.7
human 11.2
hair 11.1
work 11
planner 10.7
happy 10.6
job 10.6
medical 10.6
hairstyle 10.5
sexy 10.4
health 10.4
professional 10.4
expression 10.2
statue 10.2
make 10
smile 10
active 9.3
makeup 9.1
studio 9.1
business 9.1
pretty 9.1
motion 8.6
elegance 8.4
action 8.3
occupation 8.2
exercise 8.2
stethoscope 8
science 8
jacket 8
smiling 8
boy 7.8
culture 7.7
biology 7.6
guy 7.5
pink 7.5
dark 7.5
lady 7.3
confident 7.3
sensual 7.3
sculpture 7.1
worker 7.1
working 7.1
medicine 7
modern 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.7
person 98.8
wedding 93
dress 92.5
wedding dress 91.2
bride 89.4
clothing 84.1
ceremony 74.8
posing 73.5
woman 70.8
marriage 70.8
groom 63.5
smile 62.1
people 58.6
clothes 18.9

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 97.9%
Confused 92%
Sad 4%
Disgusted 1.2%
Happy 0.8%
Calm 0.7%
Surprised 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 36-44
Gender Female, 82.7%
Calm 83.3%
Sad 9.8%
Happy 2.8%
Confused 1.8%
Surprised 1%
Disgusted 0.7%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Fear 38.3%
Surprised 24.4%
Happy 20.1%
Sad 6.6%
Confused 5.4%
Angry 2.7%
Disgusted 1.5%
Calm 1%

AWS Rekognition

Age 36-44
Gender Female, 59%
Calm 72%
Surprised 26%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Happy 0.3%
Fear 0.3%
Sad 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 93.7%
Sunglasses 73.6%

Captions

Microsoft

a group of people posing for a photo 96.5%
a group of people posing for the camera 96.4%
a group of people posing for a picture 96.3%

Text analysis

Amazon

8
17552.

Google

.
2
ssר(
. 2 ssר( ..ב 5Sדן
..ב
5Sדן