Human Generated Data

Title

Untitled (man and woman dressed as centaurs)
Date

1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7584
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman dressed as centaurs)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.8
Person 99.8
Person 99.8
Indoors 97.5
Room 97.5
Person 96.5
Person 95.7
Person 93.6
Person 91.6
Person 91
Interior Design 89.3
Furniture 88.9
Person 87.4
Person 86.7
Person 86
Clothing 79.1
Apparel 79.1
People 78.1
Person 77.6
Hat 74.4
Crowd 71.5
Female 65.4
Suit 63.3
Overcoat 63.3
Coat 63.3
Dog 62.3
Animal 62.3
Mammal 62.3
Canine 62.3
Pet 62.3
Girl 62.2
Person 59.9
Photo 58.4
Photography 58.4
Kid 56.5
Child 56.5
Blonde 56.5
Woman 56.5
Teen 56.5
Classroom 55.1
School 55.1
Chair 50.1

Imagga
created on 2022-01-08

clothing 33.4
bathing cap 31.1
people 27.9
swimsuit 25
silhouette 24.8
cap 24.2
garment 23.7
person 23
headdress 19.2
adult 18.6
women 18.2
man 18.1
fashion 18.1
model 17.9
covering 17.8
sexy 17.7
sunset 17.1
lady 17
body 16
lifestyle 15.9
consumer goods 15.8
swimming trunks 15.7
black 15.1
portrait 14.2
male 14.2
men 13.7
attractive 13.3
leisure 13.3
couple 13.1
happy 12.5
group 12.1
style 11.9
sensual 11.8
summer 11.6
walking 11.4
pretty 11.2
maillot 11
sport 10.9
sky 10.2
beach 10.1
water 10
outdoor 9.9
sun 9.7
dark 9.2
pose 9.1
human 9
life 8.7
train 8.7
art 8.6
motion 8.6
youth 8.5
two 8.5
travel 8.4
friendship 8.4
health 8.3
outdoors 8.3
bikini 8.2
dress 8.1
light 8
chair 7.9
cute 7.9
love 7.9
together 7.9
sea 7.8
sitting 7.7
elegant 7.7
outside 7.7
crowd 7.7
skin 7.6
fun 7.5
evening 7.5
ocean 7.5
dancer 7.3
exercise 7.3
gorgeous 7.2
figure 7.2
smiling 7.2
activity 7.2
hair 7.1
smile 7.1
face 7.1
happiness 7.1
athlete 7

Google
created on 2022-01-08

Footwear 98.1
Photograph 94.2
Black 89.7
Black-and-white 85.8
Style 84
Font 81.4
Monochrome photography 74.8
Snapshot 74.3
Dance 74.1
Monochrome 73.6
Event 73
Room 72.4
Chair 70.5
Fun 65.2
Stock photography 64.8
Entertainment 63.3
Photo caption 62.1
Music 62.1
Suit 57.6
Visual arts 56.1

Microsoft
created on 2022-01-08

text 98.8
person 96.3
clothing 94.8
man 89.5
outdoor 85.4
musical instrument 77.6
concert 68.6
footwear 62
people 60.4

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 99.3%
Sad 0.3%
Happy 0.2%
Confused 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 70.3%
Surprised 69.3%
Calm 23.2%
Angry 2.3%
Happy 2.2%
Disgusted 1.1%
Fear 1.1%
Sad 0.5%
Confused 0.3%

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Sad 96.2%
Confused 3%
Disgusted 0.3%
Fear 0.1%
Calm 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Female, 67.1%
Sad 69.1%
Calm 17.2%
Angry 5.1%
Happy 3.9%
Fear 2.1%
Disgusted 1.1%
Surprised 0.8%
Confused 0.5%

AWS Rekognition

Age 18-24
Gender Female, 84.5%
Sad 65.2%
Angry 12.7%
Calm 8%
Confused 3.7%
Surprised 3.5%
Fear 3%
Happy 2%
Disgusted 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 74.4%
Dog 62.3%
Chair 50.1%

Captions

Microsoft

a group of people standing in front of a building 88.7%
a group of people standing outside of a building 88%
a group of people standing in a room 87.9%

Text analysis

Amazon

WITS
20
WITS E
E
28202.
28202
YТ3-А

Google

(ט ה
(ט
ה