Human Generated Data

Title

Untitled (beauty pageant contestants in bathing suits standing in a row by a pool)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5014

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (beauty pageant contestants in bathing suits standing in a row by a pool)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.6
Person 99.3
Person 99.1
Clothing 99
Apparel 99
Person 98.9
Person 97.7
Person 97.3
Person 97
Person 95.5
Kid 94.5
Woman 94.5
Blonde 94.5
Girl 94.5
Teen 94.5
Child 94.5
Female 94.5
Shorts 90.8
Person 87.2
Person 78.2
Shoe 69.3
Footwear 69.3
People 63.4
Swimwear 62.5
Person 60
Dress 58.3

Imagga
created on 2022-01-22

people 29.6
man 24.3
silhouette 21.5
group 21
male 19.9
men 18.9
person 18.2
sport 18
bathing cap 17.9
adult 17.5
picket fence 15.8
fence 15.3
team 15.2
athlete 15.2
crowd 14.4
business 14
cap 13.8
outdoor 13
design 12.9
outdoors 12.7
runner 12.6
clothing 12.4
drawing 12
event 12
black 11.4
headdress 11.1
exercise 10.9
active 10.8
fashion 10.6
human 10.5
beach 10.3
outside 10.3
barrier 9.9
art 9.8
running 9.6
sky 9.6
standing 9.6
lifestyle 9.4
teamwork 9.3
action 9.3
sand 9.1
fitness 9
summer 9
activity 9
style 8.9
success 8.8
sexy 8.8
businessman 8.8
body 8.8
urban 8.7
couple 8.7
sea 8.6
row 8.4
city 8.3
figure 8.2
support 8.2
life 8
covering 8
graphic 8
women 7.9
together 7.9
day 7.8
portrait 7.8
unity 7.7
party 7.7
chain 7.7
grunge 7.7
winter 7.7
happy 7.5
friendship 7.5
fun 7.5
symbol 7.4
boy 7.3
copy space 7.2
product 7.2
paper 7.2
sketch 7.1
family 7.1
modern 7

Google
created on 2022-01-22

Smile 96.6
Swimwear 86.3
Style 83.8
Font 81.3
Thigh 81.2
Brassiere 77.7
Fashion design 76.9
Waist 76
Poster 75.8
Technology 75.8
Snapshot 74.3
Vintage clothing 71.8
Fashion model 71.3
Event 70.9
Advertising 70.4
Team 70.2
Photo caption 68.8
Stage equipment 67.9
Undergarment 65.3
Underpants 65.3

Microsoft
created on 2022-01-22

text 99.2
woman 92
posing 84
clothing 79
person 73.5
female 33.2

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 52.1%
Happy 56.9%
Sad 20.2%
Calm 12.5%
Disgusted 3.4%
Confused 2.4%
Angry 2.3%
Fear 1.3%
Surprised 1%

AWS Rekognition

Age 34-42
Gender Male, 95.6%
Confused 53.3%
Sad 18.8%
Happy 12.6%
Fear 5.2%
Angry 3.5%
Surprised 2.9%
Disgusted 2.8%
Calm 1%

AWS Rekognition

Age 29-39
Gender Female, 91.8%
Calm 36.4%
Sad 28%
Disgusted 20.1%
Happy 8.2%
Surprised 2.3%
Confused 2.1%
Angry 1.6%
Fear 1.4%

AWS Rekognition

Age 31-41
Gender Male, 57%
Happy 90.4%
Calm 3.9%
Sad 3.1%
Confused 0.7%
Fear 0.6%
Angry 0.6%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 33-41
Gender Female, 59.2%
Happy 96.7%
Calm 1.8%
Confused 0.5%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Female, 55.2%
Happy 80.5%
Calm 10.9%
Sad 3.6%
Confused 1.9%
Surprised 1.2%
Angry 0.9%
Disgusted 0.8%
Fear 0.3%

AWS Rekognition

Age 40-48
Gender Female, 93.1%
Calm 57%
Disgusted 37.3%
Angry 2%
Confused 1.1%
Sad 0.8%
Fear 0.7%
Happy 0.5%
Surprised 0.4%

AWS Rekognition

Age 29-39
Gender Female, 93.1%
Calm 99.1%
Disgusted 0.6%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Sad 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 93.1%
Calm 71.7%
Disgusted 21.6%
Fear 1.6%
Happy 1.6%
Angry 1.3%
Sad 1.1%
Confused 0.6%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Male, 88.8%
Sad 42.6%
Happy 12.8%
Confused 12.4%
Fear 11.7%
Calm 11.4%
Disgusted 3.7%
Angry 3.2%
Surprised 2.2%

AWS Rekognition

Age 10-18
Gender Male, 75.8%
Disgusted 43.6%
Happy 14%
Calm 13.4%
Confused 11.3%
Fear 5.5%
Sad 4.6%
Surprised 4.1%
Angry 3.5%

AWS Rekognition

Age 24-34
Gender Male, 81.5%
Disgusted 53.1%
Happy 20.6%
Calm 14.7%
Sad 3.4%
Surprised 2.6%
Fear 2.5%
Angry 1.6%
Confused 1.5%

AWS Rekognition

Age 18-24
Gender Male, 64.7%
Surprised 35.9%
Calm 34.6%
Happy 12.4%
Sad 5.3%
Angry 4.6%
Fear 3.3%
Disgusted 3%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 69.3%

Captions

Microsoft

a group of people posing for a photo 85.2%
a group of people posing for the camera 85.1%
a group of people posing for a picture 85%

Text analysis

Amazon

3FT
22598
ARK
ARK REAL
REAL
ER
Miss
JERRY
MIS
FR &
FR & LIC
MISS
LEIRE
LIC
ER :
ITGOMER
STAY
VAGOY
NATHAN'S
9
:

Google

AMBER ATHAN ARK REA TGOME FIRE 3FT 22598
ATHAN
REA
AMBER
ARK
22598
TGOME
FIRE
3FT