Human Generated Data

Title

Untitled (beauty pageant contestants in bathing suits standing in a row by a pool)
Date

1947
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5015
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (beauty pageant contestants in bathing suits standing in a row by a pool)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.6
Person 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99.4
Person 99.3
Clothing 98.1
Apparel 98.1
Person 97.9
Shorts 96.7
Person 94.2
Stage 87.6
Shoe 86.3
Footwear 86.3
Female 85.4
Dance Pose 84.5
Leisure Activities 84.5
Shoe 76.3
Crowd 75.1
People 74.8
Shoe 73.4
Girl 63.3
Woman 63.2
Suit 62.4
Coat 62.4
Overcoat 62.4

Imagga
created on 2022-01-22

crowd 23
business 20
baron 18.9
people 17.8
group 17.7
art 15.7
symbol 15.5
silhouette 14.9
flag 14.9
design 14.6
person 14.6
male 12.8
team 12.5
man 12.4
gymnasium 12.4
nation 12.3
men 12
patriotic 11.5
businessman 11.5
women 11.1
graphic 10.9
sign 10.5
blackboard 10.4
scene 10.4
businesswoman 10
athletic facility 9.9
stage 9.7
party 9.5
dance 9.2
national 9.1
black 9
waving 8.8
world 8.7
render 8.6
motion 8.6
facility 8.3
event 8.3
building 8
night 8
marimba 7.9
audience 7.8
3d 7.7
ripple 7.6
musical instrument 7.5
commerce 7.5
presentation 7.4
technology 7.4
teamwork 7.4
percussion instrument 7.4
success 7.2
equipment 7.2
icon 7.1
job 7.1
work 7.1
country 7

Google
created on 2022-01-22

Black 89.6
Dress 88
Gesture 85.3
Black-and-white 85.2
Style 84
Font 82.9
Monochrome photography 76.5
Beauty 75.4
Monochrome 74.3
Event 73.5
Rectangle 71.8
Photo caption 65.7
Crew 64.8
Uniform 63.9
Entertainment 63.5
Room 62.7
Art 62.5
Stock photography 61.9
Team 61.1
Advertising 59.2

Microsoft
created on 2022-01-22

text 99.7
clothing 91
black 89.6
man 86.1
white 86
person 85
black and white 84.7
posing 79.4
player 78.8
footwear 77.6
standing 76.4
dance 62.9
old 61.5
group 58.1
team 35.2
line 22.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 68.1%
Calm 75.6%
Disgusted 8.4%
Happy 7.2%
Fear 3.6%
Surprised 1.7%
Angry 1.3%
Confused 1.2%
Sad 0.9%

AWS Rekognition

Age 42-50
Gender Male, 94.7%
Calm 98.7%
Happy 1%
Surprised 0.1%
Disgusted 0.1%
Sad 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 94.5%
Calm 91.1%
Sad 6.1%
Happy 2.1%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 76.8%
Calm 93.5%
Sad 4.5%
Angry 0.8%
Confused 0.4%
Happy 0.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Female, 86.3%
Happy 96.4%
Surprised 1.4%
Calm 1.2%
Confused 0.4%
Fear 0.2%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 35-43
Gender Female, 97.3%
Happy 53.8%
Surprised 20%
Confused 9.6%
Fear 9.1%
Calm 2.3%
Disgusted 2%
Angry 1.7%
Sad 1.6%

AWS Rekognition

Age 26-36
Gender Male, 99.4%
Calm 78.6%
Disgusted 5%
Sad 4.7%
Surprised 3.5%
Confused 3%
Happy 3%
Fear 1.2%
Angry 0.9%

AWS Rekognition

Age 22-30
Gender Female, 56.3%
Happy 53.2%
Calm 20.4%
Sad 12.5%
Angry 3.7%
Fear 3.4%
Confused 2.9%
Disgusted 1.9%
Surprised 1.9%

AWS Rekognition

Age 23-31
Gender Female, 57.9%
Fear 55.8%
Happy 14.3%
Surprised 9.8%
Calm 9.1%
Sad 4.6%
Angry 3.3%
Disgusted 2%
Confused 1%

AWS Rekognition

Age 48-56
Gender Female, 96.6%
Calm 30.8%
Happy 29.8%
Sad 18.5%
Confused 10%
Surprised 4.4%
Angry 2.3%
Fear 2.3%
Disgusted 1.9%

AWS Rekognition

Age 36-44
Gender Female, 55.9%
Calm 60.8%
Fear 16.9%
Surprised 13.4%
Happy 4%
Sad 2.3%
Confused 1%
Angry 0.8%
Disgusted 0.8%

AWS Rekognition

Age 37-45
Gender Male, 98.9%
Calm 50.7%
Surprised 33.6%
Happy 10.7%
Sad 1.9%
Angry 1%
Disgusted 0.8%
Confused 0.8%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Male, 92.2%
Calm 79%
Sad 5.2%
Disgusted 4.9%
Surprised 4.4%
Happy 1.9%
Angry 1.8%
Fear 1.5%
Confused 1.3%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Happy 38.6%
Sad 25.2%
Calm 19.9%
Angry 6.7%
Fear 3.5%
Confused 2.3%
Surprised 2.3%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 86.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.6%
a vintage photo of a group of people posing for a picture 91.5%
a group of people posing for a photo 91.4%

Text analysis

Amazon

22599
REAL
POWER
MER
RK
C.PEN
ELIA
RK REAL EST
&
WILLIAMS
COMM
of
EST
RUNNING
JERRY
Miss
A
MBER of COMM
MER B
UTI
MBER
ELIA T. LEV
OR
B
PUSSING
T. LEV
POWER & LIGE
ROBB
THAN'S
FIRESTO
KTGOMERY- ROBB
MASS
ХАСС
CULLIN
66922
LIGE
KTGOMERY-
MISS
300
STORE

Google

BERF COMM HAN'S GOMERY POB RK REAL EST POWER & LG MER B ELIA T. LEV INC 22599
BERF
COMM
HAN'S
GOMERY
POB
RK
REAL
EST
POWER
&
LG
MER
B
ELIA
T.
LEV
INC
22599