Human Generated Data

Title

Untitled (beauty pageant contestants in swim suits lined up on diving board, Lido Beach, FL)
Date

1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5424
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (beauty pageant contestants in swim suits lined up on diving board, Lido Beach, FL)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 99.1
Person 98.9
Person 97.2
Person 97.1
Person 96.6
Person 96
Person 94.4
Person 94.2
Vehicle 92.5
Transportation 92.5
Person 91.8
Person 78.5
Interior Design 77.6
Indoors 77.6
People 76.2
Text 69.2
Face 68.1
Portrait 65.5
Photography 65.5
Photo 65.5
Boat 56.8
Person 56.3
Guitar 55.6
Musical Instrument 55.6
Leisure Activities 55.6
Person 43.2

Imagga
created on 2022-01-23

table 40.9
hall 36.7
interior 33.6
glass 31.6
room 29.7
furniture 29.1
chair 25.7
modern 24.5
restaurant 22.1
design 20.8
luxury 20.6
architecture 18.9
house 18.4
seat 18.2
dining 18.1
dinner 16.8
decor 16.8
medical 15.9
laboratory 15.4
research 15.2
floor 14.9
chemistry 14.5
biology 14.2
home 13.9
structure 13.8
party 13.8
empty 13.7
chairs 13.7
experiment 13.7
lab 13.6
chemical 13.6
setting 13.5
light 13.4
business 13.4
wood 13.3
medicine 13.2
indoors 13.2
elegance 12.6
drink 12.5
3d 12.4
decoration 12.3
urban 12.2
marble 12.1
wine 12
counter 12
equipment 11.9
glassware 11.8
building 11.7
comfortable 11.5
plant 11.2
window 11.1
technology 11.1
inside 11
food 11
science 10.7
deck 10.6
meal 10.6
scene 10.4
contemporary 10.3
sketch 10.3
lunch 10.3
elegant 10.3
event 10.2
development 10
city 10
biotechnology 9.8
reception 9.8
napkin 9.8
drawing 9.7
style 9.6
residential 9.6
hotel 9.5
solution 9.5
service 9.3
office 9
work 8.9
sterile 8.9
beaker 8.9
banquet 8.8
sculpture 8.8
wall 8.7
water 8.7
life 8.6
construction 8.6
place 8.4
bar 8.3
wedding 8.3
indoor 8.2
cafeteria 8.1
lifestyle 8
art 7.9
sterilize 7.9
tables 7.9
h2o 7.9
silverware 7.8
catering 7.8
liquid 7.8
cutlery 7.8
fluid 7.8
nobody 7.8
measure 7.7
apartment 7.7
health 7.6
set 7.6
lamp 7.6
aqua 7.6
relaxation 7.5
reflection 7.4
celebration 7.2
dining table 7.1
day 7.1

Google
created on 2022-01-23

Naval architecture 88.9
Black-and-white 83.3
Snapshot 74.3
Font 73.6
Monochrome 67.7
Monochrome photography 67.6
Watercraft 64.7
Illustration 64.2
Crew 63
Advertising 62.7
Stock photography 62.6
Art 61.1
Room 60.6
Vintage clothing 60.5
Suit 60.5
Machine 58.7
Ship 58.7
Recreation 56.1
History 54.5

Microsoft
created on 2022-01-23

text 99.5
white 74
black 70.7
music 65.7
old 56.5
posing 39.4

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 98%
Confused 56.1%
Calm 27.7%
Sad 6.8%
Disgusted 3.4%
Happy 2.8%
Surprised 1.5%
Angry 1.1%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 94.2%
Calm 56.9%
Sad 13.6%
Confused 13%
Disgusted 4.6%
Angry 3.9%
Happy 3.3%
Fear 3.1%
Surprised 1.5%

AWS Rekognition

Age 40-48
Gender Female, 63.2%
Happy 71.1%
Sad 8.3%
Calm 6.6%
Disgusted 4.5%
Confused 3.7%
Fear 2.8%
Angry 1.6%
Surprised 1.5%

AWS Rekognition

Age 31-41
Gender Male, 98.6%
Sad 46.1%
Calm 40.3%
Confused 5.5%
Angry 2.8%
Disgusted 2.1%
Happy 1.1%
Fear 1%
Surprised 1%

AWS Rekognition

Age 19-27
Gender Male, 95.5%
Happy 86.1%
Calm 11.1%
Confused 0.8%
Surprised 0.6%
Sad 0.6%
Disgusted 0.3%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 37-45
Gender Male, 56.4%
Calm 93.5%
Happy 1.7%
Sad 1.5%
Disgusted 1.3%
Confused 0.7%
Angry 0.6%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 28-38
Gender Male, 78%
Confused 35.3%
Happy 27.5%
Calm 22.4%
Sad 12.5%
Fear 0.7%
Surprised 0.6%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Calm 54%
Disgusted 11.8%
Confused 10.5%
Happy 5.9%
Surprised 5.8%
Fear 5.6%
Angry 4.3%
Sad 2.1%

AWS Rekognition

Age 25-35
Gender Male, 77.7%
Sad 52.9%
Calm 25.9%
Confused 14.6%
Surprised 2%
Angry 1.4%
Fear 1.2%
Disgusted 1%
Happy 0.9%

AWS Rekognition

Age 31-41
Gender Male, 85.9%
Calm 65.5%
Happy 12.4%
Disgusted 11%
Sad 3.6%
Confused 3.3%
Surprised 1.8%
Angry 1.8%
Fear 0.5%

AWS Rekognition

Age 31-41
Gender Male, 91%
Happy 68.7%
Calm 8.6%
Angry 5.6%
Confused 5.2%
Disgusted 4.7%
Sad 4.5%
Fear 1.7%
Surprised 1%

AWS Rekognition

Age 33-41
Gender Male, 62.9%
Calm 81%
Sad 5.7%
Disgusted 5.4%
Fear 3%
Happy 1.9%
Confused 1%
Surprised 1%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Guitar 55.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 72.2%
a vintage photo of a group of people posing for a picture 72.1%
a group of people posing for a photo 72%

Text analysis

Amazon

BOARDS
NO
UMPING
DON'T-
SPORTSMAN
SWMMNFRONTOF BOARDS
BOT
SWMMNFRONTOF
YТЗЧААС

Google

... DON' T- SWYINTRONTOF BOARDS NO UMPING
...
DON'
T-
SWYINTRONTOF
BOARDS
NO
UMPING