Human Generated Data

Title

Untitled (group of people playing backgammon on deck near the beach)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5094
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of people playing backgammon on deck near the beach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Person 98.4
Person 98.3
Person 97.7
Person 97.6
Person 97.5
Chair 94.5
Furniture 94.5
Person 92.2
Clinic 89.6
Piano 87
Musical Instrument 87
Leisure Activities 87
Clothing 85.2
Apparel 85.2
People 75.7
Photography 59.5
Photo 59.5
Operating Theatre 57.9
Hospital 57.9
Person 54.4

Imagga
created on 2022-01-22

negative 51.1
film 40.8
newspaper 31
photographic paper 30.8
people 27.9
product 26
man 24.2
person 24.2
male 23.4
work 21.2
businessman 21.2
creation 21.1
photographic equipment 20.5
business 20
adult 19.8
professional 19.3
team 17
medical 16.8
portrait 15.5
worker 15.3
job 15
human 15
laboratory 14.5
medicine 14.1
lab 13.6
doctor 13.2
group 12.9
science 12.4
businesspeople 12.3
office 12
corporate 12
clothing 11.9
health 11.8
coat 11.7
working 11.5
research 11.4
biology 11.4
attractive 11.2
men 11.2
teamwork 11.1
bride 11.1
day 11
businesswoman 10.9
black 10.8
colleagues 10.7
scientific 10.7
happy 10.6
formal 10.5
looking 10.4
technology 10.4
manager 10.2
chemical 10.2
clinic 9.9
dress 9.9
handsome 9.8
scientist 9.8
chemistry 9.7
test 9.6
face 9.2
20s 9.2
student 9.1
lady 8.9
new 8.9
assistant 8.7
building 8.7
couple 8.7
education 8.7
hospital 8.6
development 8.6
wedding 8.3
occupation 8.2
care 8.2
suit 8.2
computer 8
love 7.9
microscope 7.9
chemist 7.9
smile 7.8
desk 7.8
nurse 7.8
modern 7.7
career 7.6
instrument 7.5
equipment 7.5
room 7.5
light 7.3
indoor 7.3
art 7.3
pose 7.2
celebration 7.2
bright 7.1

Google
created on 2022-01-22

Outerwear 95.2
Coat 87.2
Style 83.8
Black-and-white 83.4
Art 76.5
Monochrome 72.9
Suit 72.4
Monochrome photography 72.3
Font 70.8
Vintage clothing 69.9
Room 66.7
Machine 65.7
Event 65.3
Stock photography 64.8
Sitting 64
T-shirt 61.3
Office equipment 61.1
History 60.4
Visual arts 57.9
Photographic paper 55.3

Microsoft
created on 2022-01-22

text 97.8
person 94.2
clothing 93.1
wedding dress 78.3
man 74
woman 63.2
dress 62.4
bride 58.9
posing 45.4

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 67.2%
Happy 61.2%
Calm 16.6%
Confused 10.8%
Sad 3.5%
Fear 2.9%
Surprised 1.8%
Disgusted 1.7%
Angry 1.4%

AWS Rekognition

Age 27-37
Gender Female, 98.8%
Happy 68.5%
Calm 29.8%
Sad 0.7%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 67.7%
Sad 70.2%
Calm 18.1%
Confused 4.3%
Happy 3.3%
Surprised 1.9%
Fear 0.9%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 50-58
Gender Male, 85.5%
Calm 93.9%
Sad 4.3%
Happy 0.7%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 97.8%
Calm 99.6%
Sad 0.3%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 94.5%
Piano 87%

Captions

Microsoft

a group of people posing for a photo 87.8%
a group of people posing for the camera 87.7%
a group of people posing for a picture 87.6%

Text analysis

Amazon

23747
YTORAS
YTORAS RACON
RACON

Google

23747
23747