Human Generated Data

Title

Untitled (couple at restaurant table near a clock on a mantle)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4578

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple at restaurant table near a clock on a mantle)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.3
Apparel 98.2
Clothing 98.2
Person 97
Person 78.3
Hat 67
Furniture 65.6
Plant 65.2
Room 62.5
Indoors 62.5
Sitting 61.3
Home Decor 60.3
Blossom 59.4
Flower 59.4
Couch 58.6
Face 58.3
Sun Hat 55.7
Bonnet 55.5

Imagga
created on 2021-12-14

man 50.4
lab coat 41.4
person 40.3
coat 39.6
male 39
people 32.9
patient 32.6
office 30.8
professional 30.5
sitting 29.2
adult 27.4
businessman 27.4
business 27.3
work 25.9
smiling 24.6
senior 24.4
working 23.9
indoors 23.7
worker 22.6
doctor 22.6
men 21.5
teamwork 21.3
medical 21.2
specialist 20.9
meeting 20.7
talking 20
team 19.7
happy 19.4
garment 19.2
computer 19.2
group 18.5
occupation 18.3
couple 18.3
laptop 18.2
table 18.2
businesspeople 18
together 17.5
businesswoman 17.3
room 17.2
executive 16.9
colleagues 16.5
desk 16.1
portrait 15.5
nurse 15.4
job 15
women 15
case 14.4
sick person 14.1
hospital 13.9
corporate 13.8
looking 13.6
suit 13.5
lifestyle 13
smile 12.8
student 12.7
technology 12.6
elderly 12.5
clothing 12.4
cheerful 12.2
mature 12.1
home 12
old 11.8
health 11.8
necktie 11.8
clinic 11.8
happiness 11.8
two people 11.7
lab 11.7
bartender 11.6
laboratory 11.6
holding 11.6
medicine 11.5
education 11.3
modern 11.2
two 11
conference 10.8
mid adult 10.6
salon 10.6
illness 10.5
presentation 10.2
casual 10.2
waiter 9.9
bow tie 9.9
teacher 9.9
coworkers 9.8
scientist 9.8
expertise 9.7
restaurant 9.7
test 9.6
color 9.5
manager 9.3
communication 9.2
face 9.2
indoor 9.1
care 9.1
associates 8.9
to 8.9
30s 8.7
research 8.6
20s 8.3
successful 8.2
confident 8.2
science 8
chemical 7.8
chemistry 7.7
serious 7.6
biology 7.6
horizontal 7.5
one person 7.5
human 7.5
treatment 7.4
employee 7.3
board 7.2
bright 7.2
interior 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.7
person 96.5
indoor 96.3
man 94.6
clothing 77
fireplace 65.5
house 58.4

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Male, 55.1%
Calm 99.4%
Happy 0.3%
Surprised 0.1%
Sad 0.1%
Angry 0%
Fear 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 22-34
Gender Female, 69.4%
Happy 50.5%
Calm 45.9%
Sad 2.3%
Surprised 0.6%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 98.4%
Calm 53.2%
Sad 33.4%
Angry 5.4%
Confused 3.8%
Surprised 2.4%
Disgusted 0.7%
Fear 0.6%
Happy 0.4%

AWS Rekognition

Age 30-46
Gender Female, 91.9%
Calm 90.8%
Happy 3.2%
Sad 2.3%
Angry 2.2%
Confused 0.8%
Surprised 0.5%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a man sitting at a table in front of a window 91.3%
a man sitting at a table 91.2%
a man sitting on a table 91.1%

Text analysis

Amazon

119337
119337.
of
sa
ة
119337 ASKODA
you of 19 ة
LEEGII
19
you
ASKODA

Google

119337
YAGON-YT37A2-MAMTZA
LEEI
119337.
119337. 119337 YAGON-YT37A2-MAMTZA LEEI