Human Generated Data

Title

Untitled (older couple seated in living room among others)
Date

1953
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8171
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (older couple seated in living room among others)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.1
Human 99.1
Person 98.9
Person 97.2
Person 96.9
Person 95.4
Person 94
Furniture 90.2
Table Lamp 84
Lamp 84
Indoors 82.3
Room 81.6
Table 64.9
Clinic 63.8
Living Room 62.2
Flower 59.7
Plant 59.7
Blossom 59.7
Portrait 59.2
Photography 59.2
Face 59.2
Photo 59.2
Clothing 56.9
Apparel 56.9
Interior Design 56.8
Chair 51.8

Imagga
created on 2022-01-08

person 47.2
professional 39.9
people 37.4
man 37
male 36.9
businessman 33.6
office 32.2
business 31.6
worker 28.9
adult 27.7
team 26
men 25.8
patient 25.5
group 24.2
corporate 24.1
work 22.8
happy 22.6
teamwork 22.3
businesswoman 21.8
meeting 21.7
teacher 21.5
businesspeople 20.9
medical 20.3
working 19.5
room 18.9
coat 18.1
desk 18
executive 17.9
job 17.7
indoors 17.6
table 17.3
computer 16.8
smiling 16.7
colleagues 16.5
doctor 16
nurse 15.9
hospital 15.2
lab coat 15.1
women 15
smile 15
together 14.9
talking 14.3
life 13.8
sitting 13.8
indoor 13.7
modern 13.3
couple 13.1
manager 13.1
mature 13
educator 12.9
home 12.8
confident 12.7
health 12.5
handsome 12.5
case 12.1
practitioner 12.1
clinic 12
casual 11.9
laptop 11.9
associates 11.8
communication 11.8
portrait 11.7
laboratory 11.6
diversity 11.5
medicine 11.5
brass 11.4
ethnic 11.4
sick person 11.4
success 11.3
study 11.2
successful 11
happiness 11
wind instrument 10.9
lifestyle 10.9
clothing 10.8
suit 10.8
care 10.7
partnership 10.6
senior 10.3
employee 10.2
musical instrument 10.2
two 10.2
student 10
uniform 10
coworkers 9.8
40s 9.7
lab 9.7
company 9.3
hand 9.1
board 9.1
cheerful 8.9
color 8.9
diverse 8.8
conference 8.8
cooperation 8.7
standing 8.7
education 8.7
test 8.7
profession 8.6
workplace 8.6
adults 8.5
finance 8.5
presentation 8.4
treatment 8.3
occupation 8.3
waiter 8.1
looking 8
classroom 8
scientist 7.8
hands 7.8
teaching 7.8
assistant 7.8
staff 7.7
mid adult 7.7
attractive 7.7
30s 7.7
research 7.6
biology 7.6
career 7.6
20s 7.3
face 7.1
day 7.1

Google
created on 2022-01-08

Photograph 94.2
Black-and-white 84.8
Style 83.8
Adaptation 79.4
Art 77.1
Monochrome 74.7
Snapshot 74.3
Font 74
Monochrome photography 73.5
Nurse 72.2
Chair 72
Event 71.9
T-shirt 70.6
Service 69.1
Room 66.7
Photo caption 65.7
Vintage clothing 65.3
Stock photography 64.3
Uniform 61.4
Photographic paper 61.2

Microsoft
created on 2022-01-08

text 98.5
person 94.5
table 63.9
clothing 59.8
black and white 56

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 82.1%
Sad 54.3%
Calm 41.6%
Happy 1.9%
Confused 1.4%
Angry 0.4%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Female, 97.4%
Calm 99.8%
Sad 0.1%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 97.8%
Happy 73.7%
Sad 10.6%
Calm 10.6%
Confused 2.6%
Angry 1%
Disgusted 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 51-59
Gender Male, 60.8%
Surprised 58.3%
Calm 29.1%
Sad 5%
Happy 2.7%
Fear 2.5%
Confused 1.2%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 38-46
Gender Female, 93.8%
Calm 51.3%
Happy 31.9%
Confused 6.3%
Sad 4%
Surprised 3.4%
Disgusted 1.6%
Angry 1.1%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 51.8%

Captions

Microsoft

a group of people posing for a photo 85.1%
a group of people posing for the camera 85%
a group of people posing for a picture 84.9%

Text analysis

Amazon

38677
٢8
YТ3-

Google

58 YT37A°2-XAGO
58
YT37A°2-XAGO