Human Generated Data

Title

Untitled (two formally dressed couples in front of fireplace)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5264

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two formally dressed couples in front of fireplace)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Chair 99.2
Furniture 99.2
Person 98.5
Human 98.5
Person 97.3
Accessories 96.8
Accessory 96.8
Tie 96.8
Apparel 92.5
Clothing 92.5
Person 91.8
Room 88.8
Indoors 88.8
Person 87.1
People 85.7
Linen 83.4
Home Decor 83.4
Suit 80.5
Coat 80.5
Overcoat 80.5
Plant 78.2
Flower 78.2
Blossom 78.2
Table 76.1
Face 74.6
Dining Table 74
Flower Arrangement 68.6
Photography 68.3
Photo 68.3
Living Room 66
Crowd 65.8
Portrait 64.7
Tie 61.6
Dining Room 60.9
Couch 60.5
Flower Bouquet 59.3
Dress 59.1
Chair 57

Imagga
created on 2022-01-22

man 36.3
person 33.7
male 32.6
people 30.7
business 26.1
adult 25.8
businessman 24.7
professional 23
team 19.7
nurse 19.6
businesspeople 19
table 18.3
happy 18.2
sitting 18
patient 17.8
room 17.7
colleagues 17.5
smiling 17.4
work 17.1
worker 17
men 16.3
office 16.1
meeting 16
medical 15.9
20s 15.6
businesswoman 15.4
coat 15.4
blackboard 15.2
working 14.1
day 14.1
indoors 14.1
mature 13.9
lab coat 13.9
teacher 13.7
40s 13.6
portrait 13.6
30s 13.5
women 13.4
group 12.9
corporate 12.9
home 12.8
casual 12.7
laboratory 12.5
job 12.4
doctor 12.2
senior 12.2
lifestyle 11.6
family 11.6
desk 11.5
cheerful 11.4
adults 11.4
color 11.1
teamwork 11.1
waiter 11.1
indoor 11
lab 10.7
chemistry 10.6
education 10.4
grandfather 10.4
case 10.1
smile 10
associates 9.8
discussing 9.8
looking 9.6
four 9.6
research 9.5
development 9.5
talking 9.5
wicker 9.3
instrument 9.3
clothing 9.3
clinic 9.2
hospital 9.1
mother 9.1
health 9
human 9
coworkers 8.8
computer 8.8
discussion 8.8
together 8.8
couple 8.7
standing 8.7
bright 8.6
biology 8.5
face 8.5
modern 8.4
classroom 8.3
sick person 8.3
suit 8.2
technology 8.2
dining-room attendant 8.1
drawing 8.1
child 8
microscope 7.9
scientist 7.8
happiness 7.8
25 30 years 7.8
casual clothing 7.8
employee 7.8
optical 7.8
scientific 7.7
old 7.7
elderly 7.7
twenties 7.6
father 7.6
student 7.5
study 7.5
manager 7.4
focus 7.4
camera 7.4
product 7.4
laptop 7.3
new 7.3
science 7.1
interior 7.1
medicine 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 96.4
table 95.1
indoor 92.8
furniture 92.1
chair 80
clothing 70.5
person 67.4
vase 65.9

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 99.2%
Calm 89.4%
Surprised 5.8%
Happy 3.1%
Disgusted 1%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 54-64
Gender Male, 99.7%
Calm 66.1%
Sad 24.4%
Happy 5.1%
Confused 1.5%
Disgusted 0.8%
Surprised 0.8%
Angry 0.8%
Fear 0.4%

AWS Rekognition

Age 30-40
Gender Male, 76.7%
Calm 84.5%
Happy 14.5%
Sad 0.5%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.2%
Person 98.5%
Tie 96.8%

Captions

Microsoft

an old photo of a man 79.3%
a man standing in a room 79.2%
a man standing next to a window 55.4%

Text analysis

Amazon

5393
2018
DELENDER 2018
DELENDER

Google

5393
5393