Human Generated Data

Title

Untitled (woman standing at a table piled with hinges)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4908
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman standing at a table piled with hinges)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Person 99.7
Person 99.2
Apparel 93.7
Clothing 93.7
Shorts 63.7
Photography 62.8
Photo 62.8
Worker 60.3
Scientist 56.3

Imagga
created on 2022-01-23

man 48.4
person 45.3
male 38.3
adult 32.6
people 32.3
professional 30.4
work 28.6
worker 26.4
portrait 22.6
happy 22.6
smiling 22.4
working 21.2
businessman 21.2
laptop 21.1
looking 20.8
office 20.6
job 20.3
indoors 20.2
business 19.4
sitting 18.9
seller 18.4
uniform 18.2
senior 17.8
home 17.5
occupation 17.4
nurse 17.1
computer 16.9
farmer 16.6
men 16.3
doctor 16
desk 14.5
casual 14.4
team 14.3
medical 14.1
coat 13.7
table 13.2
meeting 13.2
mature 13
teamwork 13
camera 12.9
smile 12.8
technology 12.6
elderly 12.4
profession 12.4
businesspeople 12.3
scholar 12.3
corporate 12
successful 11.9
student 11.9
room 11.7
lifestyle 11.6
holding 11.6
engineer 11.4
medicine 11.4
hospital 11.4
education 11.3
health 11.1
clinic 11
pharmacist 10.9
suit 10.8
colleagues 10.7
face 10.6
color 10.6
building 10.5
serious 10.5
success 10.5
day 10.2
20s 10.1
bright 10
businesswoman 10
hand 9.9
clothing 9.8
handsome 9.8
intellectual 9.8
attractive 9.8
lab 9.7
executive 9.7
concentration 9.7
together 9.6
30s 9.6
happiness 9.4
industry 9.4
horizontal 9.2
indoor 9.1
builder 9.1
old 9.1
care 9
blackboard 9
group 8.9
interior 8.8
architect 8.7
mid adult 8.7
laboratory 8.7
project 8.7
staff 8.6
plan 8.5
modern 8.4
manager 8.4
house 8.4
science 8
teacher 8
lab coat 8
look 7.9
classroom 7.8
standing 7.8
40s 7.8
busy 7.7
helmet 7.7
talking 7.6
one person 7.5
human 7.5
one 7.5
newspaper 7.4
confident 7.3
copy space 7.2
black 7.2
health professional 7.2
school 7.2
women 7.1

Google
created on 2022-01-23

Photograph 94.2
White 92.2
Black 89.7
Sleeve 87.2
Black-and-white 86.5
Hat 85.2
Style 84
Cooking 82.1
Chef 79.8
Monochrome photography 77.7
T-shirt 77.6
Monochrome 77.5
Kitchen 76.7
Apron 76.5
Rectangle 74.3
Snapshot 74.3
Font 73.6
Cook 72
Room 66.3
Service 64

Microsoft
created on 2022-01-23

text 98.4
person 95.7
man 95
clothing 81.9
food 78.5
black and white 70.9
dish 46.4
table 28

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 96.1%
Calm 99.6%
Sad 0.3%
Surprised 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 51.6%
Calm 51.9%
Happy 37%
Fear 3.9%
Angry 2.2%
Surprised 1.7%
Sad 1.7%
Disgusted 1%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man standing in front of a table 76.7%
a man standing in a kitchen 73.4%
a man that is standing in the kitchen 70.8%

Text analysis

Amazon

19837A
19837A.
..
aa

Google

1983 7A 19837A.
7A
1983
19837A.