Human Generated Data

Title

Untitled (four men seated at a desk with hats)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8276
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men seated at a desk with hats)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Person 99.2
Person 98
Person 96.9
Building 96.1
Factory 91.9
Workshop 67.7
Furniture 62.9
Helmet 61
Clothing 61
Apparel 61
Assembly Line 59.8
Table 58.8

Imagga
created on 2022-01-08

kitchen 31.6
home 30.3
hospital 29.5
interior 26.5
nurse 25.6
people 24.5
man 23.7
shop 23.4
room 21.1
person 20.1
lifestyle 19.5
house 18.4
table 17
family 16.9
male 16.3
modern 16.1
cooking 15.7
bakery 15.3
decoration 15.2
happy 15
mercantile establishment 14.5
women 14.2
adult 13.8
indoor 13.7
food 13.4
indoors 13.2
happiness 12.5
mother 12.4
furniture 12.3
counter 12.2
new 12.1
men 12
luxury 12
smile 11.4
senior 11.2
stove 11.1
portrait 11
smiling 10.8
holiday 10.7
child 10.6
work 10.4
classroom 10
preparing 9.8
cheerful 9.7
decor 9.7
place of business 9.6
cabinet 9.3
mature 9.3
cook 9.1
holding 9.1
color 8.9
to 8.8
medical 8.8
couple 8.7
business 8.5
old 8.4
health 8.3
life 8.3
inside 8.3
fun 8.2
equipment 8.2
group 8
oven 8
job 8
together 7.9
design 7.9
boy 7.8
education 7.8
luxurious 7.8
glass 7.8
gift 7.7
percussion instrument 7.7
expensive 7.6
husband 7.6
estate 7.6
tea 7.5
domestic 7.5
traditional 7.5
meal 7.3
clinic 7.3
clothing 7.2
professional 7.2
team 7.2
desk 7.1
love 7.1
kid 7.1
working 7.1
wooden 7

Google
created on 2022-01-08

Cabinetry 83.2
Cooking 79
Table 77.4
Snapshot 74.3
Room 73
Cookware and bakeware 72.6
Monochrome 72.6
Monochrome photography 70.7
Service 67.5
Kitchen 63.3
Machine 61.1
History 58.1
Tableware 56.2
Motor vehicle 54.5
Meal 53.5
Sitting 53.3
Photography 52.2
Uniform 50.5

Microsoft
created on 2022-01-08

text 96.2
person 92.1
indoor 92
table 90.6
clothing 73.5
black and white 62.3
furniture 60.1
man 50.6
old 47.4
cooking 29.6
shop 10.2

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Female, 55.1%
Calm 93.1%
Sad 3.4%
Surprised 1.9%
Confused 0.7%
Disgusted 0.4%
Angry 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 84.7%
Happy 8.8%
Sad 3.3%
Confused 1.2%
Surprised 1%
Angry 0.5%
Disgusted 0.5%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.3%
Calm 67.8%
Happy 10.5%
Surprised 10.2%
Sad 5.6%
Disgusted 2.6%
Angry 2%
Confused 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 61%

Captions

Microsoft

a vintage photo of a group of people in a kitchen 83.8%
a group of people performing on a counter 81.7%
a vintage photo of some people in a kitchen 81.6%

Text analysis

Amazon

9325.
EM
9325
YT3RA2
EM YT3RA2 ARDA
ARDA

Google

25. 9325. 9325.
25.
9325.