Human Generated Data

Title

Untitled (four men talking near table with coffee cups)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4706
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men talking near table with coffee cups)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.5
Person 99.5
Person 98.7
Person 97.5
Person 93.5
Coffee Cup 77.1
Cup 77.1
Suit 66.8
Coat 66.8
Apparel 66.8
Overcoat 66.8
Clothing 66.8
Priest 57
Scientist 56.7

Imagga
created on 2022-01-29

man 51.8
senior 39.4
male 39
people 35.7
indoors 33.4
person 33.1
executive 32.8
mature 31.6
lab coat 29.7
sitting 29.2
home 27.9
coat 27.1
elderly 26.8
smiling 26.8
office 26.5
adult 25.9
happy 25.1
men 24.9
couple 24.4
business 23.1
medical 23
doctor 22.6
together 21.9
businessman 21.2
bartender 20.2
team 19.7
worker 19.4
professional 19.3
hospital 18.8
grandma 18.8
older 18.5
patient 18.3
old 18.1
lifestyle 18.1
talking 18.1
work 18.1
60s 17.6
health 16.7
table 16.4
desk 16.1
looking 16
working 15.9
two people 15.6
colleagues 15.5
portrait 15.5
retired 15.5
laptop 15.5
retirement 15.4
meeting 15.1
job 15
room 14.7
casual 14.4
clinic 14.4
women 14.2
care 14
teamwork 13.9
camera 13.9
illness 13.3
nurse 13.3
businesspeople 13.3
enjoying 13.3
clothing 12.9
senior adult 12.8
businesswoman 12.7
middle aged 12.7
garment 12.4
cheerful 12.2
computer 12
waiter 11.9
occupation 11.9
day 11.8
horizontal 11.7
employee 11.7
drinking 11.5
husband 11.5
smile 11.4
inside 11
grandfather 11
drink 10.9
discussing 10.8
suit 10.8
40s 10.7
face 10.7
hand 10.6
30s 10.6
medicine 10.6
glasses 10.2
color 10
modern 9.8
sixties 9.8
casual clothing 9.8
surgery 9.8
group 9.7
mid adult 9.6
dining-room attendant 9.6
profession 9.6
wife 9.5
corporate 9.5
happiness 9.4
indoor 9.1
explaining 8.9
associates 8.9
70s 8.9
coworkers 8.8
discussion 8.8
thirties 8.8
busy 8.7
bright 8.6
specialist 8.5
one person 8.5
pensioner 8.4
alcohol 8.3
wine 8.3
human 8.2
20s 8.2
technology 8.2
aged 8.1
meal 8.1
look 7.9
gray hair 7.9
seniors 7.9
necktie 7.8
50s 7.8
consultant 7.8
concentration 7.7
leisure 7.5
bow tie 7.4
confident 7.3
handsome 7.1
kin 7.1
to 7.1

Google
created on 2022-01-29

Tableware 93.1
Coat 88.6
Chef 88.2
Cooking 82.3
Serveware 76.1
Eyewear 75.9
Science 74.9
Event 72.2
White-collar worker 71.2
Wine glass 70.1
Culinary art 69.1
Uniform 68.8
Job 67.9
Cook 67.5
Plate 67.3
T-shirt 65.6
Barware 65.4
Glass 65.1
Room 62.4
Indoor games and sports 62.3

Microsoft
created on 2022-01-29

person 99.8
wall 96.2
text 95
bottle 94.9
man 92.8
clothing 89.4
old 88.6
indoor 85.8
human face 78.4
standing 78.4
drink 76.1
black 65.4
water 63.2
black and white 62.4
posing 59.9
soft drink 58
tableware 51.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.6%
Calm 81.7%
Surprised 17.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%
Sad 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 48-56
Gender Male, 98.4%
Calm 99.8%
Surprised 0.1%
Sad 0%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 98.9%
Calm 99.9%
Surprised 0%
Fear 0%
Confused 0%
Sad 0%
Happy 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 66.8%

Captions

Microsoft

a group of people posing for a photo 92.8%
an old photo of a group of people posing for the camera 91.7%
an old photo of a man and woman posing for a picture 82.1%