Human Generated Data

Title

Untitled (four men around microphone)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4423
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men around microphone)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.6
Apparel 99.6
Coat 98.6
Overcoat 98.6
Person 98.3
Human 98.3
Person 97.2
Person 96.7
Suit 94
Suit 92.8
Person 92.7
Face 92.1
Suit 86.9
Tuxedo 84.9
Suit 77.1
Crowd 73.6
People 71.2
Head 70.7
Blazer 70.3
Jacket 70.3
Shirt 67.1
Man 63.8
Tie 62.5
Accessories 62.5
Accessory 62.5
Smile 57.7

Imagga
created on 2022-01-23

lab coat 59
coat 56.6
man 54.4
male 48.2
doctor 44.2
person 42.2
professional 37.5
medical 36.2
adult 34.8
people 32.9
portrait 31.7
specialist 30.3
senior 30
stethoscope 27.4
medicine 27.3
hospital 27.3
looking 27.2
mature 27
men 25.8
occupation 25.7
elderly 24.9
smiling 24.6
health 24.3
handsome 24.1
businessman 23.8
care 23
happy 22.6
uniform 22.2
job 22.1
garment 21.3
business 19.4
nurse 19.4
smile 18.5
clinic 18.2
baron 18.2
old 18.1
clothing 17.5
profession 17.2
surgeon 16.6
work 16.5
human 15.7
face 15.6
office 15.3
patient 14.8
confident 14.6
laboratory 14.5
expertise 13.6
standing 13
cheerful 13
success 12.9
friendly 12.8
lab 12.6
team 12.5
tie 12.3
suit 12.1
successful 11.9
happiness 11.8
older 11.7
retired 11.6
staff 11.5
hand 11.4
shirt 11.3
attractive 11.2
executive 11.1
glasses 11.1
expression 11.1
grandfather 11
lifestyle 10.8
doctors 10.8
physician 10.7
worker 10.7
working 10.6
couple 10.5
practitioner 10.4
corporate 10.3
teamwork 10.2
student 9.9
look 9.6
30s 9.6
exam 9.6
illness 9.5
hair 9.5
sitting 9.4
casual 9.3
two 9.3
modern 9.1
holding 9.1
one 9
color 8.9
clinical 8.8
home 8.8
colleagues 8.7
health care 8.7
women 8.7
retirement 8.6
confidence 8.6
serious 8.6
bright 8.6
mask 8.3
positive 8.3
technology 8.2
aged 8.1
gray 8.1
computer 8
indoors 7.9
examining 7.8
diagnosis 7.8
consultant 7.8
assistant 7.8
test 7.7
laptop 7.3
pensioner 7.1
family 7.1
together 7

Google
created on 2022-01-23

Coat 87.3
Sleeve 86.5
Gesture 85.3
Collar 82.6
Happy 82
Black-and-white 81.9
Smile 79.6
Font 75.9
Formal wear 74.7
Event 72.4
Monochrome photography 71.9
White-collar worker 71.1
Monochrome 69.2
Vintage clothing 63.3
Team 63.3
Stock photography 62.9
Uniform 61.6
Art 61
History 55.5
Suit 53.7

Microsoft
created on 2022-01-23

wall 98.2
person 97.8
text 97.4
posing 97.3
man 97
human face 96.1
standing 92
clothing 91.7
black and white 82.8
smile 68.7
black 68
white 67.5
old 44.4
suit 34.4

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 70.1%
Disgusted 58.6%
Confused 18.8%
Calm 7.1%
Surprised 4.5%
Sad 4.1%
Angry 3.4%
Happy 2.1%
Fear 1.4%

AWS Rekognition

Age 21-29
Gender Female, 67.3%
Happy 52.6%
Surprised 23.8%
Fear 8.9%
Calm 4.3%
Angry 3%
Disgusted 2.9%
Sad 2.6%
Confused 1.9%

AWS Rekognition

Age 25-35
Gender Male, 97.5%
Happy 88.6%
Fear 2.4%
Calm 2.3%
Disgusted 1.8%
Sad 1.7%
Surprised 1.4%
Angry 1.1%
Confused 0.7%

AWS Rekognition

Age 38-46
Gender Female, 66%
Fear 22.6%
Disgusted 20.6%
Calm 19.2%
Surprised 15.7%
Happy 11.4%
Sad 5.3%
Confused 2.9%
Angry 2.3%

AWS Rekognition

Age 35-43
Gender Female, 81.6%
Confused 34.9%
Calm 21.8%
Sad 15.1%
Happy 8.1%
Fear 6.4%
Surprised 5.4%
Disgusted 4.3%
Angry 3.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Suit 94%

Captions

Microsoft

a group of people posing for the camera 95.9%
a group of people posing for a photo 94.6%
a group of men posing for a photo 94.5%

Text analysis

Amazon

17283.
19283
ROUVA
JPC

Google

17283. 17283. -A A PA
17283.
-A
A
PA