Human Generated Data

Title

Untitled (four men in suits talking, drinking and smoking)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4695
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men in suits talking, drinking and smoking)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4695

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.3
Human 99.3
Person 98.4
Person 97.9
Person 94.5
Clothing 84.9
Apparel 84.9
Clinic 81.6
Coat 73.5
Scientist 73.2
Doctor 62.5
People 61.5
Face 60.5
Lab 56.6
Tie 56.1
Accessories 56.1
Accessory 56.1
Lab Coat 55.2

Clarifai
created on 2023-10-27

people 99.5
man 99.2
adult 98.7
scientist 97.7
group 97.3
science 93.1
coat 92.5
doctor 91.7
uniform 91.5
medicine 89
group together 87.9
three 87
elderly 86.9
medical practitioner 84.5
physics 83.9
healthcare 83.7
hospital 81.7
test 81.1
indoors 78.7
portrait 78.6

Imagga
created on 2022-01-29

doctor 58.3
lab coat 58.2
coat 54.8
man 49.8
medical 48.6
person 48.4
professional 43.5
hospital 41.7
clinic 39.6
medicine 37
male 36.9
health 36.9
patient 36.8
people 35.7
job 31.9
office 30.6
care 29.7
occupation 29.4
adult 28.5
happy 27.6
work 26.7
working 26.5
nurse 26
team 26
business 25.5
businessman 24.7
mature 24.2
stethoscope 24
smiling 23.9
specialist 23.2
looking 21.6
teamwork 21.3
laboratory 21.2
worker 20.1
surgeon 19.8
practitioner 19.2
elderly 19.2
uniform 19
men 18.9
portrait 18.8
senior 18.8
indoors 18.5
garment 18.3
smile 17.8
clinical 17.6
colleagues 17.5
businesspeople 17.1
doctors 16.7
bright 16.5
corporate 16.3
desk 16.1
clothing 15.6
indoor 15.5
confident 15.5
profession 15.3
computer 15.2
sick person 15.2
handsome 15.2
case 15
treatment 14.7
successful 14.7
physician 14.7
busy 14.5
lifestyle 14.5
technology 14.1
associates 13.8
group 13.7
secretary 13.7
laptop 13.7
businesswoman 13.6
casual 13.6
illness 13.4
table 13
face 12.8
surgery 12.7
40s 12.7
day 12.6
mid adult 12.6
30s 12.5
color 12.2
human 12
executive 11.6
science 11.6
holding 11.6
test 11.6
research 11.4
talking 11.4
look 11.4
meeting 11.3
sitting 11.2
camera 11.1
golfer 10.9
student 10.9
general practitioner 10.9
entrepreneur 10.8
coworkers 10.8
suit 10.8
lab 10.7
expertise 10.7
practice 10.7
exam 10.5
attractive 10.5
workplace 10.5
success 10.5
women 10.3
glasses 10.2
modern 9.8
examining 9.8
old 9.8
consultant 9.8
assistant 9.7
education 9.5
healing 9.4
happiness 9.4
two 9.3
chemical 9.2
lady 8.9
chemist 8.9
30 35 years 8.8
heal 8.8
scientist 8.8
diagnosis 8.8
businessmen 8.8
examination 8.8
couple 8.7
light 8.7
instrument 8.7
staff 8.6
player 8.5
horizontal 8.4
20s 8.3
room 8.2
good mood 7.8
medic 7.8
visit 7.8
health care 7.8
scientific 7.8
chemistry 7.7
corporation 7.7
partnership 7.7
biology 7.6
life 7.6
equipment 7.4
home 7.2
together 7

Google
created on 2022-01-29

Shirt 93.9
Sleeve 87.1
Gesture 85.3
Black-and-white 82.3
Eyewear 79
Monochrome photography 70.5
Service 69.3
Monochrome 69.1
Science 67.6
Uniform 65.5
Stock photography 62.6
T-shirt 59
Player 58.6
Hat 58
Laboratory equipment 57.3
Research 56
Room 55.4
Font 54.9
Personal protective equipment 54.2
Job 52.6

Microsoft
created on 2022-01-29

person 96.3
text 95.8
clothing 92.6
man 90.5
human face 85.3
black and white 77.6
old 74.1
smile 63.1
drawing 54.9
glasses 53.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Sad 33.7%
Calm 31.5%
Angry 17%
Confused 9.2%
Disgusted 3%
Happy 2.4%
Surprised 1.9%
Fear 1.2%

AWS Rekognition

Age 50-58
Gender Male, 75.1%
Happy 39.3%
Calm 29%
Angry 12.1%
Surprised 6%
Sad 5.4%
Confused 3.7%
Disgusted 2.4%
Fear 2.1%

AWS Rekognition

Age 52-60
Gender Male, 97.1%
Calm 73%
Confused 17.7%
Surprised 5.3%
Sad 1.8%
Angry 0.9%
Disgusted 0.8%
Happy 0.4%
Fear 0.2%

AWS Rekognition

Age 54-62
Gender Male, 100%
Sad 47.9%
Confused 41.8%
Calm 6.4%
Surprised 0.9%
Happy 0.9%
Fear 0.8%
Disgusted 0.7%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.3%
Person 98.4%
Person 97.9%
Person 94.5%
Tie 56.1%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2022-01-29

an old photo of a man 91.4%
old photo of a man 90.8%
an old photo of a group of people in a room 90.7%

Text analysis

Amazon

بت
EI
COAD
COAD YTORAS
YTORAS
..."

Google

13
13