Human Generated Data

Title

Untitled (men and women looking into microscopes)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4697
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women looking into microscopes)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.4
Apparel 99.4
Person 97.4
Human 97.4
Person 95.9
Person 92.7
Person 91.9
Person 91.6
Tie 91.3
Accessory 91.3
Accessories 91.3
Clinic 83.5
Coat 77.7
Overcoat 77.7
Tie 76.5
Face 73.1
People 64.6
Photography 64.4
Photo 64.4
Portrait 64.4
Suit 61.5
Shirt 58.9
Fashion 58.2
Robe 58.2
Gown 58
Lab Coat 57.9
Tuxedo 57.8
Scientist 56.7
Wedding 56.6
Furniture 56.3
Indoors 55.8
Table 55.6

Imagga
created on 2022-01-29

man 38.5
businessman 35.3
business 33.4
male 32.6
professional 31
people 30.7
person 30.2
office 27.3
work 26.7
adult 25.3
corporate 24.1
looking 24
desk 22.7
doctor 22.6
happy 22.6
businesspeople 21.8
team 21.5
worker 21.4
working 21.2
coat 21
job 20.4
portrait 20.1
colleagues 19.4
medical 19.4
suit 18.3
group 17.7
computer 17.6
teamwork 17.6
negative 17.5
businesswoman 17.3
men 17.2
associates 16.7
table 16.4
lab coat 16.3
handsome 16
technology 15.6
casual 15.3
hospital 15.2
meeting 15.1
indoors 14.9
manager 14.9
film 14.7
modern 14.7
indoor 14.6
sitting 14.6
laptop 14.6
clinic 14.5
smiling 14.5
laboratory 14.5
human 14.3
face 14.2
medicine 14.1
health 13.9
coworkers 13.8
occupation 13.8
bright 13.6
day 13.3
mature 13
success 12.9
successful 12.8
lab 12.6
attractive 12.6
color 12.2
education 12.1
assistant 11.7
science 11.6
research 11.4
smile 11.4
look 11.4
student 11
horizontal 10.9
care 10.7
light 10.7
photographic paper 10.6
cooperation 10.6
specialist 10.5
serious 10.5
building 10.3
happiness 10.2
camera 10.2
20s 10.1
hand 9.9
doctors 9.8
executive 9.7
chemistry 9.7
chemical 9.7
elderly 9.6
tie 9.5
room 9.3
confident 9.1
nurse 8.9
collaboration 8.9
crew 8.9
scientist 8.8
25 30 years 8.8
together 8.8
scientific 8.7
concentration 8.7
lifestyle 8.7
engineer 8.7
30s 8.7
senior 8.4
cheerful 8.1
patient 8
development 7.9
chemist 7.9
couple 7.8
good mood 7.8
hands 7.8
conference 7.8
businessmen 7.8
expertise 7.8
builder 7.8
2 7.7
construction 7.7
test 7.7
formal 7.6
workplace 7.6
finance 7.6
biology 7.6
career 7.6
females 7.6
learning 7.5
company 7.4
glasses 7.4
jacket 7.3
women 7.1
photographic equipment 7.1
pencil 7.1

Google
created on 2022-01-29

Black-and-white 83.6
Font 77.1
Event 72.7
Monochrome photography 71.4
Health care provider 70.7
Monochrome 69.4
Service 69.2
Science 64.6
Vintage clothing 63.6
Suit 63.2
Room 61.7
Chemistry 60.7
Illustration 57.5
History 57.1
Medical assistant 54.9
Formal wear 54.3
Medical procedure 54
Uniform 52.1
Nurse 51.1
Photo caption 50

Microsoft
created on 2022-01-29

text 97.5
wedding dress 93.5
bride 90
posing 89.1
person 88.5
wedding 83
clothing 77.8
old 75.2
man 72.5
woman 58.9
black and white 52.4

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 96.7%
Surprised 34.8%
Sad 26.4%
Calm 14.3%
Disgusted 8.7%
Happy 7.6%
Confused 4.1%
Angry 2.3%
Fear 1.9%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Confused 44.4%
Calm 25.4%
Sad 10.7%
Angry 6%
Happy 5.5%
Disgusted 4.1%
Surprised 3.1%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Male, 98.9%
Sad 40.7%
Surprised 24.7%
Happy 10.2%
Calm 8.1%
Angry 7.3%
Confused 4.6%
Disgusted 2.3%
Fear 2.1%

AWS Rekognition

Age 45-51
Gender Female, 94.6%
Happy 83.4%
Sad 8.3%
Surprised 3.8%
Calm 2.3%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Tie 91.3%
Suit 61.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 91.9%
a group of people posing for a photo 91.8%
a vintage photo of a group of people posing for a picture 91.7%

Text analysis

Amazon

30
.OE
of

Google

30.
30.