Human Generated Data

Title

Untitled (man standing at table, Cloister Inn Club Dinner, Haverford, PA)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8286
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man standing at table, Cloister Inn Club Dinner, Haverford, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.1
Person 99.1
Person 98.6
Chair 93.6
Furniture 93.6
Person 83.6
Sitting 78.3
Restaurant 76.9
Tie 65.1
Accessories 65.1
Accessory 65.1

Imagga
created on 2022-01-08

patient 58.2
person 54.7
man 51.8
specialist 51.4
male 41.9
case 36.3
sick person 35.1
people 29.6
adult 26.7
professional 25.3
office 25
businessman 24.7
sitting 24.1
business 23.7
lab coat 20.9
occupation 20.2
desk 19.8
men 19.8
senior 19.7
happy 19.4
medical 19.4
indoors 19.3
table 19
nurse 19
smiling 18.8
doctor 18.8
working 18.6
work 18.1
meeting 17.9
coat 17.4
teacher 17.2
team 17
home 16.8
job 15.9
mature 15.8
couple 15.7
practitioner 15.2
education 14.7
40s 14.6
lifestyle 14.5
suit 14.4
portrait 14.2
health 13.9
group 13.7
indoor 13.7
worker 13.7
colleagues 13.6
looking 13.6
student 13.6
women 13.4
corporate 12.9
computer 12.8
hospital 12.4
talking 12.4
teamwork 12.1
casual 11.9
elderly 11.5
medicine 11.5
room 11.3
clinic 11
laptop 10.9
school 10.8
smile 10.7
concentration 10.6
cheerful 10.6
executive 10.5
together 10.5
businesspeople 10.4
standing 10.4
classroom 10.2
20s 10.1
color 10
businesswoman 10
care 9.9
handsome 9.8
to 9.7
mid adult 9.7
coffee 9.3
inside 9.2
hand 9.1
board 9
coworkers 8.8
discussion 8.8
two people 8.8
30s 8.7
adults 8.5
two 8.5
manager 8.4
horizontal 8.4
clothing 8.4
treatment 8.3
technology 8.2
necktie 8.1
interior 8
happiness 7.8
face 7.8
attractive 7.7
illness 7.6
college 7.6
career 7.6
service 7.4
surgeon 7.3
black 7.2
bright 7.2
day 7.1
modern 7

Google
created on 2022-01-08

Shirt 94.2
Photograph 94.2
Black 89.8
Picture frame 89.6
Black-and-white 82.3
Health care provider 76.2
Snapshot 74.3
Monochrome 74.1
Service 73.7
Monochrome photography 73.5
Event 73
Room 70.7
Vintage clothing 69.9
Medical 69.6
Health care 69.1
Nurse uniform 65.4
History 64.2
Stock photography 64.2
Medical procedure 63.1
Scrubs 63

Microsoft
created on 2022-01-08

person 97.9
text 97.8
man 82.5
table 76.9
clothing 70.3
human face 63

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Happy 98.1%
Calm 0.7%
Surprised 0.6%
Confused 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 100%
Sad 84%
Happy 9.6%
Calm 4.4%
Angry 0.9%
Confused 0.6%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 98.4%
Calm 0.7%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 93.6%
Tie 65.1%

Captions

Microsoft

a group of people sitting at a table 84.4%
a person standing in front of a laptop 80.3%
a group of people standing in front of a laptop 80.2%

Text analysis

Amazon

9532.
VT27A2
محجم

Google

9532.
9532.