Human Generated Data

Title

Untitled (man standing at table, Cloister Inn Club Dinner, Haverford, PA)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8286

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man standing at table, Cloister Inn Club Dinner, Haverford, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.5
Person 99.5
Person 99.1
Person 99.1
Person 98.6
Chair 93.6
Furniture 93.6
Person 83.6
Sitting 78.3
Restaurant 76.9
Accessory 65.1
Accessories 65.1
Tie 65.1

Imagga
created on 2022-01-08

patient 58.2
person 54.7
man 51.8
specialist 51.4
male 41.9
case 36.3
sick person 35.1
people 29.6
adult 26.7
professional 25.3
office 25
businessman 24.7
sitting 24.1
business 23.7
lab coat 20.9
occupation 20.2
desk 19.8
men 19.8
senior 19.7
happy 19.4
medical 19.4
indoors 19.3
table 19
nurse 19
smiling 18.8
doctor 18.8
working 18.6
work 18.1
meeting 17.9
coat 17.4
teacher 17.2
team 17
home 16.8
job 15.9
mature 15.8
couple 15.7
practitioner 15.2
education 14.7
40s 14.6
lifestyle 14.5
suit 14.4
portrait 14.2
health 13.9
group 13.7
indoor 13.7
worker 13.7
colleagues 13.6
looking 13.6
student 13.6
women 13.4
corporate 12.9
computer 12.8
hospital 12.4
talking 12.4
teamwork 12.1
casual 11.9
elderly 11.5
medicine 11.5
room 11.3
clinic 11
laptop 10.9
school 10.8
smile 10.7
concentration 10.6
cheerful 10.6
executive 10.5
together 10.5
businesspeople 10.4
standing 10.4
classroom 10.2
20s 10.1
color 10
businesswoman 10
care 9.9
handsome 9.8
to 9.7
mid adult 9.7
coffee 9.3
inside 9.2
hand 9.1
board 9
coworkers 8.8
discussion 8.8
two people 8.8
30s 8.7
adults 8.5
two 8.5
manager 8.4
horizontal 8.4
clothing 8.4
treatment 8.3
technology 8.2
necktie 8.1
interior 8
happiness 7.8
face 7.8
attractive 7.7
illness 7.6
college 7.6
career 7.6
service 7.4
surgeon 7.3
black 7.2
bright 7.2
day 7.1
modern 7

Microsoft
created on 2022-01-08

person 97.9
text 97.8
man 82.5
table 76.9
clothing 70.3
human face 63

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Happy 98.1%
Calm 0.7%
Surprised 0.6%
Confused 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 100%
Sad 84%
Happy 9.6%
Calm 4.4%
Angry 0.9%
Confused 0.6%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 98.4%
Calm 0.7%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 93.6%
Tie 65.1%

Captions

Microsoft

a group of people sitting at a table 84.4%
a person standing in front of a laptop 80.3%
a group of people standing in front of a laptop 80.2%

Text analysis

Amazon

9532.
VT27A2
محجم

Google

9532.
9532.