Human Generated Data

Title

Untitled (man in suit standing behind table, Princeton University reunion, Princeton, NJ)
Date

c. 1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4552
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man in suit standing behind table, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.1
Person 99.1
Person 99.1
Meal 98.1
Food 98.1
Person 96.7
Tie 96.4
Accessories 96.4
Accessory 96.4
Person 95.8
Clothing 92.2
Apparel 92.2
Restaurant 88.8
Cafeteria 84.7
Tie 80.2
Person 79.8
Buffet 77.3
Tie 74.5
Dish 70.3
Tie 69
Home Decor 64.5
Linen 64.4
Overcoat 63.6
Suit 63.6
Coat 63.6
Person 57.1

Imagga
created on 2021-12-14

man 45
person 37.9
male 35.5
people 34.6
lab coat 34.2
coat 33.2
senior 30.9
patient 30.3
indoors 28.1
medical 26.5
adult 25.6
doctor 25.4
home 23.9
hospital 22.5
professional 21.5
clinic 21.1
office 21
health 20.2
sitting 19.8
smiling 19.5
elderly 19.2
nurse 19
happy 18.8
job 18.6
work 18.2
looking 17.6
worker 17.1
portrait 16.8
lifestyle 16.6
surgeon 16.1
room 16
specialist 16
occupation 15.6
casual 15.3
working 15
medicine 15
men 14.6
business 14
mature 14
retirement 13.4
team 13.4
care 13.2
table 13
retired 12.6
businessman 12.4
teamwork 12.1
computer 12
women 11.9
70s 11.8
day 11.8
kitchen 11.6
clothing 11.6
to 11.5
illness 11.4
together 11.4
couple 11.3
garment 11
60s 10.8
grandfather 10.7
case 10.7
two people 10.7
waiter 10.5
talking 10.5
old 10.5
businesspeople 10.4
camera 10.2
two 10.2
businesswoman 10
holding 9.9
sick person 9.8
50s 9.8
executive 9.7
technology 9.7
30s 9.6
desk 9.4
meeting 9.4
glasses 9.3
face 9.2
student 9.2
teacher 8.9
casual clothing 8.8
education 8.7
exam 8.6
happiness 8.6
profession 8.6
grandma 8.4
dining-room attendant 8.4
horizontal 8.4
color 8.3
inside 8.3
laptop 8.2
cheerful 8.1
employee 8
science 8
fifties 7.9
standing 7.8
half length 7.8
40s 7.8
middle aged 7.8
lab 7.8
older 7.8
sick 7.7
laboratory 7.7
modern 7.7
test 7.7
hand 7.6
house 7.5
suit 7.5
indoor 7.3
bright 7.2
handsome 7.1
smile 7.1

Google
created on 2021-12-14

Photograph 94.1
Black-and-white 82.9
Cooking 79.7
Snapshot 74.3
Monochrome photography 72.5
Monochrome 71.5
Event 69.9
Service 69.4
Vintage clothing 65.5
Stock photography 63.6
Room 63
History 60.6
Chef 58.6
Hat 57.2
Font 56.5
Culinary art 55.7
Apron 55.4
Photography 52.5

Microsoft
created on 2021-12-14

person 98.3
text 98.3
clothing 91.3
man 91.1
old 80.8
standing 76
human face 71.8
posing 37.7

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Male, 98.5%
Calm 53.7%
Happy 17.4%
Confused 15.1%
Sad 8.9%
Surprised 2.9%
Angry 0.9%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 30-46
Gender Female, 81.3%
Calm 76.7%
Surprised 7.2%
Sad 6.5%
Confused 4.3%
Angry 2.1%
Happy 1.7%
Disgusted 0.9%
Fear 0.6%

AWS Rekognition

Age 46-64
Gender Female, 91.2%
Calm 89.7%
Surprised 4%
Happy 3.6%
Angry 1.8%
Disgusted 0.3%
Sad 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 38-56
Gender Male, 62.2%
Calm 76.1%
Happy 20.1%
Surprised 1.3%
Sad 1.3%
Angry 0.6%
Fear 0.4%
Confused 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 96.4%

Captions

Microsoft

an old photo of a group of people posing for the camera 82.1%
a group of people posing for a photo 80.9%
a man standing in front of a group of people posing for a photo 65.9%

Text analysis

Amazon

MOIO