Human Generated Data

Title

Untitled (men standing around punch bowl/bar)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4816
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men standing around punch bowl/bar)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.2
Human 99.2
Person 98.5
Person 97.6
Apparel 90.4
Clothing 90.4
Tie 80.9
Accessories 80.9
Accessory 80.9
Scientist 77.9
Coat 76.6
Overcoat 75.9
Suit 75.9
Tie 74.9
Glass 71.2
Clinic 65.7
Tuxedo 59.2
Lab 56.5
Pub 56.1
Bar Counter 56.1
Shirt 55.5

Imagga
created on 2022-01-29

man 47.1
male 39.1
people 36.9
executive 35
meeting 34
businessman 33.6
business 33.4
groom 32
person 32
adult 30.8
office 29.8
senior 29.1
team 28.7
colleagues 27.2
businesswoman 26.4
lab coat 26
businesspeople 25.6
men 24.9
couple 24.4
smiling 23.2
working 23
indoors 22.9
worker 22.8
professional 22.4
happy 22
talking 21.9
group 21
sitting 20.6
mature 20.5
coat 20.5
together 20.2
table 19.1
discussion 18.5
women 18.2
elderly 18.2
corporate 18.1
desk 18
teamwork 17.6
home 16.8
work 16.5
doctor 16
patient 15.8
coworkers 15.7
room 15.5
mid adult 15.5
lifestyle 15.2
job 15.1
medical 15
specialist 14.7
cheerful 14.6
associates 13.8
discussing 13.8
20s 13.8
conference 13.7
30s 13.5
care 13.2
manager 13.1
clothing 13
presentation 13
bow tie 13
portrait 13
garment 12.8
casual 12.7
40s 12.7
busy 12.5
occupation 11.9
indoor 11.9
health 11.8
four 11.5
smile 11.4
hospital 11.4
laptop 10.9
grandma 10.9
horizontal 10.9
two people 10.7
color 10.6
necktie 10.5
old 10.5
employee 10.5
day 10.2
happiness 10.2
camera 10.2
suit 9.9
clinic 9.9
modern 9.8
60s 9.8
middle aged 9.7
success 9.7
illness 9.5
company 9.3
coffee 9.3
successful 9.2
boardroom 8.9
four people 8.9
explaining 8.9
30 35 years 8.8
50s 8.8
computer 8.8
practitioner 8.8
businessmen 8.8
older 8.7
retired 8.7
cooperation 8.7
drinking 8.6
boss 8.6
face 8.5
enjoying 8.5
waiter 8.4
communication 8.4
hand 8.4
drink 8.4
confident 8.2
aged 8.2
looking 8
nurse 7.9
business people 7.9
kin 7.9
collaboration 7.9
70s 7.9
forties 7.9
husband 7.8
standing 7.8
thirties 7.8
expertise 7.8
staff 7.7
twenties 7.7
ethnic 7.6
career 7.6
technology 7.4
grandfather 7.4
medicine 7.1

Google
created on 2022-01-29

Outerwear 95.2
Coat 92.8
Gesture 85.3
Style 83.8
Black-and-white 83.1
Suit 77.9
Formal wear 73.5
Monochrome photography 73.4
White-collar worker 73.3
Monochrome 73.1
Event 73
Cooking 67.1
Vintage clothing 65.7
Service 64.4
History 63
Stock photography 62.8
Tie 61.3
Room 61.1
Smile 60.7
Uniform 59.5

Microsoft
created on 2022-01-29

person 99.8
text 99.1
man 96.5
clothing 91.5
bottle 83.1
standing 78.4
old 47.8

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Calm 44.3%
Sad 37.5%
Happy 12.4%
Confused 2.8%
Disgusted 1.1%
Fear 0.7%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 28-38
Gender Male, 98.6%
Surprised 85.4%
Calm 9.4%
Angry 1.5%
Disgusted 1.1%
Confused 1%
Happy 0.7%
Fear 0.5%
Sad 0.4%

AWS Rekognition

Age 37-45
Gender Male, 71.8%
Calm 58.4%
Sad 34.1%
Confused 5.8%
Happy 0.9%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 80.9%
Suit 75.9%

Captions

Microsoft

a group of people posing for a photo 81.3%
an old photo of a person 81.2%
a group of people posing for the camera 81.1%

Text analysis

Amazon

EVECLA
ELENDER EVECLA DVOL
ELENDER
DVOL