Human Generated Data

Title

Untitled (six men drinking beer)
Date

c. 1950
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19776

Human Generated Data

Title

Untitled (six men drinking beer)

People

Artist: Unidentified Artist,

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.7
Clothing 99.7
Person 96.9
Human 96.9
Person 96
Person 95.1
Coat 94.6
Overcoat 94.6
Person 93.8
Person 93.6
Person 92.5
Suit 85.2
Tuxedo 82
Accessories 81.3
Accessory 81.3
Tie 81.3
Fashion 81.3
Robe 81.3
Shirt 80.6
Gown 78.3
Suit 73.3
Face 67.8
Wedding 67.4
Wedding Gown 64.2
Dress 63.6
Plant 61
Female 60
Evening Dress 58.7
Handrail 58.5
Banister 58.5
Suit 58.2
Chair 56.9
Furniture 56.9
Crystal 56.8
Bridegroom 55

Imagga
created on 2022-03-05

nurse 100
doctor 53.6
man 49.7
medical 48.6
hospital 46.2
professional 44.6
stethoscope 39.1
male 39
team 37.6
person 37.2
medicine 36.1
coat 35.9
people 34.6
happy 32
job 30.1
health 29.9
clinic 29.8
care 29.6
uniform 28.9
adult 28.8
business 28.6
occupation 28.4
doctors 27.5
portrait 27.2
smiling 26.8
smile 26.4
mature 26
standing 24.3
specialist 24.3
practitioner 24.1
group 23.4
profession 23
lab coat 22.9
work 22.8
confident 22.8
worker 22.3
businessman 22.1
surgeon 20.9
looking 20.8
patient 20.7
teamwork 20.4
working 20.3
men 19.8
staff 19.1
handsome 18.7
clinical 18.6
colleagues 17.5
30s 16.4
healthy 15.8
friendly 15.6
physician 14.6
laboratory 14.5
office 14.5
student 13.2
senior 13.1
success 12.9
camera 12
successful 11.9
two 11.9
businesswoman 11.8
suit 11.8
ill 11.7
health care 11.7
workers 11.7
practice 11.6
confidence 11.5
black 11.4
businesspeople 11.4
meeting 11.3
women 11.1
lifestyle 10.8
surgical 10.8
consultant 10.7
lab 10.7
expertise 10.7
sick 10.6
diversity 10.6
partnership 10.6
elderly 10.5
human 10.5
illness 10.5
40s 9.7
corporate 9.5
happiness 9.4
face 9.2
positive 9.2
20s 9.2
indoors 8.8
thirties 8.8
assistant 8.8
building 8.7
mid adult 8.7
bright 8.6
casual 8.5
cricket equipment 8.5
treatment 8.3
indoor 8.2
cheerful 8.1
coworkers 7.9
couple 7.8
diverse 7.8
hands 7.8
attractive 7.7
old 7.7
exam 7.7
one 7.5
company 7.4
lady 7.3
hair 7.1
case 7.1
together 7
look 7

Google
created on 2022-03-05

Standing 86.4
Sleeve 84.7
Style 83.9
Black-and-white 83.2
Blazer 77.7
Hat 77.5
Microphone 75
Formal wear 74.4
Event 73.6
Monochrome photography 71
Uniform 70.7
Stage equipment 70.5
Monochrome 70.2
Crew 69.7
Vintage clothing 68.3
Fashion design 66.8
Music 65.7
Team 65.5
Suit 65.2
White-collar worker 64.2

Microsoft
created on 2022-03-05

person 98.1
clothing 94.3
man 91
standing 87.6
outdoor 85.4
posing 83.6
black and white 81.1
sport 67.9
text 67.2
smile 52.2
clothes 40.9
dressed 26.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 96.1%
Sad 3%
Surprised 0.3%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 88.4%
Sad 82.1%
Calm 11.3%
Angry 2.1%
Surprised 1.6%
Happy 1.3%
Disgusted 0.8%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Sad 44.3%
Happy 34.6%
Confused 11%
Surprised 2.9%
Disgusted 2.6%
Fear 1.8%
Angry 1.5%
Calm 1.3%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 98.1%
Surprised 0.8%
Angry 0.4%
Sad 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Sad 38.1%
Confused 24.4%
Calm 16.2%
Surprised 12.1%
Angry 4.3%
Disgusted 2%
Happy 1.7%
Fear 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Suit 85.2%
Tie 81.3%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for a picture 98.1%
a group of people posing for the camera 98%

Text analysis

Amazon

RODVK
RODVK EVEELA
EVEELA
٢١