Human Generated Data

Title

Untitled (group portrait)

Date

1939

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1721

Human Generated Data

Title

Untitled (group portrait)

People

Artist: John Deusing, American active 1940s

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.8
Person 99.8
Clothing 99.5
Apparel 99.5
Person 99.4
Person 99.3
Person 99
Person 98.7
Person 98.6
Person 98.2
Person 98
Person 97.9
Person 97.2
Person 97.2
Face 95.6
Person 95.1
Shirt 93.1
Tie 90.9
Accessories 90.9
Accessory 90.9
Tie 89.4
Smile 86
Coat 82.8
Sunglasses 82.4
Doctor 79.9
People 77.1
Head 73.8
Overcoat 73.4
Scientist 73
Tie 69
Photo 66.8
Portrait 66.8
Photography 66.8
Lab Coat 65.6
Suit 62.2
Sleeve 59.3
Clinic 57.3
Crowd 57.3
Necktie 56.7
Suit 54.8

Imagga
created on 2021-12-14

specialist 62.2
nurse 54.5
man 49.7
male 43.2
doctor 38.5
person 37
adult 33.1
businessman 32.6
professional 32.4
medical 31.7
people 31.2
hospital 30
surgeon 29.3
coat 28.6
business 28.5
happy 27.5
occupation 27.5
portrait 27.1
job 26.5
stethoscope 25.9
team 25.9
looking 24.8
lab coat 23.2
medicine 22.9
smiling 22.4
men 22.3
mature 21.4
smile 21.3
uniform 21.1
handsome 20.5
worker 19.5
success 18.5
clinic 18.2
care 18.1
health 18
work 18
standing 17.4
office 16.8
colleagues 16.5
human 16.5
staff 16.2
senior 15.9
confident 15.4
elderly 15.3
tie 15.2
working 15
group 14.5
30s 14.4
suit 14.4
happiness 14.1
teamwork 13.9
businesspeople 13.3
camera 12.9
successful 12.8
face 12.8
executive 12.6
expertise 12.6
confidence 12.4
profession 12.4
manager 12.1
cheerful 11.4
corporate 11.2
practitioner 10.8
holding 10.7
boss 10.5
attractive 10.5
student 10.3
expression 10.2
glasses 10.2
two 10.2
20s 10.1
friendly 10
hand 9.9
physician 9.7
clothing 9.7
40s 9.7
technology 9.6
laboratory 9.6
patient 9.5
bright 9.3
modern 9.1
equipment 8.9
one 8.9
associates 8.8
doctors 8.8
clinical 8.8
consultant 8.8
look 8.7
mid adult 8.7
lifestyle 8.7
formal 8.6
illness 8.6
desk 8.5
casual 8.5
black 8.4
old 8.3
color 8.3
indoor 8.2
businesswoman 8.2
coworkers 7.8
education 7.8
leader 7.7
serious 7.6
meeting 7.5
shirt 7.5
light 7.3
indoors 7

Google
created on 2021-12-14

Photograph 94.2
Shirt 94
White 92.2
Smile 91.2
Sleeve 85.1
Style 83.8
Font 76.8
Crew 75.4
Snapshot 74.3
Vintage clothing 73.4
Event 73.3
Fun 72.5
Uniform 71.4
Monochrome 70.9
Formal wear 70.8
Team 69.1
Monochrome photography 68.7
T-shirt 68.7
Art 67.8
History 66.5

Microsoft
created on 2021-12-14

posing 99.9
person 97.5
group 91.8
text 91.7
smile 89.6
wedding dress 76.6
bride 76.3
clothing 68.4
black and white 61.4
old 40.6

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Female, 52%
Calm 94.5%
Surprised 3.1%
Happy 0.7%
Confused 0.6%
Sad 0.6%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Male, 93.5%
Calm 58.8%
Surprised 22.5%
Sad 11.7%
Happy 3.6%
Confused 1.2%
Fear 1.2%
Angry 0.8%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Female, 81.3%
Surprised 72.8%
Calm 20.2%
Confused 2.4%
Fear 2.2%
Happy 1.5%
Sad 0.6%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 45-63
Gender Male, 95.9%
Calm 49.6%
Happy 40%
Surprised 6.3%
Sad 1.6%
Confused 1.4%
Disgusted 0.5%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 23-37
Gender Male, 93.7%
Surprised 77.9%
Calm 19%
Happy 1%
Fear 0.9%
Confused 0.5%
Sad 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Male, 56.4%
Happy 47.2%
Surprised 40.7%
Calm 8.6%
Angry 1.2%
Confused 0.8%
Fear 0.6%
Sad 0.6%
Disgusted 0.3%

AWS Rekognition

Age 36-54
Gender Female, 93.6%
Surprised 74.5%
Calm 17.3%
Fear 5.4%
Angry 0.8%
Sad 0.6%
Confused 0.6%
Happy 0.6%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Female, 54.2%
Calm 64.1%
Confused 17%
Happy 10.5%
Sad 3.4%
Surprised 3.4%
Angry 0.8%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 22-34
Gender Female, 88.2%
Happy 53%
Calm 25%
Sad 9.7%
Surprised 6.4%
Fear 3.9%
Angry 0.9%
Confused 0.8%
Disgusted 0.2%

AWS Rekognition

Age 36-52
Gender Male, 95.4%
Calm 87.5%
Surprised 9.7%
Happy 0.6%
Angry 0.6%
Confused 0.5%
Disgusted 0.4%
Sad 0.4%
Fear 0.2%

AWS Rekognition

Age 23-35
Gender Male, 60.1%
Calm 87%
Surprised 3.8%
Sad 3.5%
Happy 3%
Fear 1.2%
Confused 1%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 27-43
Gender Female, 98%
Calm 50.8%
Surprised 22.8%
Happy 13.1%
Confused 6.6%
Sad 2.8%
Fear 2.2%
Angry 0.8%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 90.9%
Sunglasses 82.4%
Suit 62.2%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for the camera 98.1%
a group of people posing for a picture 98%