Human Generated Data

Title

Untitled (class of girls in gym clothes)

Date

1944

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1618

Human Generated Data

Title

Untitled (class of girls in gym clothes)

People

Artist: John Deusing, American active 1940s

Date

1944

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.5
Person 99.5
Person 98.7
Person 98.2
Person 98.1
Person 97.7
Person 97.6
Person 97.5
Person 97
Person 96.8
Person 96.2
Person 95.6
Person 95.5
Person 94.4
Person 93.6
Footwear 92.5
Apparel 92.5
Clothing 92.5
Shoe 92.5
Person 89.7
Person 89.3
Person 85.4
People 81.3
Person 75.2
Shoe 71.8
Shoe 52.9
Person 44.3

Imagga
created on 2021-12-14

group 33.8
crowd 30.7
people 25.7
business 21.3
men 19.7
team 19.7
silhouette 19
sketch 18.7
drawing 16.6
art 14.9
man 14.9
graphic 14.6
teamwork 13.9
success 13.7
adult 13.6
male 13.5
person 13.2
symbol 12.8
facility 12.7
black 12.6
design 12.4
party 12
sign 12
shape 11.9
set 11.9
silhouettes 11.6
outline 11.4
walking 11.4
body 11.2
many 11.1
office 10.4
standing 10.4
women 10.3
work 10.2
representation 10.1
3d 10.1
old 9.7
human 9.7
corporate 9.4
clip 9.3
gymnasium 9
collection 9
businessman 8.8
leadership 8.6
friends 8.5
action 8.3
figure 8.2
backgrounds 8.1
equipment 8
urban 7.9
partnership 7.7
friendship 7.5
boy 7.3
athletic facility 7.2
metal 7.2
line 7.2
suit 7.2
pawn 7.1

Microsoft
created on 2021-12-14

posing 98.2
text 96.9
clothing 94.6
group 89.6
man 88.1
old 85.7
person 85.6
black 84.4
white 80.3
young 75.6
footwear 67.7
team 31.1
clothes 22.8

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Female, 52.7%
Calm 86.3%
Happy 10.3%
Sad 2.7%
Angry 0.3%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 32-48
Gender Male, 97.1%
Disgusted 46.9%
Calm 33.8%
Happy 7%
Angry 4.9%
Sad 3%
Surprised 2%
Fear 1.4%
Confused 1%

AWS Rekognition

Age 21-33
Gender Female, 53%
Calm 76.2%
Happy 10.1%
Fear 4.6%
Sad 3.1%
Surprised 2.7%
Angry 1.4%
Confused 1.2%
Disgusted 0.6%

AWS Rekognition

Age 36-52
Gender Male, 96.9%
Calm 98.2%
Happy 0.8%
Sad 0.5%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 14-26
Gender Male, 80%
Happy 81.2%
Calm 12.4%
Confused 2%
Sad 1.5%
Angry 1.1%
Surprised 1%
Fear 0.7%
Disgusted 0.2%

AWS Rekognition

Age 23-35
Gender Male, 65.6%
Happy 88.4%
Calm 9.1%
Confused 0.7%
Sad 0.6%
Surprised 0.5%
Disgusted 0.4%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 36-54
Gender Male, 58.2%
Happy 52.2%
Calm 32.3%
Sad 4.5%
Angry 3.7%
Confused 2.3%
Surprised 1.9%
Fear 1.6%
Disgusted 1.5%

AWS Rekognition

Age 13-23
Gender Male, 86.9%
Calm 88.1%
Happy 11.5%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 17-29
Gender Male, 94.3%
Calm 92.2%
Sad 2.5%
Happy 2.1%
Surprised 1.9%
Confused 0.6%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 26-42
Gender Male, 71.7%
Happy 56.6%
Calm 19.7%
Disgusted 14.9%
Sad 3.4%
Confused 2.5%
Angry 1.2%
Surprised 1%
Fear 0.6%

AWS Rekognition

Age 26-42
Gender Male, 70.5%
Calm 49.5%
Happy 43.9%
Sad 5.1%
Angry 0.5%
Confused 0.3%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 76.3%
Calm 69.6%
Happy 17.1%
Sad 5.1%
Surprised 3.7%
Disgusted 1.7%
Fear 1.2%
Confused 0.9%
Angry 0.8%

AWS Rekognition

Age 22-34
Gender Female, 55.2%
Happy 66.3%
Calm 26.2%
Sad 2.5%
Surprised 1.8%
Confused 1.3%
Angry 0.7%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 23-37
Gender Male, 85.3%
Happy 62.8%
Calm 26.8%
Sad 7.4%
Surprised 0.9%
Confused 0.7%
Angry 0.6%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 34-50
Gender Male, 91.8%
Calm 87.5%
Sad 6.5%
Happy 3.7%
Angry 1.2%
Confused 0.4%
Surprised 0.4%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 71.7%
Happy 61.7%
Calm 15.1%
Sad 10.3%
Fear 5.3%
Surprised 3.1%
Angry 2.8%
Confused 1.2%
Disgusted 0.4%

AWS Rekognition

Age 25-39
Gender Male, 64%
Sad 26.7%
Surprised 25%
Calm 15.8%
Happy 14.1%
Fear 9.4%
Confused 4.9%
Disgusted 2.1%
Angry 2%

AWS Rekognition

Age 19-31
Gender Male, 87%
Surprised 41.3%
Happy 30.8%
Calm 21.4%
Angry 1.8%
Confused 1.6%
Fear 1.2%
Sad 1%
Disgusted 0.8%

AWS Rekognition

Age 25-39
Gender Female, 79.4%
Calm 85.8%
Sad 10.5%
Confused 1.5%
Happy 1.1%
Angry 0.7%
Disgusted 0.3%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-33
Gender Male, 87.6%
Sad 48.4%
Calm 33.1%
Confused 12%
Surprised 3.9%
Angry 1.2%
Disgusted 0.6%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 21-33
Gender Female, 59.6%
Calm 47.9%
Happy 42.9%
Surprised 5.6%
Sad 1.4%
Fear 0.8%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 26-42
Gender Female, 61.2%
Calm 50.1%
Happy 46.1%
Sad 1.7%
Disgusted 0.8%
Surprised 0.4%
Confused 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 24-38
Gender Male, 87.3%
Calm 78.4%
Sad 8.6%
Happy 5.4%
Surprised 3.4%
Confused 2.7%
Angry 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 13-25
Gender Female, 69.5%
Happy 90.9%
Calm 6.7%
Sad 1%
Surprised 0.4%
Angry 0.3%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Male, 89.9%
Calm 65.1%
Happy 27.3%
Disgusted 1.9%
Sad 1.8%
Surprised 1.6%
Confused 1.1%
Angry 0.7%
Fear 0.6%

AWS Rekognition

Age 22-34
Gender Female, 67.4%
Calm 59.2%
Surprised 25%
Fear 4.6%
Happy 4%
Sad 2.9%
Confused 2.4%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 32-48
Gender Female, 92.6%
Happy 87.8%
Calm 8.9%
Sad 1.5%
Surprised 0.6%
Angry 0.5%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 3-9
Gender Female, 73%
Calm 48.7%
Sad 41.2%
Confused 3%
Surprised 2.4%
Happy 1.5%
Angry 1.4%
Fear 1.2%
Disgusted 0.7%

AWS Rekognition

Age 21-33
Gender Female, 50.3%
Happy 75.2%
Calm 24.1%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 21-33
Gender Male, 75.6%
Calm 68.3%
Sad 8.2%
Surprised 7.8%
Happy 5.4%
Fear 4.3%
Angry 3.2%
Confused 2%
Disgusted 0.8%

AWS Rekognition

Age 21-33
Gender Male, 92.8%
Happy 73%
Calm 22.5%
Sad 2.4%
Confused 0.8%
Surprised 0.6%
Angry 0.5%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 87.8%
Calm 97.6%
Happy 1.5%
Sad 0.5%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 96.8%
Calm 58%
Happy 21.2%
Confused 14.5%
Surprised 2.7%
Sad 1.7%
Disgusted 1%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 14-26
Gender Male, 71.6%
Calm 65.1%
Sad 32.8%
Confused 0.9%
Surprised 0.6%
Happy 0.4%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-33
Gender Male, 90.8%
Calm 65.3%
Happy 27.2%
Surprised 3.2%
Fear 1.6%
Sad 0.8%
Disgusted 0.8%
Confused 0.6%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 92.5%

Captions

Microsoft

a group of people posing for a photo 94.7%
a group of kids posing for a photo 80.6%
a group of men posing for a photo 80.5%

Text analysis

Amazon

Pers