Human Generated Data

Title

Untitled (portrait of large group of girls in white capes)

Date

1933

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13311

Human Generated Data

Title

Untitled (portrait of large group of girls in white capes)

People

Artist: Harry Annas, American 1897 - 1980

Date

1933

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13311

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.5
Person 99.4
Person 99.1
Person 98.4
Person 97.1
Person 97.1
Person 96
Person 95.6
Person 94.3
Person 91
School 90.2
Person 88.2
Sailor Suit 86
Person 84.3
Porch 83.8
Classroom 82.3
Room 82.3
Indoors 82.3
People 79.2
Clothing 75.8
Apparel 75.8
Person 75.7
Person 62.7
Kindergarten 61.8
Person 61.7
Boy 59
Person 56.8
Kid 55.1
Child 55.1

Clarifai
created on 2023-10-27

people 99.9
group 99.2
child 99.2
many 99
group together 97.2
boy 96.1
man 93.4
portrait 91.7
adult 91
monochrome 90.7
woman 90.5
education 89.6
son 89.5
uniform 88.3
crowd 88
school 87.9
street 87.7
queue 86.5
wear 86.4
wedding 84.8

Imagga
created on 2022-01-23

people 26.7
group 20.1
silhouette 19
man 17.4
crowd 17.3
black 16.8
person 14.5
kin 14.5
male 14.2
men 12.9
grunge 12.8
city 12.5
urban 12.2
body 12
business 11.5
adult 11.3
old 11.1
hospital 11
dress 10.8
world 10.7
hand 10.6
women 10.3
gymnasium 10.2
music 9.9
fashion 9.8
child 9.8
human 9.7
life 9.6
party 9.4
sport 9.2
dark 9.2
girls 9.1
design 9.1
dance 9
fun 9
success 8.8
art 8.7
drawing 8.6
musician 8.6
model 8.5
walking 8.5
power 8.4
dancer 8.3
action 8.3
decoration 8.2
athletic facility 8.2
stage 8.1
symbol 8.1
team 8.1
light 8
portrait 7.8
play 7.7
travel 7.7
youth 7.7
friends 7.5
style 7.4
training 7.4
singer 7.4
dirty 7.2
office 7.2
posing 7.1
work 7.1
businessman 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.1
clothing 95.4
group 87.5
posing 77.6
people 74.3
man 63.3
old 61.4
team 35.7
crowd 30.6
clothes 16

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 82.7%
Happy 98.3%
Calm 1.2%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Calm 69.1%
Happy 18.1%
Surprised 7.5%
Sad 2%
Confused 0.9%
Fear 0.8%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 18-26
Gender Female, 80.8%
Happy 96.8%
Calm 1.7%
Sad 0.5%
Surprised 0.3%
Angry 0.2%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.2%
Calm 99.4%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 100%
Calm 48.5%
Sad 44.5%
Angry 4.1%
Fear 0.7%
Confused 0.7%
Surprised 0.6%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 23-31
Gender Female, 98.2%
Calm 96.2%
Confused 1.4%
Sad 1%
Happy 0.7%
Angry 0.3%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 40-48
Gender Female, 100%
Happy 82.7%
Calm 12.3%
Surprised 1.7%
Confused 1.1%
Angry 0.8%
Sad 0.6%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 14-22
Gender Male, 99.6%
Happy 93.4%
Sad 1.8%
Calm 1.8%
Angry 0.9%
Confused 0.9%
Surprised 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 41-49
Gender Female, 100%
Calm 36.9%
Surprised 26.1%
Sad 15.3%
Happy 5.3%
Fear 5.2%
Angry 4.2%
Confused 3.6%
Disgusted 3.4%

AWS Rekognition

Age 26-36
Gender Female, 100%
Sad 53.3%
Calm 40.8%
Angry 1.9%
Confused 1.4%
Fear 1%
Surprised 0.6%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 35-43
Gender Female, 100%
Calm 75.4%
Sad 22.8%
Fear 0.6%
Confused 0.3%
Happy 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 29-39
Gender Female, 90.5%
Happy 58.3%
Sad 10.9%
Confused 8.9%
Surprised 6.7%
Angry 4.4%
Calm 3.8%
Fear 3.8%
Disgusted 3.1%

AWS Rekognition

Age 24-34
Gender Female, 98.4%
Calm 84.6%
Happy 5.4%
Confused 3.2%
Angry 2.8%
Surprised 1.5%
Sad 1.2%
Fear 0.8%
Disgusted 0.6%

AWS Rekognition

Age 18-24
Gender Female, 98.2%
Angry 80.9%
Calm 11.7%
Sad 3.1%
Confused 1.5%
Surprised 0.8%
Happy 0.8%
Disgusted 0.6%
Fear 0.6%

AWS Rekognition

Age 24-34
Gender Female, 59.3%
Calm 82.3%
Happy 10.5%
Confused 3.4%
Angry 1.2%
Sad 1%
Surprised 0.7%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Sad 49.5%
Calm 39.3%
Confused 3%
Angry 2.9%
Surprised 1.7%
Fear 1.6%
Disgusted 1.1%
Happy 0.9%

AWS Rekognition

Age 20-28
Gender Male, 85%
Sad 96.1%
Fear 1.2%
Angry 1%
Calm 0.9%
Surprised 0.2%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 74.7%
Happy 62.2%
Calm 29.2%
Sad 2.5%
Confused 2%
Surprised 1.1%
Angry 1.1%
Fear 1%
Disgusted 0.8%

AWS Rekognition

Age 49-57
Gender Female, 99.9%
Calm 86.5%
Happy 10.6%
Sad 1.8%
Surprised 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.4%
Happy 85.9%
Sad 7.1%
Disgusted 1.6%
Calm 1.5%
Angry 1.4%
Confused 0.9%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 87.1%
Sad 3.9%
Happy 3.7%
Confused 1.6%
Angry 1.1%
Disgusted 1%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 20-28
Gender Female, 91.7%
Happy 91.6%
Calm 3.6%
Angry 1.4%
Surprised 0.9%
Confused 0.7%
Disgusted 0.7%
Sad 0.7%
Fear 0.4%

AWS Rekognition

Age 23-31
Gender Female, 97.2%
Happy 59%
Calm 32.3%
Confused 3.2%
Sad 1.5%
Angry 1.4%
Surprised 1.3%
Fear 0.7%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Male, 94.1%
Calm 90.2%
Angry 5.2%
Happy 1.4%
Confused 1.3%
Sad 0.7%
Disgusted 0.5%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Female, 99.4%
Sad 49.6%
Calm 34.9%
Angry 4.9%
Fear 3.4%
Disgusted 2.3%
Confused 2.2%
Happy 1.6%
Surprised 1.1%

AWS Rekognition

Age 28-38
Gender Male, 97.5%
Calm 92.8%
Confused 4.9%
Angry 0.9%
Sad 0.7%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Calm 90.7%
Sad 7.3%
Angry 0.7%
Fear 0.5%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 97.8%
Happy 72.7%
Calm 22.6%
Surprised 1.1%
Angry 1%
Confused 0.9%
Disgusted 0.6%
Fear 0.6%
Sad 0.6%

AWS Rekognition

Age 35-43
Gender Female, 93%
Happy 62.8%
Calm 28.5%
Angry 3.2%
Confused 2.6%
Sad 1.1%
Surprised 0.8%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 30-40
Gender Female, 62.7%
Happy 86.1%
Sad 5.3%
Calm 4.8%
Angry 1.1%
Disgusted 0.8%
Confused 0.7%
Surprised 0.7%
Fear 0.5%

AWS Rekognition

Age 20-28
Gender Male, 80.8%
Happy 98.4%
Calm 0.8%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 76%
Calm 91.6%
Sad 2.1%
Angry 1.9%
Happy 1.7%
Surprised 1.3%
Confused 0.8%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 36-44
Gender Female, 92.3%
Happy 99%
Calm 0.4%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 89.4%
Calm 97.6%
Confused 1%
Sad 0.5%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.9%
Calm 88.8%
Sad 4%
Angry 3.2%
Confused 1.3%
Fear 0.8%
Surprised 0.7%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Female, 99.6%
Calm 87%
Happy 3.3%
Surprised 2.8%
Confused 2.7%
Angry 1.4%
Sad 1.1%
Fear 0.9%
Disgusted 0.8%

AWS Rekognition

Age 33-41
Gender Female, 99.7%
Sad 83.4%
Calm 5.1%
Confused 4.3%
Happy 2.3%
Angry 1.6%
Fear 1.3%
Disgusted 1.1%
Surprised 0.8%

AWS Rekognition

Age 33-41
Gender Male, 88.7%
Sad 70.2%
Fear 12.7%
Calm 8.7%
Disgusted 2.6%
Confused 1.9%
Happy 1.6%
Surprised 1.4%
Angry 0.9%

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Sad 90.1%
Calm 4.7%
Happy 1.6%
Surprised 1.5%
Confused 0.7%
Fear 0.7%
Disgusted 0.4%
Angry 0.4%

AWS Rekognition

Age 42-50
Gender Female, 94%
Happy 88.3%
Calm 4%
Surprised 3.2%
Disgusted 1.6%
Fear 1.5%
Sad 0.6%
Confused 0.4%
Angry 0.4%

AWS Rekognition

Age 35-43
Gender Female, 99.5%
Calm 90.9%
Sad 5.7%
Confused 1%
Happy 0.7%
Surprised 0.7%
Angry 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 80.3%
Calm 81.5%
Confused 6%
Disgusted 4.4%
Sad 4.2%
Angry 2.3%
Happy 0.8%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Female, 96.7%
Calm 87.2%
Happy 7%
Sad 2.2%
Surprised 1%
Angry 0.9%
Confused 0.8%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 37-45
Gender Female, 99.6%
Calm 59.5%
Angry 11.6%
Happy 10.8%
Sad 10.6%
Confused 3.7%
Fear 1.7%
Surprised 1.4%
Disgusted 0.8%

AWS Rekognition

Age 35-43
Gender Female, 99.8%
Happy 53.7%
Calm 22.9%
Sad 17.4%
Angry 2.1%
Disgusted 1.4%
Surprised 1.2%
Confused 0.8%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Female, 97.9%
Happy 81.2%
Calm 9.7%
Angry 2.1%
Disgusted 2.1%
Sad 1.8%
Fear 1.4%
Surprised 1.1%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Female, 94.6%
Sad 44.1%
Angry 24.2%
Calm 19.4%
Happy 5.9%
Fear 2.1%
Surprised 1.8%
Confused 1.5%
Disgusted 1.1%

AWS Rekognition

Age 28-38
Gender Male, 97.2%
Calm 61.9%
Happy 26.5%
Sad 3%
Disgusted 2.4%
Surprised 2%
Angry 2%
Confused 1.4%
Fear 0.9%

AWS Rekognition

Age 19-27
Gender Male, 52.6%
Sad 98.5%
Calm 0.9%
Happy 0.3%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 24-34
Gender Female, 98.9%
Calm 87.7%
Sad 6.4%
Happy 1.8%
Confused 1.7%
Surprised 0.9%
Angry 0.7%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Female, 99.7%
Calm 91.9%
Happy 3.9%
Sad 1.4%
Confused 0.9%
Surprised 0.6%
Angry 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 99.8%
Happy 94.4%
Calm 2.1%
Surprised 1.2%
Sad 0.7%
Angry 0.7%
Disgusted 0.4%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.1%
Sad 88.5%
Calm 4.7%
Fear 3.4%
Angry 1.3%
Confused 0.7%
Disgusted 0.5%
Surprised 0.5%
Happy 0.4%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Happy 95.8%
Calm 1.2%
Surprised 0.8%
Confused 0.5%
Sad 0.5%
Disgusted 0.5%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 31-41
Gender Female, 100%
Calm 50.4%
Confused 30.7%
Sad 5.4%
Angry 4.5%
Fear 4.3%
Surprised 1.7%
Disgusted 1.7%
Happy 1.3%

AWS Rekognition

Age 33-41
Gender Female, 78.3%
Happy 33.1%
Sad 23.8%
Calm 15.5%
Disgusted 15.3%
Angry 4.6%
Fear 3.1%
Surprised 2.9%
Confused 1.7%

AWS Rekognition

Age 22-30
Gender Male, 74.7%
Calm 95.1%
Happy 1.8%
Surprised 1%
Confused 0.9%
Sad 0.7%
Angry 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Female, 53.8%
Calm 40.3%
Fear 13.4%
Surprised 13.2%
Sad 11.6%
Angry 11.6%
Happy 6.4%
Disgusted 2.3%
Confused 1.3%

AWS Rekognition

Age 7-17
Gender Female, 87.5%
Happy 49.3%
Sad 37.2%
Calm 8.1%
Disgusted 1.8%
Confused 1%
Surprised 0.9%
Fear 0.9%
Angry 0.8%

AWS Rekognition

Age 6-14
Gender Male, 99%
Sad 56.7%
Calm 26%
Happy 8.2%
Angry 2.9%
Fear 2.9%
Surprised 1.6%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 18-24
Gender Male, 98%
Sad 47.5%
Angry 30.7%
Calm 17.9%
Confused 1.5%
Happy 0.7%
Surprised 0.6%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 37-45
Gender Male, 98.8%
Calm 75.7%
Happy 8.8%
Angry 7.9%
Surprised 3%
Sad 1.5%
Confused 1.4%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 23-31
Gender Female, 100%
Sad 66.6%
Calm 19.8%
Surprised 4.3%
Happy 3.5%
Angry 2.1%
Confused 1.3%
Fear 1.2%
Disgusted 1.2%

AWS Rekognition

Age 29-39
Gender Female, 98.3%
Happy 77%
Sad 14.4%
Calm 4.8%
Fear 1.6%
Angry 0.8%
Surprised 0.7%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Male, 98.2%
Happy 60.4%
Calm 13.8%
Disgusted 8.5%
Fear 6.6%
Sad 4.5%
Surprised 3.4%
Confused 1.5%
Angry 1.4%

AWS Rekognition

Age 25-35
Gender Female, 85.8%
Calm 98.3%
Sad 1.3%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 87.1%
Sad 56.8%
Calm 40.8%
Angry 0.7%
Confused 0.6%
Disgusted 0.4%
Fear 0.4%
Surprised 0.3%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Female, 80.5%
Happy 33%
Surprised 19.2%
Disgusted 15.1%
Fear 12.6%
Angry 8.6%
Sad 4.5%
Calm 4.5%
Confused 2.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.7%
Person 99.5%
Person 99.4%
Person 99.1%
Person 98.4%
Person 97.1%
Person 97.1%
Person 96%
Person 95.6%
Person 94.3%
Person 91%
Person 88.2%
Person 84.3%
Person 75.7%
Person 62.7%
Person 61.7%
Person 56.8%

Text analysis

Amazon

HS