Human Generated Data

Title

Untitled (children posing around table at birthday party)

Date

1948

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6976

Human Generated Data

Title

Untitled (children posing around table at birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.4
Person 99.4
Person 99.4
Person 98.9
Person 98.6
Person 98.1
Person 95.5
Person 94.7
Person 94.6
Person 94.5
Apparel 92
Shoe 92
Footwear 92
Clothing 92
People 91.5
Room 91
Indoors 91
Person 90.1
Person 77.7
Person 77.5
Person 65.4
Person 60
Kindergarten 56.5
Classroom 56.3
School 56.3
Furniture 56.1
Shoe 50.7

Imagga
created on 2022-01-23

wind instrument 32.5
musical instrument 30
brass 27.5
people 26.7
person 19.1
outfit 18.6
man 17.5
room 16.4
men 16.3
performer 16.3
musician 16.2
adult 16
singer 15
trombone 13.9
group 13.7
business 13.3
kin 13
male 12.8
black 12.1
women 11.8
harmonica 11.4
home 11.2
interior 10.6
indoors 10.5
scene 10.4
entertainer 10.2
indoor 10
holiday 10
classroom 9.8
family 9.8
old 9.7
couple 9.6
free-reed instrument 9.4
decoration 9.4
violin 9.3
portrait 9
fashion 9
dress 9
history 8.9
businessman 8.8
music 8.8
happy 8.8
play 8.6
model 8.5
cornet 8.4
traditional 8.3
vintage 8.3
art 8.2
style 8.2
office 8.1
uniform 8.1
sexy 8
clothing 8
celebration 8
dancer 7.9
standing 7.8
bowed stringed instrument 7.8
ancient 7.8
travel 7.7
sitting 7.7
culture 7.7
youth 7.7
winter 7.7
elegance 7.5
city 7.5
silhouette 7.4
light 7.3
building 7.3
new 7.3
color 7.2
religion 7.2
team 7.2
smile 7.1
teacher 7.1
window 7.1
happiness 7

Google
created on 2022-01-23

Footwear 98
Hairstyle 95.1
Standing 86.4
Window 85
Social group 82.8
Vintage clothing 78.8
Child 76.8
Toddler 76.7
Art 74.8
Event 73.9
Door 72.6
Room 72.4
Plant 71.6
Monochrome 71.4
House 69.9
Classic 68.5
History 66.3
Houseplant 65
Building 64.9
Stock photography 64.5

Microsoft
created on 2022-01-23

person 96.5
clothing 95.9
posing 94.2
text 92
christmas tree 89.5
group 78.3
footwear 71.9
old 61.5
child 54.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 100%
Fear 53.8%
Calm 27.6%
Surprised 12.5%
Angry 1.7%
Confused 1.6%
Disgusted 1.2%
Happy 0.9%
Sad 0.7%

AWS Rekognition

Age 6-16
Gender Male, 88.1%
Calm 98.1%
Surprised 0.6%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 6-12
Gender Male, 58.3%
Calm 97.5%
Sad 1.2%
Angry 0.7%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 94.3%
Sad 2%
Fear 1%
Surprised 0.8%
Disgusted 0.6%
Angry 0.6%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 2-10
Gender Male, 98.3%
Calm 95.7%
Confused 1.9%
Surprised 1.6%
Angry 0.3%
Sad 0.3%
Happy 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 4-10
Gender Female, 100%
Calm 99.2%
Sad 0.3%
Angry 0.3%
Surprised 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 1-7
Gender Female, 64.1%
Calm 67.6%
Fear 11.1%
Sad 8.8%
Surprised 5.6%
Angry 2.8%
Disgusted 1.9%
Confused 1.6%
Happy 0.6%

AWS Rekognition

Age 0-6
Gender Female, 95.8%
Calm 89.2%
Disgusted 2.6%
Angry 2%
Sad 1.9%
Confused 1.5%
Fear 1.2%
Happy 1.1%
Surprised 0.4%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 99.8%
Sad 0.1%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 1-7
Gender Female, 87.1%
Calm 79.5%
Sad 14.8%
Fear 2.9%
Confused 0.9%
Surprised 0.8%
Angry 0.4%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 71.1%
Surprised 18.1%
Fear 3.3%
Sad 3%
Confused 1.3%
Happy 1.3%
Disgusted 1%
Angry 0.9%

AWS Rekognition

Age 4-10
Gender Female, 97.8%
Calm 80.5%
Happy 9.9%
Surprised 4.5%
Confused 2%
Angry 1%
Fear 0.8%
Disgusted 0.7%
Sad 0.7%

AWS Rekognition

Age 1-7
Gender Male, 88.9%
Calm 99.1%
Angry 0.4%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 59-69
Gender Female, 88.1%
Calm 46.8%
Happy 16.3%
Confused 10%
Fear 9.7%
Surprised 5.1%
Disgusted 4.9%
Angry 3.7%
Sad 3.6%

AWS Rekognition

Age 4-10
Gender Female, 99.3%
Calm 74.1%
Sad 10.9%
Surprised 6.3%
Angry 2.6%
Disgusted 2.4%
Fear 1.9%
Confused 1.1%
Happy 0.7%

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 75.1%
Sad 16.4%
Angry 2.9%
Fear 2.3%
Surprised 1.1%
Happy 0.9%
Disgusted 0.9%
Confused 0.4%

AWS Rekognition

Age 2-10
Gender Female, 80.2%
Calm 68.6%
Confused 20.9%
Angry 3.1%
Surprised 2.5%
Happy 2.3%
Sad 1.6%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 4-10
Gender Female, 66.3%
Calm 94%
Happy 4.4%
Sad 0.5%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 0-4
Gender Female, 86.1%
Calm 97.8%
Surprised 1.6%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 9-17
Gender Male, 82.3%
Calm 97.2%
Sad 0.9%
Surprised 0.4%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 6-16
Gender Female, 50.5%
Sad 93.8%
Calm 3.5%
Fear 2.3%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 1-7
Gender Female, 99.6%
Calm 87.2%
Angry 4.6%
Sad 3.2%
Fear 1.7%
Disgusted 1.1%
Confused 1%
Happy 0.9%
Surprised 0.3%

AWS Rekognition

Age 0-6
Gender Female, 89.6%
Calm 61.4%
Sad 28%
Fear 9.2%
Disgusted 0.4%
Happy 0.3%
Confused 0.3%
Angry 0.3%
Surprised 0.2%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 92%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of people posing for a picture 97%
a group of people posing for the camera 96.9%

Text analysis

Google