Human Generated Data

Title

Untitled (group portrait of young schoolchildren with teacher)
Date

1952-1953
People

Artist: Orrion Barger, American active 1913 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6699

Human Generated Data

Title

Untitled (group portrait of young schoolchildren with teacher)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1952-1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 99.5
Person 99.5
Person 99.2
Person 99
Person 98.8
Person 98.5
Person 97.8
Person 97.2
Person 96.4
Shoe 95.8
Footwear 95.8
Clothing 95.8
Apparel 95.8
Person 93.9
Person 92.8
Person 86.8
Person 84.9
People 83.1
Person 78.8
Person 78.7
Room 72.1
Indoors 72.1
Female 70.4
Kindergarten 68.3
School 67.2
Kid 66.7
Child 66.7
Classroom 63.7
Person 62.5
Face 61.9
Shoe 59.6
Shoe 57
Person 54.5

Imagga
created on 2022-01-22

kin 61.9
classroom 56.6
room 46.2
child 39
happy 32.6
smiling 32.5
people 31.8
family 29.3
person 27.4
group 25.8
mother 25.3
kid 23
man 22.2
children 20.9
home 20.7
together 20.1
portrait 20
boy 20
smile 19.9
daughter 19.6
male 19.5
happiness 18.8
fun 18
childhood 17.9
cheerful 17.9
adult 17.1
women 16.6
girls 16.4
school 16.3
love 15.8
education 15.6
father 15.5
team 15.2
parent 15.1
cute 15.1
holding 14.8
men 14.6
youth 14.5
lifestyle 14.4
teacher 14.4
casual 14.4
kids 14.1
friends 14.1
standing 13.9
looking 13.6
son 13.2
diversity 12.5
indoors 12.3
student 12.2
friendship 12.2
attractive 11.9
teen 11
brother 10.6
nurse 10.6
pretty 10.5
couple 10.4
color 10
life 9.8
little 9.7
boys 9.7
looking camera 9.6
sibling 9.4
joy 9.2
business 9.1
businesswoman 9.1
professional 8.9
new 8.9
businessman 8.8
students 8.8
face 8.5
two 8.5
house 8.4
teamwork 8.3
20s 8.2
indoor 8.2
teenager 8.2
blond 8.1
interior 8
buddy 7.9
sitting 7.7
class 7.7
30s 7.7
husband 7.6
sit 7.6
senior 7.5
baby 7.5
playing 7.3
success 7.2
dress 7.2
clothing 7.1
to 7.1
working 7.1
day 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Dress 87.2
Suit 79.1
Picture frame 78.9
Font 75.1
Event 74
Vintage clothing 73.6
Classic 70.2
Crew 70
Team 69.6
Child 67.2
History 65.2
Uniform 64.2
Stock photography 62.9
Room 60.3
Monochrome 59.6
Art 58.8
Retro style 54.9
Oval 54.5
Family 54.5

Microsoft
created on 2022-01-22

posing 100
person 100
wall 99.7
clothing 98.4
group 98.4
text 96.2
smile 96.1
boy 93.3
standing 92.5
young 80.7
human face 78.8
child 74.4
school 71.6
team 68.2
footwear 67

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 98.3%
Surprised 1%
Angry 0.2%
Calm 0.2%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.5%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%
Calm 0%
Sad 0%

AWS Rekognition

Age 10-18
Gender Male, 99.9%
Calm 79.5%
Happy 19.2%
Confused 0.6%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 4-12
Gender Male, 100%
Happy 74.2%
Calm 25.1%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 6-16
Gender Female, 96.6%
Happy 70.1%
Surprised 19.1%
Calm 7.6%
Angry 0.9%
Fear 0.7%
Confused 0.7%
Disgusted 0.6%
Sad 0.3%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Happy 99.2%
Surprised 0.5%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 4-10
Gender Female, 99.9%
Happy 99.1%
Calm 0.4%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 4-12
Gender Male, 100%
Happy 98.9%
Calm 0.3%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 6-12
Gender Female, 86.7%
Happy 97.1%
Calm 1.5%
Surprised 0.5%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 9-17
Gender Male, 97.9%
Calm 74.9%
Happy 21.7%
Surprised 1%
Confused 0.9%
Angry 0.6%
Disgusted 0.5%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 2-10
Gender Male, 100%
Calm 84.7%
Happy 11.2%
Confused 1.9%
Angry 0.9%
Sad 0.6%
Disgusted 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Happy 99.4%
Surprised 0.2%
Calm 0.2%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 55.9%
Calm 26.9%
Disgusted 4.5%
Angry 3.4%
Surprised 3.3%
Confused 3%
Sad 1.9%
Fear 1.2%

AWS Rekognition

Age 6-16
Gender Male, 96.7%
Calm 59.6%
Happy 24.5%
Confused 5.1%
Surprised 4.8%
Fear 1.9%
Disgusted 1.8%
Angry 1.3%
Sad 1%

AWS Rekognition

Age 2-10
Gender Female, 75.2%
Happy 98.3%
Calm 0.6%
Surprised 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Female, 100%
Calm 29.1%
Happy 23.9%
Surprised 19.9%
Disgusted 12%
Confused 9.1%
Angry 2.3%
Sad 1.9%
Fear 1.8%

AWS Rekognition

Age 4-10
Gender Female, 99.4%
Calm 98.8%
Surprised 0.4%
Confused 0.3%
Angry 0.2%
Sad 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Female, 99.7%
Happy 38%
Calm 20.7%
Confused 13.4%
Disgusted 9.1%
Surprised 8.4%
Angry 3.9%
Fear 3.5%
Sad 3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 95.8%

Captions

Microsoft

Virginia Weidler et al. posing for a photo 98.6%
Virginia Weidler et al. posing for the camera 98.5%
Virginia Weidler et al. posing for a picture 98.4%