Human Generated Data

Title

Untitled (family portrait with seventeen children)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10378

Human Generated Data

Title

Untitled (family portrait with seventeen children)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 99.1
Person 99
Person 98.7
Person 98.1
Person 97.7
Kindergarten 97.4
Person 97.3
Person 96.3
Person 95.7
Tie 94.9
Accessories 94.9
Accessory 94.9
Person 94.6
Tie 92.6
Person 88
Person 87.4
Person 85.7
Person 85.3
People 84.7
School 82.7
Tie 82.3
Classroom 82.2
Indoors 82.2
Room 82.2
Person 80.9
Person 79.5
Person 76
Person 66.9
Person 65.5
Tie 63.3
Coat 62.8
Suit 62.8
Overcoat 62.8
Clothing 62.8
Apparel 62.8
Person 60.5

Imagga
created on 2022-01-23

nurse 100
people 38.4
man 27.5
person 27
men 24.9
group 24.1
male 24.1
adult 23.2
women 22.9
team 20.6
happy 20
business 20
businessman 19.4
room 18.2
professional 18.1
hospital 16.7
home 16.7
smiling 15.9
together 15.7
work 14.9
couple 13.9
businesswoman 13.6
family 13.3
meeting 13.2
indoors 13.2
cheerful 13
office 12.8
uniform 12.8
portrait 12.3
child 12.1
smile 12.1
teamwork 12
job 11.5
standing 11.3
executive 11
suit 10.8
worker 10.7
medical 10.6
fun 10.5
looking 10.4
education 10.4
love 10.2
happiness 10.2
school 10
girls 10
life 9.9
attractive 9.8
to 9.7
interior 9.7
working 9.7
success 9.6
casual 9.3
kin 9.1
silhouette 9.1
holding 9.1
clothing 9
classroom 9
human 9
new 8.9
mother 8.7
lifestyle 8.7
corporate 8.6
chair 8.5
student 8.5
friendship 8.4
pretty 8.4
boy 7.8
table 7.8
modern 7.7
boss 7.6
health 7.6
two 7.6
talking 7.6
businesspeople 7.6
career 7.6
fashion 7.5
friends 7.5
manager 7.4
care 7.4
inside 7.4
occupation 7.3
black 7.3
indoor 7.3
children 7.3
teacher 7.2
cute 7.2

Google
created on 2022-01-23

Family taking photos together 78.7
Family reunion 78.2
Font 75.5
Vintage clothing 74.9
Event 73.2
Team 72
Hat 71.7
Smile 69.9
Child 68.8
Happy 65.9
Toddler 65.5
Stock photography 63.2
Fun 62.3
Art 60.8
Crew 60.6
Monochrome 60.2
Room 58.6
Family pictures 58.6
History 58.1
Classic 57.8

Microsoft
created on 2022-01-23

posing 100
person 99.9
group 99.1
clothing 97.6
wall 96.4
smile 96.4
standing 90.5
boy 88
team 81.2
human face 75.6
old 72.6
footwear 70.9
child 54.6
clothes 17.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Female, 99.4%
Calm 97.8%
Angry 0.7%
Confused 0.6%
Sad 0.3%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Female, 68.2%
Calm 97.4%
Happy 0.7%
Angry 0.5%
Sad 0.5%
Confused 0.4%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 4-12
Gender Male, 100%
Happy 45.8%
Calm 30.1%
Confused 13.3%
Surprised 6.8%
Sad 2.3%
Angry 1.1%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 4-12
Gender Male, 99.7%
Happy 99.7%
Calm 0.1%
Confused 0%
Angry 0%
Surprised 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 82.4%
Calm 6.2%
Surprised 4.6%
Fear 2.8%
Confused 1.9%
Angry 1.4%
Disgusted 0.3%
Sad 0.3%

AWS Rekognition

Age 1-7
Gender Male, 99.7%
Calm 38.5%
Happy 36.8%
Confused 11.1%
Sad 5.4%
Surprised 4.4%
Angry 2%
Fear 0.9%
Disgusted 0.9%

AWS Rekognition

Age 6-12
Gender Male, 100%
Happy 99.1%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 66.4%
Calm 95.5%
Sad 1.1%
Confused 1%
Surprised 0.7%
Happy 0.4%
Disgusted 0.4%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Calm 75.9%
Confused 9.5%
Fear 7.5%
Surprised 2.8%
Sad 1.7%
Angry 1.5%
Happy 0.6%
Disgusted 0.5%

AWS Rekognition

Age 2-10
Gender Male, 100%
Calm 99%
Confused 0.5%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Male, 100%
Happy 92.7%
Confused 3.2%
Calm 2%
Angry 1.1%
Sad 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 92.5%
Confused 3.2%
Surprised 1.7%
Angry 1%
Calm 0.9%
Fear 0.3%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 0-4
Gender Male, 88.4%
Calm 99.4%
Sad 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 69.4%
Surprised 8.8%
Calm 8.1%
Angry 5.5%
Confused 4.7%
Disgusted 1.4%
Sad 1.3%
Fear 0.8%

AWS Rekognition

Age 6-14
Gender Female, 99.1%
Happy 47%
Calm 34.6%
Surprised 5.8%
Sad 4.9%
Confused 4.5%
Angry 1.8%
Disgusted 0.8%
Fear 0.8%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 94.2%
Surprised 1.3%
Calm 1.3%
Angry 1.3%
Confused 1%
Fear 0.5%
Disgusted 0.3%
Sad 0.2%

AWS Rekognition

Age 9-17
Gender Female, 53.6%
Happy 99.6%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Confused 0.1%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 40-48
Gender Male, 98.9%
Confused 45%
Sad 20.8%
Calm 16%
Disgusted 10.9%
Surprised 2.5%
Angry 1.8%
Fear 1.8%
Happy 1.1%

AWS Rekognition

Age 0-4
Gender Female, 99.9%
Sad 98.9%
Angry 0.3%
Calm 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 94.9%
Suit 62.8%

Captions

Microsoft

a group of people posing for a photo 99.1%
a group of people posing for the camera 99%
a group of people posing for a picture 98.9%