Human Generated Data

Title

The Blaine Sergent Family

Date

1946

People

Artist: Russell Lee, American 1903 - 1986

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.595

Human Generated Data

Title

The Blaine Sergent Family

People

Artist: Russell Lee, American 1903 - 1986

Date

1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.595

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.3
Person 99.1
Person 99
Person 97.9
Person 96.9
Person 96.3
Clothing 88.4
Apparel 88.4
Shorts 85.5
Person 81.8
People 77.1
Sitting 71.5
Nature 69.5
Smoke 57.9
Outdoors 56
Shoe 55.2
Footwear 55.2

Clarifai
created on 2023-10-25

people 100
group 99.9
group together 99.6
child 98.7
woman 97
adult 96.1
many 96.1
man 94.7
son 94.4
offspring 94.1
sibling 93.9
four 93.9
family 93.7
leader 92.1
five 91.5
several 91.2
portrait 90
administration 89
three 86
recreation 85

Imagga
created on 2022-01-08

kin 72
man 30.2
people 27.3
child 25.9
person 24.2
family 24
male 22.2
outdoors 20.1
portrait 18.1
father 17
mother 15.9
together 15.8
athlete 14.9
couple 14.8
happy 14.4
love 14.2
adult 13.9
boy 13.9
parent 13.8
outdoor 13.8
men 13.7
sport 13.6
fun 13.5
happiness 13.3
leisure 13.3
world 12.5
daughter 12.4
park 12.3
smiling 12.3
lifestyle 12.3
player 12.2
group 12.1
ballplayer 12.1
girls 11.8
sunset 11.7
room 11.4
walking 11.4
summer 10.9
dad 10.7
old 10.4
beach 10.1
silhouette 9.9
holding 9.9
vacation 9.8
kid 9.7
women 9.5
day 9.4
friendship 9.4
contestant 9.3
joy 9.2
dark 9.2
son 9
sibling 8.9
kids 8.5
children 8.2
active 8.1
classroom 7.7
sky 7.6
life 7.6
field 7.5
friends 7.5
teen 7.3
water 7.3
teenager 7.3
protection 7.3
exercise 7.3
smile 7.1
school 7.1
businessman 7.1
travel 7

Google
created on 2022-01-08

Black 89.5
Shorts 88.6
Adaptation 79.3
Vintage clothing 72.7
Crew 68.7
Event 66.8
Sitting 66.1
Stock photography 62.7
Room 62.6
Monochrome 62.5
History 62.4
Monochrome photography 62.2
House 59.8
Building 58.7
Team 57.9
Smile 57.6
Window 54
Photo caption 51.4
Family 51

Microsoft
created on 2022-01-08

clothing 98.7
posing 96.6
outdoor 92.8
person 92.7
group 92.4
footwear 90.4
smile 87.7
man 81.8
text 80.4
child 77.3
standing 76.1
woman 72
old 70.7
people 59.3
family 15.5
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 100%
Calm 76%
Sad 19%
Angry 1.1%
Fear 1%
Disgusted 1%
Confused 0.9%
Surprised 0.6%
Happy 0.4%

AWS Rekognition

Age 9-17
Gender Male, 72.4%
Calm 68.3%
Sad 30.2%
Confused 0.4%
Angry 0.3%
Surprised 0.3%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Female, 70.2%
Calm 80.1%
Sad 11.3%
Angry 5.9%
Happy 0.7%
Confused 0.7%
Fear 0.6%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 6-14
Gender Male, 100%
Calm 40.5%
Sad 36%
Confused 16.5%
Fear 4%
Disgusted 1.2%
Angry 1%
Surprised 0.5%
Happy 0.3%

AWS Rekognition

Age 42-50
Gender Male, 100%
Sad 78.4%
Confused 10%
Calm 5.3%
Fear 4.4%
Disgusted 0.8%
Surprised 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 2-8
Gender Female, 85.7%
Calm 99.3%
Confused 0.2%
Surprised 0.2%
Sad 0.1%
Fear 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 99.9%
Sad 0.1%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 2-8
Gender Female, 100%
Sad 52.1%
Fear 24.5%
Calm 15.7%
Angry 3%
Disgusted 2.1%
Confused 0.9%
Surprised 0.9%
Happy 0.7%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 55
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 12
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 55.2%

Categories

Imagga

people portraits 98.6%