Human Generated Data

Title

Untitled (family portrait in living room, gathered on and around couch)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6984

Human Generated Data

Title

Untitled (family portrait in living room, gathered on and around couch)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6984

Machine Generated Data

Tags

Amazon
created on 2022-01-23

People 99.5
Human 99.5
Family 99.4
Person 98.9
Person 98.3
Person 98.1
Person 97.5
Person 96.6
Person 96.5
Person 96.3
Person 96.2
Tie 96.1
Accessories 96.1
Accessory 96.1
Person 96
Person 94.9
Person 94.8
Person 94.1
Person 94
Person 93.5
Person 89.7
Tie 88.5
Person 66.5
Suit 61.3
Clothing 61.3
Coat 61.3
Overcoat 61.3
Apparel 61.3

Clarifai
created on 2023-10-27

people 100
group 99.9
child 99.5
portrait 99
son 98.9
family 97.8
sepia 97.6
group together 97.5
centennial 96.3
man 95.9
retro 95.7
adult 95.3
leader 94.4
woman 92.9
many 92.3
nostalgia 92
several 91.8
wear 91.2
offspring 91.2
snapshot 90.7

Imagga
created on 2022-01-23

kin 90.7
people 29.5
couple 24.4
man 22.1
brass 20.2
adult 18.9
bride 18.6
male 18.5
person 18.5
portrait 17.4
dress 17.1
wedding 16.5
wind instrument 15.8
love 15.8
old 15.3
two 14.4
family 14.2
happiness 14.1
bouquet 13.6
happy 13.1
fashion 12.8
smiling 12.3
groom 12.1
cornet 12
musical instrument 11.5
married 11.5
men 11.1
elegance 10.9
face 10.6
attractive 10.5
marriage 10.4
style 10.4
home 10.4
smile 10
romance 9.8
mother 9.7
fun 9.7
together 9.6
black 9.6
celebration 9.6
flowers 9.5
room 9.5
senior 9.4
antique 9
romantic 8.9
bridal 8.7
women 8.7
clothing 8.5
outdoor 8.4
vintage 8.3
outdoors 8.2
group 8
sexy 8
posing 8
husband 7.8
sepia 7.8
ceremony 7.7
statue 7.6
wife 7.6
monument 7.5
decoration 7.4
cheerful 7.3
indoor 7.3
girls 7.3
business 7.3
color 7.2
religion 7.2
interior 7.1
businessman 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wall 99.9
person 98.9
clothing 98.9
posing 97.1
group 94.8
smile 93.6
indoor 92.6
baby 92.4
human face 87.6
toddler 86.3
woman 85.4
old 78.7
family 72.8
text 69.9
boy 63.8
white 62.9
child 62.4
footwear 54.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 99%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Sad 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Male, 100%
Happy 99.6%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 39-47
Gender Female, 100%
Happy 99%
Surprised 0.7%
Angry 0.1%
Fear 0.1%
Calm 0.1%
Confused 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 6-12
Gender Female, 99.6%
Happy 98.3%
Calm 1.2%
Surprised 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 22-30
Gender Female, 100%
Surprised 42.8%
Confused 14.4%
Calm 14%
Happy 10.5%
Fear 7.7%
Angry 5.5%
Sad 3.2%
Disgusted 1.8%

AWS Rekognition

Age 27-37
Gender Female, 100%
Happy 94.3%
Surprised 1.9%
Angry 1.2%
Calm 1%
Confused 0.5%
Disgusted 0.4%
Fear 0.4%
Sad 0.2%

AWS Rekognition

Age 34-42
Gender Female, 100%
Happy 87%
Calm 6.4%
Angry 1.9%
Surprised 1.6%
Fear 1.5%
Disgusted 0.6%
Sad 0.5%
Confused 0.5%

AWS Rekognition

Age 38-46
Gender Male, 100%
Happy 92.9%
Angry 4.5%
Calm 1%
Confused 0.6%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%
Sad 0.2%

AWS Rekognition

Age 26-36
Gender Male, 100%
Happy 99.7%
Calm 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 4-10
Gender Male, 99.1%
Calm 96.3%
Angry 1.3%
Confused 0.7%
Fear 0.6%
Sad 0.5%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-4
Gender Male, 54.8%
Calm 92.1%
Sad 2.4%
Confused 1.9%
Angry 1.1%
Happy 0.7%
Surprised 0.7%
Fear 0.7%
Disgusted 0.4%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 99.5%
Surprised 0.2%
Confused 0.1%
Calm 0.1%
Angry 0.1%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 96.8%
Happy 1.1%
Confused 0.6%
Angry 0.4%
Sad 0.3%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 66-76
Gender Male, 97.1%
Calm 43.3%
Fear 36.3%
Confused 7.4%
Surprised 6.4%
Angry 3.8%
Happy 1.1%
Disgusted 1%
Sad 0.6%

AWS Rekognition

Age 0-6
Gender Male, 81.6%
Calm 60.8%
Surprised 11.2%
Confused 5.3%
Happy 4.9%
Disgusted 4.9%
Fear 4.8%
Angry 4.4%
Sad 3.8%

AWS Rekognition

Age 0-4
Gender Female, 97.7%
Happy 49.1%
Calm 17.9%
Confused 13.6%
Disgusted 6.2%
Angry 5.4%
Sad 4.9%
Surprised 1.7%
Fear 1.3%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 98.9%
Person 98.3%
Person 98.1%
Person 97.5%
Person 96.6%
Person 96.5%
Person 96.3%
Person 96.2%
Person 96%
Person 94.9%
Person 94.8%
Person 94.1%
Person 94%
Person 93.5%
Person 89.7%
Person 66.5%
Tie 96.1%
Tie 88.5%
Suit 61.3%

Categories