Human Generated Data

Title

Untitled (family portrait, in front of fireplace)

Date

1959

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18826

Human Generated Data

Title

Untitled (family portrait, in front of fireplace)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18826

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Tie 99.5
Accessories 99.5
Accessory 99.5
Human 99.1
Person 99
Person 97.7
Person 97.6
Person 97.6
People 97.1
Person 97
Family 97
Person 96.6
Person 96
Person 94.1
Person 92.2
Clothing 90.8
Apparel 90.8
Suit 79.2
Coat 79.2
Overcoat 79.2
Gown 59.2
Fashion 59.2

Clarifai
created on 2023-10-22

people 99.9
group 99.8
group together 99.2
wedding 97.9
four 97.4
adult 97.2
offspring 96.5
man 96.3
child 96.1
woman 95.4
several 95
three 92.9
actress 92.8
sibling 92.2
family 91.7
five 91.5
leader 91.3
many 91.2
wear 88.9
administration 88.4

Imagga
created on 2022-02-25

groom 40.7
man 34.9
home 33.5
room 31.5
people 30.1
kin 28.2
person 27.6
indoors 27.2
adult 27
couple 27
happiness 25.9
family 24.9
male 24.5
happy 21.3
smiling 21
patient 19.8
lifestyle 17.3
interior 16.8
house 16.7
nurse 16.6
couch 16.4
cheerful 16.3
love 15.8
together 15.8
sitting 15.5
smile 15
child 14.5
women 14.2
indoor 13.7
husband 13.6
hospital 13.6
two 13.6
mother 13
father 12.9
chair 12.8
teacher 12.5
bed 12.3
adults 12.3
boy 12.2
life 12.1
men 12
relaxing 11.8
care 11.5
loving 11.4
portrait 11
20s 11
romantic 10.7
new 10.5
comfortable 10.5
wife 10.4
living 10.4
health 10.4
professional 10.3
wedding 10.1
relaxation 10
color 10
cup 9.9
dress 9.9
attractive 9.8
living room 9.8
daughter 9.7
medical 9.7
bride 9.6
married 9.6
resting 9.5
females 9.5
barbershop 9.4
doctor 9.4
enjoyment 9.4
casual 9.3
dad 9.1
holding 9.1
fun 9
kid 8.9
20 24 years 8.9
break 8.6
togetherness 8.5
relationship 8.4
pretty 8.4
horizontal 8.4
shop 8.3
treatment 8.3
girls 8.2
lady 8.1
group 8.1
romance 8
cushions 7.9
divan 7.9
chairs 7.8
parent 7.8
casual clothing 7.8
cups 7.8
brown hair 7.8
face 7.8
two people 7.8
sofa 7.8
full length 7.8
mid adult 7.7
expression 7.7
case 7.6
talking 7.6
bouquet 7.5
fashion 7.5
bedroom 7.3
domestic 7.3
children 7.3
classroom 7.2
looking 7.2
holiday 7.2
medicine 7

Google
created on 2022-02-25

Hairstyle 95.1
Black 89.8
Fashion 87.8
Dress 87.6
Happy 80.8
Smile 79
Vintage clothing 78.2
Wedding dress 76.5
Suit 74.9
Monochrome photography 74
Event 73.9
Formal wear 73.1
Monochrome 72.9
Room 70.9
Comfort 68.4
Bridal clothing 67.9
Toddler 67.9
Sitting 65.2
Child 64.9
Classic 64.5

Microsoft
created on 2022-02-25

wall 98.9
person 97.1
clothing 96.1
indoor 94.3
wedding dress 93.8
woman 91.8
smile 89.2
human face 88
bride 86.9
family 85.7
posing 80.9
dress 75.6
people 70.7
group 69.3
man 67.9
text 67.3
old 61.8
wedding 59.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 95.5%
Happy 99.2%
Confused 0.4%
Calm 0.2%
Surprised 0.1%
Sad 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Happy 99.5%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Calm 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 89.9%
Confused 6.6%
Calm 2.3%
Surprised 0.5%
Fear 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-3
Gender Female, 84%
Happy 93.4%
Calm 3.4%
Surprised 2.5%
Confused 0.3%
Fear 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Female, 100%
Happy 99.4%
Surprised 0.3%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 2-10
Gender Male, 72.3%
Happy 99.9%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Calm 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 98.9%
Angry 0.8%
Calm 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 19-27
Gender Female, 98.8%
Happy 91%
Surprised 3.1%
Angry 1.5%
Confused 1.4%
Disgusted 1.3%
Fear 0.9%
Sad 0.4%
Calm 0.4%

AWS Rekognition

Age 6-16
Gender Male, 98.7%
Happy 98.9%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Calm 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 9-17
Gender Female, 100%
Happy 99.3%
Disgusted 0.3%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%
Calm 0%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 11
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie
Person
Suit
Tie 99.5%
Person 99%
Person 97.7%
Person 97.6%
Person 97.6%
Person 97%
Person 96.6%
Person 96%
Person 94.1%
Person 92.2%
Suit 79.2%

Categories

Imagga

people portraits 98.3%
events parties 1.1%