Human Generated Data

Title

Untitled (family in living room, Derry, New Hampshire)

Date

1954, printed later

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.45

Human Generated Data

Title

Untitled (family in living room, Derry, New Hampshire)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1954, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.45

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Tie 97
Accessories 97
Accessory 97
Person 96.7
Person 96.6
Person 95.7
Person 94.8
Furniture 94.5
People 91.4
Clothing 86.8
Apparel 86.8
Couch 85.8
Living Room 83.8
Room 83.8
Indoors 83.8
Tie 82
Rug 81.6
Face 76.6
Tree 75.7
Plant 75.7
Shoe 70.4
Footwear 70.4
Kid 64.3
Child 64.3
Home Decor 62.2
Girl 59.7
Female 59.7
Baby 59
Portrait 57.9
Photography 57.9
Photo 57.9

Clarifai
created on 2023-10-25

people 100
group 99.4
child 99.2
adult 98.1
family 97.4
two 97
woman 96.7
three 96.7
offspring 96
portrait 95.9
son 95.2
wear 94.5
group together 93.7
nostalgia 93.5
man 93.2
baby 92.8
retro 91.2
furniture 91.1
monochrome 90.8
leader 90.1

Imagga
created on 2022-01-08

child 27.8
people 25.1
person 23.9
happy 20.7
adult 18.8
attractive 17.5
portrait 17.5
man 17.5
kin 16.9
hair 16.6
fashion 15.8
smile 15.7
face 14.9
happiness 14.9
newspaper 14.5
cute 14.3
childhood 14.3
fun 14.2
brunette 13.9
male 13.7
expression 13.6
pretty 13.3
kid 12.4
product 12.1
children 11.8
model 11.7
smiling 11.6
family 11.6
looking 11.2
style 11.1
paint 10.9
dress 10.8
brother 10.7
retro 10.6
old 10.4
lifestyle 10.1
creation 9.9
school 9.9
art 9.8
little 9.7
couple 9.6
women 9.5
studio 9.1
girls 9.1
vintage 9.1
holding 9.1
salon 9
one 9
mother 8.7
love 8.7
play 8.6
professional 8.6
black 8.5
casual 8.5
hand 8.4
joy 8.3
teen 8.3
human 8.2
cheerful 8.1
interior 8
indoors 7.9
drawing 7.9
boy 7.8
color 7.8
room 7.7
men 7.7
modern 7.7
youth 7.7
daughter 7.7
two 7.6
elegance 7.6
lady 7.3
posing 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 99.9
clothing 96.9
person 96.2
baby 91.5
toddler 88.4
human face 85.9
smile 71.4
boy 53.2
posing 52.7
old 51.9
vintage 27

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Happy 99.7%
Angry 0.1%
Fear 0%
Disgusted 0%
Surprised 0%
Sad 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 87.5%
Disgusted 5.9%
Surprised 3.7%
Angry 1.3%
Fear 0.6%
Confused 0.5%
Calm 0.3%
Sad 0.2%

AWS Rekognition

Age 0-3
Gender Female, 89.6%
Calm 42%
Confused 29.6%
Surprised 16.2%
Disgusted 5.3%
Angry 3.9%
Sad 1.2%
Happy 1%
Fear 0.6%

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Happy 99.7%
Disgusted 0.1%
Surprised 0.1%
Calm 0.1%
Angry 0%
Confused 0%
Sad 0%
Fear 0%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 97%
Rug 81.6%
Shoe 70.4%

Categories

Imagga

paintings art 97.5%
people portraits 2.4%

Text analysis

Amazon

74
230
Studio
New
Hampshire
Francis
Francis J. Sullivan Studio
1954
Derry, New Hampshire
J.
Sullivan
Derry,
41%
12

Google

74 41% Francis J. Sullivan Studio Derry, New Hampshire 1954 230
74
41%
Francis
J.
Sullivan
Studio
Derry,
New
Hampshire
1954
230