Human Generated Data

Title

Untitled (family portrait in living room, 50th Anniversary)

Date

1958

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18814

Human Generated Data

Title

Untitled (family portrait in living room, 50th Anniversary)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 100
Clothing 100
Person 99.2
Human 99.2
Person 99.1
Person 98
Person 97.5
Person 97.4
Fashion 97.4
Robe 97.4
Person 97.2
Gown 96.2
Wedding 95.7
Person 95.5
Helmet 95.4
Person 94.6
Wedding Gown 93.6
Bride 93.6
Person 91.5
Dress 91.5
Female 90.8
Helmet 90.1
Person 88.2
Bridegroom 86.6
Person 85
People 83.7
Person 83.1
Face 79.5
Woman 74.7
Door 67.9
Girl 64.9
Overcoat 64.2
Suit 64.2
Coat 64.2
Photography 64.1
Photo 64.1
Portrait 64.1
Kid 60.6
Child 60.6
Housing 60.2
Building 60.2
Couch 59.3
Furniture 59.3
Plant 59.2
Costume 57.8
Meal 56.2
Food 56.2
Person 50.2

Imagga
created on 2022-03-05

kin 88.3
bride 36.5
wedding 33.1
groom 31.7
people 31.2
couple 30.5
love 27.6
married 26.8
dress 26.2
happiness 25.8
man 25.5
happy 23.8
adult 20.8
two 20.3
outdoors 19.5
male 19.1
marriage 19
together 18.4
park 18.1
bouquet 17.9
outdoor 16.8
gown 16.6
person 16.1
smiling 15.9
veil 15.7
summer 15.4
day 14.9
portrait 14.9
family 14.2
church 13.9
smile 13.5
world 12.7
lifestyle 12.3
men 12
women 11.9
active 11.7
bridal 11.7
ceremony 11.6
walking 11.4
joy 10.9
husband 10.6
attractive 10.5
wife 10.4
sport 10.4
life 10.4
celebration 10.4
youth 10.2
face 9.9
fun 9.7
flowers 9.6
friends 9.4
friendship 9.4
girls 9.1
pretty 9.1
fashion 9
suit 9
cheerful 8.9
romantic 8.9
wed 8.8
outside 8.6
wall 8.5
future 8.4
vacation 8.2
religion 8.1
looking 8
newly 7.9
brunette 7.8
flower 7.7
pair 7.6
human 7.5
religious 7.5
leisure 7.5
holding 7.4
emotion 7.4
joyful 7.3
children 7.3
black 7.2
spectator 7.2
romance 7.1
nurse 7.1
child 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

clothing 98.1
person 97.4
wedding dress 95.8
woman 91.3
man 90.9
bride 90.3
dress 87
black and white 81.4
footwear 79.2
people 64.6
text 59.9
group 58.5

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Sad 97%
Angry 0.8%
Calm 0.7%
Happy 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 45-53
Gender Male, 98.5%
Calm 79%
Happy 19.4%
Surprised 0.7%
Sad 0.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Female, 66.7%
Happy 66.7%
Calm 22.6%
Surprised 3.4%
Sad 3.2%
Confused 1.2%
Fear 1.1%
Disgusted 1%
Angry 0.8%

AWS Rekognition

Age 47-53
Gender Male, 93.4%
Happy 92.8%
Calm 4.1%
Surprised 1.6%
Sad 0.4%
Angry 0.3%
Confused 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Angry 50.2%
Sad 13.9%
Surprised 13.8%
Happy 10.2%
Calm 4.1%
Fear 2.9%
Disgusted 2.5%
Confused 2.4%

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Happy 72.4%
Calm 17.2%
Sad 3.5%
Confused 2.1%
Surprised 1.6%
Fear 1.2%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 49-57
Gender Female, 54%
Calm 89.2%
Sad 4.7%
Happy 3.7%
Fear 1.2%
Disgusted 0.5%
Surprised 0.3%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 98.9%
Happy 0.6%
Surprised 0.3%
Disgusted 0.1%
Confused 0%
Sad 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 45-53
Gender Female, 61%
Calm 82.7%
Happy 10.8%
Surprised 2.2%
Fear 2%
Sad 0.8%
Disgusted 0.7%
Angry 0.5%
Confused 0.4%

AWS Rekognition

Age 50-58
Gender Male, 98.9%
Calm 99.7%
Sad 0.1%
Disgusted 0.1%
Happy 0%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 13-21
Gender Male, 53%
Happy 81.6%
Surprised 15.2%
Calm 0.8%
Angry 0.7%
Fear 0.6%
Sad 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Sad 96.9%
Calm 0.7%
Angry 0.7%
Disgusted 0.7%
Confused 0.3%
Fear 0.3%
Surprised 0.2%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Helmet 95.4%
Couch 59.3%

Captions

Microsoft

a group of people standing in a room 94.3%
a group of people standing in front of a window 81.7%
a group of people in a room 81.6%

Text analysis

Amazon

KODAKA-EITW

Google

T3RA
2--XAGO
MJI7--Y T3RA 2--XAGO
MJI7--Y