Human Generated Data

Title

Untitled (wedding group portrait with cake, Brookline, Massachusetts)

Date

1950, printed later

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.969

Human Generated Data

Title

Untitled (wedding group portrait with cake, Brookline, Massachusetts)

People

Artist: Samuel Cooper, American active 1950s

Date

1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 100
Apparel 100
Human 99
Person 99
Person 98.6
Person 97.2
Fashion 97.2
Robe 97.2
Person 96.9
Gown 96.2
Wedding 96.1
Person 95.2
Person 95.2
Person 94.8
Person 94.3
Wedding Gown 93.8
Bride 93.8
Person 91.9
Shoe 86
Footwear 86
Suit 82.3
Overcoat 82.3
Coat 82.3
People 79.4
Female 63
Suit 63
Suit 60.9
Bridegroom 58.6

Imagga
created on 2021-12-14

kin 100
people 31.8
couple 24.4
man 22.2
male 19.1
family 18.7
person 17.2
happy 16.9
together 16.6
portrait 16.2
two 16.1
groom 15.4
smiling 15.2
bride 14.4
old 13.9
dress 13.5
women 13.4
happiness 13.3
child 13
men 12.9
wedding 12.9
mother 12.7
love 12.6
adult 12
outdoors 11.2
home 11.2
sitting 11.2
musical instrument 11
children 10.9
girls 10
fashion 9.8
cheerful 9.7
bouquet 9.4
friends 9.4
percussion instrument 9.4
holiday 9.3
face 9.2
standing 8.7
boy 8.7
husband 8.7
marimba 8.6
marriage 8.5
outdoor 8.4
tradition 8.3
park 8.2
religion 8.1
group 8.1
romantic 8
lifestyle 7.9
father 7.9
smile 7.8
travel 7.7
outside 7.7
culture 7.7
daughter 7.6
walking 7.6
senior 7.5
human 7.5
friendship 7.5
church 7.4
new 7.3
aged 7.2
color 7.2
room 7.2
history 7.2
to 7.1
day 7.1

Google
created on 2021-12-14

Footwear 98.1
Coat 92.6
Black 89.7
Smile 85.2
Dress 84
Wedding dress 82.8
Suit 82.8
Bride 78.6
Formal wear 76.5
Vintage clothing 75.5
Classic 75.4
Event 73.8
Monochrome photography 72.3
House 70.3
Family reunion 70.3
Monochrome 69.8
History 63.5
Stock photography 61.9
Tree 60.2
Plant 59.6

Microsoft
created on 2021-12-14

person 99.9
grass 99.3
clothing 96.1
outdoor 92.9
dress 91.8
woman 89.2
posing 88
standing 87.6
wedding dress 87.4
man 85.7
suit 84
group 81.7
people 81
smile 79.6
bride 78.8
old 50.8
clothes 21.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 90%
Calm 93.3%
Angry 2.6%
Happy 1.5%
Sad 0.9%
Surprised 0.8%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 23-35
Gender Female, 99.3%
Happy 99.3%
Surprised 0.4%
Calm 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Sad 0%

AWS Rekognition

Age 39-57
Gender Male, 98.6%
Happy 68.8%
Calm 11.4%
Angry 9.7%
Surprised 3.3%
Disgusted 2.6%
Fear 2.3%
Confused 1.1%
Sad 0.8%

AWS Rekognition

Age 52-70
Gender Female, 94.4%
Disgusted 50%
Angry 30.5%
Calm 8%
Happy 3.4%
Surprised 3%
Fear 2%
Confused 1.9%
Sad 1.1%

AWS Rekognition

Age 36-54
Gender Male, 98.9%
Happy 99.8%
Calm 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Surprised 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 50-68
Gender Male, 86.8%
Calm 95.7%
Sad 3.8%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 40-58
Gender Female, 97.1%
Calm 82.5%
Happy 15.6%
Sad 0.4%
Surprised 0.4%
Fear 0.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.1%

AWS Rekognition

Age 26-40
Gender Female, 98.5%
Happy 97.5%
Fear 0.5%
Surprised 0.5%
Disgusted 0.4%
Confused 0.4%
Angry 0.3%
Calm 0.2%
Sad 0.2%

AWS Rekognition

Age 39-57
Gender Male, 88.8%
Calm 83.5%
Angry 7.3%
Disgusted 2.4%
Sad 2.3%
Happy 1.9%
Surprised 1.3%
Fear 0.7%
Confused 0.6%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 62
Gender Female

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Shoe 86%
Suit 82.3%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people standing in front of a crowd posing for the camera 96.5%
a group of people posing for a picture 96.4%

Text analysis

Amazon

9090
P101
(88) 9090 P101
(88)

Google

8) 9070 PIo1
8)
9070
PIo1