Human Generated Data

Title

Untitled (studio portrait of five-member family standing and sitting against painted backdrop)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3704

Human Generated Data

Title

Untitled (studio portrait of five-member family standing and sitting against painted backdrop)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Clothing 99.5
Apparel 99.5
Human 99.4
Person 99.4
Person 99
Person 98.7
Person 98.4
Person 98.3
Person 97.2
Dress 95.7
Female 93.3
Face 93.3
Tie 89.3
Accessories 89.3
Accessory 89.3
Outdoors 88.3
Tie 86.2
Nature 82.8
People 81.8
Coat 81.2
Shoe 79.3
Footwear 79.3
Girl 77.4
Woman 74
Glasses 69.2
Photo 64.7
Photography 64.7
Kid 64.5
Child 64.5
Portrait 63.7
Overcoat 62.5
Steamer 59.8
Performer 56.3
Sunglasses 55.8
Suit 55.3

Imagga
created on 2022-02-05

kin 47.3
groom 36.5
people 30.7
couple 29.6
person 27.1
adult 24.8
male 23.4
man 22.8
happy 21.9
bride 20.1
happiness 19.6
love 18.9
senior 18.7
home 18.3
women 18.2
men 18
portrait 17.5
together 16.6
married 16.3
dress 16.2
wedding 15.6
two 15.2
family 15.1
husband 14.5
lab coat 14.4
nurse 14.1
smiling 13.7
clothing 13.1
smile 12.8
coat 12.7
wife 12.3
indoors 12.3
mature 12.1
fashion 12.1
mother 11.9
old 11.8
businessman 11.5
marriage 11.4
fun 11.2
day 11
business 10.9
lifestyle 10.8
cheerful 10.6
elderly 10.5
group 10.5
face 9.9
patient 9.8
ceremony 9.7
grandma 9.7
celebration 9.6
friends 9.4
joyful 9.2
gown 9.1
30s 8.6
sitting 8.6
black 8.4
attractive 8.4
camera 8.3
room 8.2
lady 8.1
world 8
sexy 8
water 8
drinking 7.6
casual 7.6
talking 7.6
bouquet 7.5
care 7.4
hair 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

wall 99
smile 95.6
person 94.6
clothing 94.6
human face 94.3
woman 91.6
posing 91.4
standing 87
dress 82.5
text 79.3
wedding dress 79.3
bride 59.9
group 56.5

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 58.3%
Calm 81.8%
Fear 9.9%
Confused 2.3%
Surprised 2.1%
Disgusted 1.3%
Happy 1.2%
Sad 0.9%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Female, 94.5%
Calm 98.4%
Sad 0.6%
Angry 0.3%
Surprised 0.2%
Happy 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.1%
Happy 63.4%
Calm 25.1%
Confused 3.4%
Surprised 2.9%
Disgusted 2%
Sad 1.7%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 30-40
Gender Female, 83.7%
Calm 99%
Surprised 0.7%
Confused 0.1%
Sad 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.8%
Confused 0.1%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 23-33
Gender Female, 79.3%
Calm 98.1%
Sad 0.8%
Surprised 0.4%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.4%
Tie 89.3%
Shoe 79.3%
Suit 55.3%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of people standing in front of a mirror posing for the camera 87.4%
a group of people posing for the camera 87.3%