Human Generated Data

Title

Untitled (family portrait in front of fireplace)

Date

c. 1970

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.540

Human Generated Data

Title

Untitled (family portrait in front of fireplace)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 98.9
Person 98.9
Furniture 98.6
Person 98.6
Person 97.9
Couch 97.7
Tie 94.8
Accessory 94.8
Accessories 94.8
People 89.1
Clothing 75.7
Apparel 75.7
Cabinet 60.5
Family 59.2
Indoors 58.7
Room 58.7
Wood 56.3

Imagga
created on 2022-02-26

mother 73.5
parent 65.7
family 56.1
home 55.1
father 40.6
kin 39
child 38.2
male 37.4
happy 37
together 35.1
couple 34.9
people 34.6
man 33.6
senior 30
grandma 29.6
husband 28.6
dad 28.2
indoors 28.1
couch 27.1
love 26.8
happiness 25.9
adult 25.4
son 25.3
lifestyle 25.3
children 24.6
smiling 24.6
grandfather 24.2
boy 23.5
casual 22.9
wife 21.8
kid 21.3
daughter 21.1
smile 20.7
mature 20.5
fun 20.2
cheerful 19.5
elderly 19.2
sitting 18.9
room 18.4
grandmother 17.6
old 17.4
portrait 16.8
retired 16.5
loving 16.2
living 16.1
person 15.7
indoor 15.5
retirement 15.4
sofa 15.3
two 15.3
women 15
domestic 14.7
parents 14.7
playing 14.6
interior 14.2
30s 13.5
childhood 13.4
house 13.4
darling 13.2
expression 12.8
face 12.8
blond 12.6
married 12.5
little 12.4
kids 12.3
men 12
boys 11.6
mom 11.6
holding 11.6
baby 11.4
togetherness 11.3
group 11.3
relationship 11.2
20s 11
living room 10.8
parenthood 10.8
bonding 10.7
four 10.6
attractive 10.5
laughing 10.4
looking 10.4
joyful 10.1
cute 10.1
joy 10
color 10
generations 9.9
brother 9.8
handsome 9.8
hug 9.7
generation 9.6
clothing 9.2
leisure 9.1
gray 9
grandchild 8.9
grandparent 8.9
70s 8.9
two people 8.8
affectionate 8.7
mid adult 8.7
enjoying 8.5
help 8.4
horizontal 8.4
health 8.3
care 8.2
relaxing 8.2
life 8.1
4 7.8
their 7.8
40s 7.8
middle aged 7.8
relaxed 7.5
active 7.2

Google
created on 2022-02-26

Door 86.3
Vintage clothing 76.7
Toddler 73.8
Smile 73.1
Event 71.6
Happy 71.6
Child 71.1
Suit 70
Room 69.8
Classic 68.1
Formal wear 67.5
Family taking photos together 66.4
Flash photography 66.3
Home door 64.6
Sitting 63.6
Stock photography 62.1
Fun 61.3
Art 59.9
Chair 59.7
Baby 59.5

Microsoft
created on 2022-02-26

person 99.2
wall 98.8
human face 97.5
clothing 97.3
indoor 96.3
baby 94.8
toddler 90.2
smile 90.1
woman 74.1
text 68.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 98.6%
Calm 90.9%
Happy 5.6%
Surprised 1.1%
Confused 0.8%
Angry 0.6%
Disgusted 0.5%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Happy 97.7%
Confused 0.7%
Disgusted 0.4%
Angry 0.4%
Calm 0.3%
Surprised 0.2%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 1-7
Gender Female, 99.8%
Happy 98.8%
Calm 0.5%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 94.8%

Captions

Microsoft

a man and a woman posing for a picture 91.8%
a man and woman posing for a picture 89.2%
a woman posing for a picture 89.1%