Human Generated Data

Title

Untitled (family with dog)

Date

1960s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.632

Human Generated Data

Title

Untitled (family with dog)

People

Artist: Bachrach Studios, founded 1868

Date

1960s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.8
Chair 99.6
Person 99
Human 99
Couch 98.7
Person 98.1
Person 94.5
Tie 94.2
Accessories 94.2
Accessory 94.2
Person 93.1
Person 91
Person 90.2
Sitting 86.4
Coat 82.4
Apparel 82.4
Suit 82.4
Overcoat 82.4
Clothing 82.4
People 80.4
Suit 74.7
Tie 71.7
Living Room 71.5
Indoors 71.5
Room 71.5
Animal 69.8
Canine 69.8
Mammal 69.8
Tie 65.7
Pet 64.1
Flooring 59.7
Suit 50.6

Imagga
created on 2022-01-09

kin 53.8
home 39.9
man 36.3
adult 33.1
couple 30.5
people 28.5
person 28.2
happiness 27.4
indoors 26.4
room 25.6
happy 25.1
male 24.5
family 23.2
mother 22.7
smiling 21.7
love 21.3
groom 19.4
lifestyle 18.1
sitting 18.1
cheerful 17.9
interior 17.7
couch 17.4
indoor 17.4
patient 16.6
father 16.4
smile 15.7
loving 15.3
house 15.1
relationship 15
child 14.8
together 14
women 13.5
daughter 12.8
fun 12.7
husband 12.7
hairdresser 12.6
portrait 12.3
togetherness 12.3
men 12
attractive 11.9
females 11.4
brunette 11.3
boy 11.3
life 11
casual 11
dress 10.9
sofa 10.7
mid adult 10.6
parent 10.6
pretty 10.5
adults 10.4
enjoyment 10.3
dad 10.1
face 10
holding 9.9
care 9.9
salon 9.8
sexy 9.6
girlfriend 9.6
wife 9.5
expression 9.4
chair 9.4
holiday 9.3
girls 9.1
relaxing 9.1
living room 8.8
two people 8.8
full length 8.7
affectionate 8.7
boyfriend 8.7
30s 8.7
married 8.6
clothing 8.6
comfortable 8.6
bed 8.5
enjoying 8.5
son 8.4
mature 8.4
color 8.4
health 8.3
leisure 8.3
fashion 8.3
20s 8.3
window 8.3
children 8.2
case 8.2
style 8.2
aged 8.2
domestic 8.1
romance 8
computer 8
20 24 years 7.9
bright 7.9
day 7.9
brown hair 7.8
two 7.6
talking 7.6
relaxation 7.5
senior 7.5
nurse 7.5
inside 7.4
hospital 7.3
lady 7.3
new 7.3
sick person 7.2
cup 7.2
looking 7.2
handsome 7.1
romantic 7.1
kid 7.1
medical 7.1

Google
created on 2022-01-09

Trousers 96.3
Photograph 94.3
Smile 93.7
Leg 91.1
Black 89.6
Coat 88.8
Dog 86.2
Dress 84.1
Style 84.1
Black-and-white 84
Curtain 78.4
People 78.3
Suit 78.2
Blazer 77.9
Vintage clothing 76.6
Classic 76.1
Formal wear 75.6
Flash photography 74.5
Snapshot 74.3
Monochrome photography 74.2

Microsoft
created on 2022-01-09

person 99.4
clothing 95.8
smile 95.4
woman 84.8
posing 82.6
suit 79.5
dress 77.8
human face 73.3
man 63.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 99.5%
Happy 49.3%
Calm 47.7%
Confused 0.9%
Angry 0.8%
Sad 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 98%
Happy 1.4%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 12-20
Gender Female, 93.3%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 99.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Calm 0.1%

AWS Rekognition

Age 38-46
Gender Female, 99.9%
Calm 95.4%
Happy 1.3%
Surprised 1%
Angry 0.6%
Confused 0.6%
Sad 0.6%
Disgusted 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 94.2%
Suit 82.4%

Captions

Microsoft

a group of people posing for a photo 98.1%
a group of people sitting posing for the camera 98%
a group of people posing for the camera 97.9%