Human Generated Data

Title

Untitled (four children)
Date

c. 1950
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.769

Human Generated Data

Title

Untitled (four children)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 98.9
Person 98.6
Person 97.6
Table Lamp 97.4
People 87.2
Furniture 85.3
Lamp 70.6
Couch 67.7
Family 66
Lampshade 56.7

Imagga
created on 2022-01-23

family 44.5
child 38.4
nurse 36
man 35.6
home 35.1
male 34.8
father 34
military uniform 33.6
mother 30.3
kin 29.6
happy 29.4
parent 29.1
uniform 28.7
people 26.8
clothing 26.7
husband 24.8
couple 24.4
innocent 24.4
kid 23.9
person 23.4
smiling 23.1
happiness 21.9
wife 21.8
senior 21.6
adult 20.2
dad 20
love 19.7
baby 19.6
indoors 17.6
together 17.5
boy 17.4
daughter 17.3
lifestyle 17.3
son 16.9
hospital 16.8
portrait 16.2
joy 15.9
children 15.5
casual 15.2
grandfather 15
room 14.7
cheerful 14.6
covering 14.4
cute 13.6
consumer goods 13.5
togetherness 13.2
two 12.7
childhood 12.5
elderly 12.4
medical 12.4
fun 12
health 11.8
retired 11.6
little 11.5
face 11.4
old 11.1
holding 10.7
care 10.7
smile 10.7
attractive 10.5
laughing 10.4
patient 10.4
mature 10.2
girls 10
playing 10
interior 9.7
newborn 9.7
married 9.6
sitting 9.4
adorable 9.2
house 9.2
indoor 9.1
black 9
blond 9
handsome 8.9
group 8.9
women 8.7
couch 8.7
standing 8.7
day 8.6
kids 8.5
life 8.3
domestic 8.1
sibling 8.1
looking 8
affectionate 7.7
mid adult 7.7
infant 7.7
30s 7.7
toddler 7.6
loving 7.6
living 7.6
enjoying 7.6
human 7.5

Google
created on 2022-01-23

Smile 94.4
Photograph 94.2
Standing 86.4
Toddler 81.7
People 79.2
Lamp 77
Child 76.8
Vintage clothing 75.7
Table 74.5
Snapshot 74.3
Classic 73.7
Drawer 72.9
Baby 72.6
Room 69.1
Monochrome 67.2
Monochrome photography 66.4
Art 65.4
Sitting 65.1
Stock photography 62.1
Fun 60.7

Microsoft
created on 2022-01-23

person 100
toddler 99
baby 99
wall 98.2
sitting 98.2
human face 97.7
clothing 97.1
child 96.1
smile 90.3
indoor 89.2
boy 86.1
text 83.8
group 78.6
people 62.7
posing 51
old 50

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 99.2%
Happy 99.6%
Calm 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Male, 61%
Happy 99.9%
Calm 0%
Confused 0%
Sad 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Male, 72.2%
Happy 98%
Calm 1.1%
Confused 0.3%
Sad 0.3%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Male, 100%
Happy 99.7%
Calm 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Lamp 70.6%
Couch 67.7%

Captions

Microsoft

a group of people sitting on a bench posing for the camera 95.9%
a vintage photo of a group of people sitting on a bench 94.6%
a vintage photo of a group of people sitting posing for the camera 94.5%

Text analysis

Amazon

Bradfood