Human Generated Data

Title

Untitled (family portrait with five generations posing in living room)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2482

Human Generated Data

Title

Untitled (family portrait with five generations posing in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-17

Furniture 100
Chair 100
Clothing 99.7
Apparel 99.7
Person 99.2
Human 99.2
Person 99.1
Person 98.7
Person 97.9
Female 94
Face 85.8
Dress 83.9
Shorts 83.2
Shoe 78.8
Footwear 78.8
Woman 75.6
Smile 75.6
Skirt 74.8
Girl 73.2
Photography 70.9
Photo 70.9
Portrait 70.9
People 70.2
Kid 68.9
Child 68.9
Person 68.9
Indoors 68.4
Door 63.4
Room 59.6
Home Decor 57.5
Cushion 57.1
Pillow 57.1

Clarifai
created on 2019-06-17

people 99.9
child 99.2
portrait 97.4
adult 97.2
family 97
group together 96.3
woman 96.1
wear 95.6
two 93.7
group 93.5
four 93.4
five 93
three 92.8
offspring 92.2
man 90.3
several 88.7
sibling 87.4
education 85.2
facial expression 83.2
furniture 83

Imagga
created on 2019-06-17

happy 32.6
smiling 32.5
family 32
child 30.6
people 29.6
male 27.9
home 27.1
man 26.9
person 26.2
sitting 25.8
senior 24.4
sibling 23.8
mother 22.2
together 21.9
fun 21
couple 20.9
portrait 20.7
chair 20.6
tricycle 20.2
adult 19.5
father 19.1
kid 18.6
smile 18.5
indoors 17.6
room 17
wheeled vehicle 16.8
wheelchair 16.2
childhood 16.1
lifestyle 15.9
mature 15.8
nurse 15.7
boy 15.6
little 15
happiness 14.9
cheerful 14.6
children 14.6
husband 14.3
wife 14.2
parent 14.1
medical 14.1
seat 13.9
women 13.4
love 13.4
patient 13
playing 12.8
girls 12.8
retired 12.6
couch 12.6
vehicle 12.5
hospital 12.2
son 12.1
daughter 12
casual 11.9
two 11.9
holding 11.6
cute 11.5
school 11.4
group 11.3
furniture 11
joy 10.9
electric chair 10.7
care 10.7
affectionate 10.6
interior 10.6
grandma 10.6
elderly 10.5
old 10.4
grandfather 10.4
brother 10.4
health 10.4
looking 10.4
togetherness 10.4
men 10.3
camera 10.2
leisure 10
grandmother 9.8
sofa 9.6
domestic 9.5
professional 9.5
enjoying 9.5
youth 9.4
occupation 9.2
indoor 9.1
outdoors 9
kin 8.9
instrument 8.9
parents 8.8
life 8.7
instrument of execution 8.7
standing 8.7
30s 8.7
retirement 8.6
expression 8.5
face 8.5
kids 8.5
conveyance 8.4
house 8.4
barber chair 8.3
holiday 7.9
vertical 7.9
living room 7.8
sister 7.8
blond 7.8
play 7.8
sick 7.7
affection 7.7
rocking chair 7.7
dad 7.7
illness 7.6
relaxed 7.5
human 7.5
baby 7.5
20s 7.3
exercise 7.3
building 7.2
device 7

Google
created on 2019-06-17

Photograph 97
People 95
Snapshot 89
Family 68
Photography 67.8
Room 65.7
Child 57.3

Microsoft
created on 2019-06-17

person 96.7
clothing 92.2
sport 88.4
footwear 86.3
smile 84.5
posing 67.7

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 52.3%
Calm 53%
Confused 45.3%
Surprised 45.3%
Angry 45.1%
Sad 45.2%
Happy 45.8%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Male, 95.9%
Calm 80.7%
Happy 6.6%
Disgusted 1.6%
Sad 3%
Surprised 2.7%
Angry 3.4%
Confused 2.1%

AWS Rekognition

Age 26-43
Gender Male, 53.5%
Happy 51.7%
Angry 45.4%
Calm 45.2%
Sad 45.2%
Disgusted 45.3%
Surprised 46.9%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Male, 54.7%
Calm 54.5%
Angry 45.1%
Happy 45.1%
Disgusted 45.1%
Confused 45%
Surprised 45.1%
Sad 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Calm 48.2%
Happy 45.6%
Disgusted 45.4%
Angry 45.7%
Confused 46.4%
Surprised 45.7%
Sad 48.1%

AWS Rekognition

Age 48-68
Gender Female, 50.1%
Sad 50.1%
Happy 49.5%
Confused 49.5%
Calm 49.6%
Surprised 49.5%
Angry 49.6%
Disgusted 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Sad 49.5%
Happy 49.6%
Disgusted 49.9%
Confused 49.5%
Angry 49.5%
Calm 49.9%
Surprised 49.6%

AWS Rekognition

Age 4-7
Gender Female, 50.4%
Sad 49.7%
Confused 49.6%
Calm 49.7%
Happy 49.7%
Surprised 49.6%
Disgusted 49.6%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Calm 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 50.5%
Confused 49.5%
Happy 49.5%
Sad 49.5%

Feature analysis

Amazon

Person 99.2%
Shoe 78.8%

Captions

Microsoft

a group of people posing for a photo 90.1%
a group of people posing for the camera 90%
a group of people posing for a picture 89.9%

Text analysis

Amazon

COVEEIA

Google

RODVK
RODVK OVEEI
OVEEI