Human Generated Data

Title

Untitled (portrait of group in livingroom)

Date

c. 1935-1940

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1478

Human Generated Data

Title

Untitled (portrait of group in livingroom)

People

Artist: Durette Studio, American 20th century

Date

c. 1935-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.6
Human 99.6
Person 99.5
Clothing 99.4
Apparel 99.4
Person 99.4
Person 99.4
Person 99.1
Person 98.9
Person 98.7
Person 98.5
Dress 98
Female 94.6
Face 92.1
People 86
Woman 81.7
Overcoat 76.8
Coat 76.8
Suit 76.8
Girl 72.2
Footwear 68.4
Shoe 68.4
Smile 66.7
Portrait 66.4
Photo 66.4
Photography 66.4
Shorts 65.8
Sunglasses 63.6
Accessory 63.6
Accessories 63.6
Kid 60.9
Child 60.9
Sleeve 59.7
Skirt 56.1
Family 55.9

Clarifai
created on 2019-06-01

people 99.9
group 99.4
adult 98.3
woman 97.9
group together 97.7
man 97.6
child 92.3
five 90.7
several 90
portrait 88.9
leader 86.1
wear 84.7
four 83.7
offspring 82.5
many 82.5
family 81
education 80.7
monochrome 80
facial expression 79.8
administration 76.4

Imagga
created on 2019-06-01

kin 56.6
people 31.2
couple 28.7
man 28.3
bride 26.7
groom 24.9
person 24.8
male 24.1
adult 22.2
dress 21.7
happy 21.3
wedding 21.1
nurse 19.3
love 18.9
portrait 18.8
happiness 18
human 17.2
men 17.2
married 16.3
smiling 15.9
bouquet 15.4
senior 15
business 14
family 13.3
businessman 13.2
cheerful 13
medical 12.3
marriage 12.3
fashion 12.1
celebration 12
two 11.8
old 11.8
ceremony 11.6
together 11.4
flowers 11.3
group 11.3
team 10.7
face 10.6
30s 10.6
indoors 10.5
attractive 10.5
women 10.3
professional 10.2
child 10
mother 9.9
husband 9.9
gown 9.8
romance 9.8
looking 9.6
home 9.6
patient 9.3
elegance 9.2
20s 9.2
care 9
black 9
romantic 8.9
bridal 8.7
hospital 8.7
standing 8.7
day 8.6
party 8.6
wife 8.5
clothing 8.4
mature 8.4
health 8.3
camera 8.3
holding 8.2
girls 8.2
worker 8.2
suit 8.1
look 7.9
smile 7.8
elderly 7.7
loving 7.6
room 7.6
females 7.6
doctor 7.5
outdoors 7.5
lady 7.3
businesswoman 7.3
lifestyle 7.2
holiday 7.2
hair 7.1
handsome 7.1
summer 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

text 97.2
posing 96
clothing 91.1
person 90.4
old 80.3
smile 75.7
wedding dress 66.5
woman 65
group 63.9
dress 55.5
man 54.8

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Male, 96.5%
Angry 1.7%
Sad 2.8%
Happy 89.1%
Confused 1.1%
Surprised 2.6%
Calm 1.8%
Disgusted 1%

AWS Rekognition

Age 35-52
Gender Female, 52%
Angry 45.8%
Sad 46.2%
Surprised 45.7%
Happy 47.8%
Calm 47.6%
Disgusted 45.9%
Confused 46%

AWS Rekognition

Age 26-43
Gender Male, 51.2%
Sad 45.2%
Calm 45.3%
Surprised 45.7%
Angry 45.2%
Disgusted 45.1%
Happy 53.2%
Confused 45.2%

AWS Rekognition

Age 48-68
Gender Male, 55%
Disgusted 45.2%
Calm 51%
Sad 45.3%
Confused 45.3%
Angry 45.3%
Surprised 45.4%
Happy 47.4%

AWS Rekognition

Age 35-52
Gender Male, 86.4%
Angry 3.3%
Happy 3.9%
Confused 4.3%
Sad 9.3%
Calm 73.9%
Surprised 3.6%
Disgusted 1.7%

AWS Rekognition

Age 57-77
Gender Male, 54.3%
Surprised 45.3%
Happy 45.8%
Disgusted 46.1%
Calm 51.9%
Sad 45.2%
Confused 45.5%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45.2%
Calm 52.9%
Surprised 45.4%
Angry 45.3%
Happy 45.5%
Sad 45.4%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Confused 45.2%
Happy 51%
Calm 47.6%
Disgusted 45.3%
Sad 45.5%
Angry 45.2%
Surprised 45.3%

Feature analysis

Amazon

Person 99.6%
Shoe 68.4%
Sunglasses 63.6%

Captions

Microsoft

a group of people posing for a photo 96.5%
an old photo of a group of people posing for the camera 95.5%
an old photo of a group of people posing for a picture 95.4%