Human Generated Data

Title

Untitled (eighteen-member family portrait in livingroom)
Date

c. 1905-1915
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3936

Human Generated Data

Title

Untitled (eighteen-member family portrait in livingroom)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.3
Person 99.3
Person 99
Person 99
Person 99
Person 98.9
Person 98.9
Person 98.8
Person 98.7
Person 98.1
Person 97.7
Apparel 97.3
Clothing 97.3
Person 96.3
Person 95.7
Person 95.5
Crowd 90.3
People 89
Person 86.6
Face 79.9
Tie 73.9
Accessory 73.9
Accessories 73.9
Suit 73.6
Overcoat 73.6
Coat 73.6
Person 73.4
Dress 70.8
Audience 70.3
Indoors 69.1
Female 66.9
Chair 63.5
Furniture 63.5
Shirt 62.7
Room 61.4
Child 60.1
Kid 60.1
Photography 58.8
Photo 58.8
Girl 57.3
Person 43.9

Clarifai
created on 2019-06-01

people 99.9
group 99.8
group together 99.6
many 99.3
child 96.7
adult 96.6
man 96.3
woman 92.9
crowd 92.7
leader 88.9
several 88.4
education 83.6
boy 82.6
war 82.1
administration 78.5
school 77.6
wear 75.7
military 74
five 73.3
music 72.9

Imagga
created on 2019-06-01

kin 46.7
people 30.7
male 27
man 26.9
person 25.7
adult 25.6
happy 24.4
couple 24.4
child 23.4
smiling 23.1
teacher 21.2
portrait 20.7
men 18.9
family 18.7
group 18.5
home 18.3
women 17.4
sibling 17.2
together 16.6
mother 16.5
classroom 15.4
happiness 14.9
lifestyle 14.4
leisure 14.1
friendship 14
room 14
boy 13.9
fun 13.5
senior 13.1
smile 12.8
casual 12.7
daughter 12.6
sitting 12
love 11.8
black 11.4
cheerful 11.4
friends 11.3
educator 11.1
grandfather 10.9
negative 10.6
indoors 10.5
professional 10.5
enjoying 10.4
mature 10.2
joy 10
outdoor 9.9
father 9.7
life 9.5
day 9.4
school 9.1
girls 9.1
businessman 8.8
son 8.8
elderly 8.6
sport 8.4
modern 8.4
old 8.4
parent 8.3
outdoors 8.2
kid 8
business 7.9
60s 7.8
face 7.8
teaching 7.8
education 7.8
play 7.7
class 7.7
attractive 7.7
married 7.7
youth 7.7
husband 7.6
film 7.6
fashion 7.5
learning 7.5
human 7.5
silhouette 7.4
camera 7.4
20s 7.3
playing 7.3
musical instrument 7.3
team 7.2
handsome 7.1
little 7.1

Google
created on 2019-06-01

Photograph 96.8
Snapshot 85.5
Standing 79.6
Black-and-white 74.4
Photography 70.6
Monochrome 64.3
Stock photography 62.1
Family 58.6
Style 51

Microsoft
created on 2019-06-01

person 99.5
clothing 96.8
group 91.6
posing 79.6
human face 76.1
man 74.4
old 64.8
black and white 63.4
crowd 1.8

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Angry 45.5%
Happy 45.4%
Confused 45.6%
Calm 45.4%
Disgusted 45.2%
Sad 52.7%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Sad 48.6%
Angry 45.2%
Happy 45.1%
Confused 49.7%
Calm 46.2%
Surprised 45.2%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Confused 45.2%
Surprised 45.6%
Happy 45.2%
Calm 52.7%
Sad 45.9%
Disgusted 45.1%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Disgusted 45.1%
Confused 45.3%
Angry 45.3%
Calm 47%
Surprised 45.2%
Happy 45.1%
Sad 51.9%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Disgusted 45.4%
Calm 45.7%
Confused 45.4%
Sad 50.2%
Surprised 45.4%
Angry 46.4%
Happy 46.6%

AWS Rekognition

Age 35-53
Gender Female, 54.6%
Happy 46.8%
Sad 47.3%
Confused 45.3%
Angry 45.8%
Disgusted 46.3%
Surprised 45.6%
Calm 48%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Calm 46%
Disgusted 45.4%
Confused 45.5%
Surprised 45.5%
Happy 47.8%
Sad 49.5%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Male, 51.5%
Confused 46%
Sad 48.7%
Calm 48.2%
Happy 45.4%
Surprised 45.8%
Disgusted 45.5%
Angry 45.5%

AWS Rekognition

Age 16-27
Gender Female, 52.9%
Angry 46%
Sad 49.5%
Happy 46.3%
Calm 46.4%
Confused 45.5%
Disgusted 45.7%
Surprised 45.6%

AWS Rekognition

Age 35-52
Gender Female, 54.9%
Disgusted 45.4%
Sad 46%
Happy 46.6%
Surprised 46.7%
Calm 48.5%
Angry 45.5%
Confused 46.3%

AWS Rekognition

Age 14-23
Gender Female, 54.9%
Angry 45.4%
Sad 47.8%
Surprised 45.9%
Happy 45.6%
Calm 48.1%
Disgusted 45.5%
Confused 46.7%

AWS Rekognition

Age 11-18
Gender Female, 54.9%
Happy 46.2%
Sad 45.4%
Surprised 46.8%
Confused 46.4%
Disgusted 46%
Calm 47.7%
Angry 46.6%

Feature analysis

Amazon

Person 99.3%
Tie 73.9%

Captions

Microsoft

a group of people posing for a photo 96.4%
a group of people posing for the camera 96.3%
a group of people posing for a picture 96.2%