Human Generated Data

Title

Untitled (formal studio portrait of eight member family, seated and standing)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3821

Human Generated Data

Title

Untitled (formal studio portrait of eight member family, seated and standing)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.2
Person 99.2
Person 99.1
Clothing 98.8
Apparel 98.8
Person 98.7
Person 98.5
Person 98.5
Person 98.2
Person 97.9
Person 97.5
Footwear 96.5
Shoe 96.5
Shoe 95.9
Chair 95.1
Furniture 95.1
Shoe 90.6
People 89.4
Shoe 84.8
Shoe 75.3
Tie 70.8
Accessory 70.8
Accessories 70.8
Crowd 70.1
Sitting 65.8
Face 65
Portrait 64.3
Photography 64.3
Photo 64.3
Family 64.3
Linen 61.9
Home Decor 61.9
Coat 61.8
Overcoat 59.3
Suit 59.3
Female 59.2

Clarifai
created on 2019-06-01

people 99.9
group 99.4
group together 98.6
adult 98.1
woman 95.5
man 95
several 93.1
medical practitioner 90.9
leader 90.6
administration 90.4
many 89.3
wear 88
four 87.5
five 85.5
three 84.9
portrait 81.6
uniform 79.6
child 78
scientist 76.8
offspring 72.2

Imagga
created on 2019-06-01

nurse 79.8
kin 37.5
people 35.7
man 35.6
adult 32.3
male 30.5
person 26.1
couple 25.3
smiling 23.9
happy 23.2
women 21.4
happiness 20.4
home 19.2
men 18.9
hospital 18.8
family 18.7
indoors 18.5
sitting 17.2
professional 17.1
business 17
portrait 16.8
room 16.6
talking 16.2
businessman 15.9
patient 15.3
two 15.2
lifestyle 15.2
mother 15
smile 15
together 14.9
cheerful 14.6
businesswoman 14.5
husband 14.3
love 14.2
senior 14.1
30s 13.5
meeting 13.2
teacher 13.1
20s 12.8
bride 12.5
businesspeople 12.3
groom 12.2
worker 11.8
colleagues 11.7
medical 11.5
wife 11.4
mature 11.2
wedding 11
day 11
dress 10.8
40s 10.7
mid adult 10.6
casual 10.2
team 9.9
casual clothing 9.8
four 9.6
elderly 9.6
life 9.3
face 9.2
lab coat 9.2
educator 9.2
indoor 9.1
child 9.1
new 8.9
color 8.9
working 8.8
office 8.8
thirties 8.8
two people 8.8
brunette 8.7
clothing 8.7
work 8.6
coat 8.5
house 8.4
health 8.3
lady 8.1
group 8.1
job 8
daughter 8
four people 7.9
discussing 7.9
forties 7.8
standing 7.8
boy 7.8
table 7.8
corporate 7.7
modern 7.7
attractive 7.7
married 7.7
old 7.7
marriage 7.6
enjoying 7.6
adults 7.6
bouquet 7.5
doctor 7.5
friendship 7.5
girls 7.3
celebration 7.2
father 7.2
romantic 7.1
interior 7.1

Google
created on 2019-06-01

Photograph 96.4
Snapshot 82.9
Uniform 59.9
Family 59.5
Team 52.3

Microsoft
created on 2019-06-01

wall 98.9
clothing 96.5
posing 96.4
smile 93.7
person 88.6
woman 85.7
man 80.4
group 76.6
human face 76.2
wedding dress 66.2
wedding 54.7

Face analysis

Amazon

AWS Rekognition

Age 17-27
Gender Male, 53%
Happy 1.4%
Angry 0.9%
Surprised 0.6%
Disgusted 2.6%
Sad 2.1%
Calm 91.6%
Confused 0.8%

AWS Rekognition

Age 48-68
Gender Female, 52.6%
Angry 45.3%
Disgusted 45.3%
Confused 45.2%
Calm 49.8%
Sad 48.9%
Surprised 45.2%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Calm 52%
Disgusted 46.3%
Confused 45.5%
Surprised 45.4%
Happy 45.3%
Sad 45.3%
Angry 45.2%

AWS Rekognition

Age 23-38
Gender Male, 92.3%
Disgusted 1.4%
Happy 4.3%
Sad 2.2%
Calm 84.8%
Angry 1.5%
Surprised 3.7%
Confused 2.1%

AWS Rekognition

Age 23-38
Gender Female, 52.7%
Happy 45.1%
Confused 45.2%
Angry 45.4%
Disgusted 45.1%
Surprised 45.2%
Sad 48.3%
Calm 50.7%

AWS Rekognition

Age 20-38
Gender Male, 53.1%
Confused 45.2%
Angry 45.2%
Sad 45.5%
Calm 50.8%
Disgusted 47.7%
Happy 45.3%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Surprised 45.4%
Sad 45.2%
Happy 45.9%
Angry 45.2%
Disgusted 45.7%
Confused 45.2%
Calm 52.5%

Feature analysis

Amazon

Person 99.2%
Shoe 96.5%
Tie 70.8%

Captions

Microsoft

a group of people posing for a photo 97.3%
a group of people posing for the camera 97.2%
a group of people posing for a picture 97.1%