Human Generated Data

Title

Untitled (thirteen women on front porch, many with matching hats and dresses)
Date

c. 1910-1920
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3680

Human Generated Data

Title

Untitled (thirteen women on front porch, many with matching hats and dresses)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.6
Clothing 99.6
Person 98.8
Human 98.8
Person 98
Person 98
Person 97.6
Person 97.5
Person 97.2
Person 96.2
Person 95.8
Person 95.6
Person 95.3
Person 90
Person 89.7
Person 88.2
Face 83.4
People 79.2
Helmet 76.8
Hat 75.1
Person 69.6
Crowd 68.4
Tie 68.2
Accessory 68.2
Accessories 68.2
Chair 67.9
Furniture 67.9
Text 67.8
Person 67.8
Kid 62.8
Child 62.8
Photo 60.4
Photography 60.4
Portrait 60.4
School 58
Room 58
Indoors 58
Classroom 58
Smile 56.5
Audience 56.3
Sun Hat 55.7
Sailor Suit 55.4

Clarifai
created on 2019-06-01

people 99.9
group 99.5
group together 99.1
many 98.8
adult 97.3
man 97
child 96.6
woman 95.7
music 93.9
leader 93.5
wear 92.1
portrait 91.7
several 90.6
crowd 89.8
boy 89.4
education 87.7
facial expression 87.6
outfit 87.4
musician 87.3
administration 86.9

Imagga
created on 2019-06-01

brass 62.8
wind instrument 48.5
cornet 40.2
musical instrument 36.8
people 27.8
man 24.2
male 24.1
adult 22.3
person 22.3
happy 18.1
senior 16.8
couple 15.7
active 14.9
trombone 14.9
portrait 14.9
old 14.6
men 14.6
elderly 14.3
bugle 13.9
black 12
health 11.8
medical 11.5
fun 11.2
women 11.1
playing 10.9
married 10.5
professional 10.4
love 10.2
casual 10.1
girls 10
human 9.7
child 9.7
group 9.7
stage 9.5
enjoying 9.5
happiness 9.4
lifestyle 9.4
friendship 9.3
mature 9.3
smile 9.2
outdoor 9.2
hospital 9.1
worker 8.9
style 8.9
together 8.7
retired 8.7
smiling 8.7
room 8.4
hand 8.3
dress 8.1
grandfather 8.1
lady 8.1
home 8
couples 7.8
older 7.8
outside 7.7
attractive 7.7
retirement 7.7
teacher 7.6
laughing 7.5
doctor 7.5
friends 7.5
leisure 7.5
holding 7.4
action 7.4
care 7.4
camera 7.4
clothing 7.3
exercise 7.2
kin 7.2
suit 7.2
family 7.1
summer 7.1
work 7.1
businessman 7
medicine 7
indoors 7

Google
created on 2019-06-01

Photograph 96.1
Team 92.7
Social group 91.9
Crew 74.4
Photography 62.4
Monochrome 60.1
Black-and-white 56.4
Family 53.1

Microsoft
created on 2019-06-01

person 99.9
posing 99
group 97
clothing 95.3
window 92.5
human face 87.8
musical instrument 86.7
smile 84.4
man 81.4
team 73.5
old 47.3
crowd 2.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 79.3%
Angry 7.3%
Sad 13.5%
Disgusted 12%
Happy 27.4%
Calm 22.1%
Surprised 7.9%
Confused 9.9%

AWS Rekognition

Age 26-43
Gender Male, 95.2%
Disgusted 2.6%
Calm 65.7%
Confused 6.6%
Sad 6.1%
Surprised 6.3%
Angry 4%
Happy 8.7%

AWS Rekognition

Age 23-38
Gender Female, 81.2%
Happy 61.7%
Disgusted 1.5%
Angry 9.2%
Calm 6.9%
Surprised 2.8%
Confused 2%
Sad 15.9%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Angry 45.3%
Happy 45.4%
Confused 45.2%
Calm 50%
Disgusted 45.3%
Sad 48.5%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Confused 45.5%
Sad 46.5%
Calm 50%
Happy 46.2%
Surprised 45.9%
Disgusted 45.4%
Angry 45.5%

AWS Rekognition

Age 26-43
Gender Female, 51%
Angry 6.6%
Happy 12.6%
Confused 6%
Calm 55.4%
Surprised 7.8%
Sad 5.7%
Disgusted 5.9%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Disgusted 45.1%
Calm 53.2%
Sad 45.3%
Confused 45.2%
Angry 45.3%
Surprised 45.2%
Happy 45.8%

AWS Rekognition

Age 26-43
Gender Male, 84.9%
Sad 4.6%
Surprised 1.6%
Disgusted 0.9%
Angry 1.8%
Calm 86.8%
Happy 2.3%
Confused 2.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Angry 45.6%
Surprised 46%
Calm 49%
Sad 45.7%
Confused 45.8%
Disgusted 45.3%
Happy 47.7%

AWS Rekognition

Age 26-43
Gender Male, 96.8%
Angry 5.3%
Confused 3.4%
Surprised 5.6%
Happy 6.8%
Sad 8.1%
Calm 66.2%
Disgusted 4.6%

AWS Rekognition

Age 23-38
Gender Male, 53.2%
Angry 45.2%
Disgusted 45.1%
Happy 45.3%
Sad 45.4%
Surprised 45.3%
Calm 53.5%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 50%
Angry 45.4%
Happy 46.3%
Sad 49.9%
Disgusted 45.7%
Confused 45.3%
Calm 47.1%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 51.8%
Disgusted 45.9%
Sad 45.4%
Happy 45.9%
Confused 45.2%
Surprised 45.6%
Angry 45.2%
Calm 51.7%

Feature analysis

Amazon

Person 98.8%
Helmet 76.8%
Tie 68.2%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of people posing for the camera 97%
a group of people posing for a picture 96.9%