Human Generated Data

Title

Untitled (interior of banquet with men in uniform)
Date

c. 1930-1940
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5777

Human Generated Data

Title

Untitled (interior of banquet with men in uniform)

People

Artist: Durette Studio, American 20th century

Date

c. 1930-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 98.9
Human 98.9
Person 95.8
Person 88.7
Person 86
Person 83.9
Crowd 83.9
Sitting 83
Chair 81.4
Furniture 81.4
Chair 76.1
Person 71.1
Person 69.9
People 65.6
Indoors 65
Cafeteria 62.8
Restaurant 62.8
Audience 57.1
Chess 55.8
Game 55.8
Overcoat 55.2
Coat 55.2
Clothing 55.2
Apparel 55.2
Flooring 55.1

Clarifai
created on 2019-11-16

people 99.6
audience 98.6
group together 98.6
many 98.6
group 97.7
stage 95.2
man 94.7
crowd 94.6
music 90.9
movie 90.4
woman 90.1
adult 90
concert 88.2
meeting 86.4
theater 86
public show 85.7
auditorium 85.3
chair 85.1
spectator 85
room 83.7

Imagga
created on 2019-11-16

silhouette 24.8
theater curtain 15.2
night 15.1
people 15.1
light 14.7
dark 14.2
black 14.2
man 14.1
musical instrument 13.4
curtain 13
music 11.7
percussion instrument 11.4
grunge 11.1
sunset 10.8
negative 10.7
body 10.4
chair 10.1
blind 10
structure 10
male 9.9
stringed instrument 9.6
couple 9.6
sky 9.6
person 9.4
water 9.3
blackboard 9.3
building 9.3
window 9
texture 9
women 8.7
dance 8.6
party 8.6
vintage 8.3
park 8.2
landscape 8.2
style 8.2
disco 8
holiday 7.9
travel 7.7
men 7.7
protective covering 7.7
film 7.7
walk 7.6
sun 7.5
piano 7.4
room 7.2
dirty 7.2
love 7.1

Google
created on 2019-11-16

Photograph 96.6
Black 94.5
Black-and-white 88.5
Snapshot 85.9
Photography 78
Room 71.4
Monochrome 70.2
Monochrome photography 69.6
Stage 56.9

Microsoft
created on 2019-11-16

text 93.9
person 92.4
black and white 86
table 76.3
people 61.6
group 61.3
man 57.4

Face analysis

Amazon

AWS Rekognition

Age 48-66
Gender Male, 54.4%
Angry 47.7%
Fear 45.1%
Confused 45.2%
Happy 45.6%
Calm 50.2%
Disgusted 45.4%
Surprised 45.2%
Sad 45.7%

AWS Rekognition

Age 51-69
Gender Male, 53.6%
Sad 46%
Surprised 45.3%
Confused 45.5%
Fear 45.3%
Angry 47.3%
Happy 45.7%
Calm 49%
Disgusted 45.8%

AWS Rekognition

Age 39-57
Gender Male, 54.7%
Surprised 45%
Fear 45%
Angry 45.3%
Disgusted 45.1%
Sad 47.2%
Calm 52.3%
Happy 45.1%
Confused 45%

AWS Rekognition

Age 31-47
Gender Male, 53.8%
Fear 45.1%
Confused 45.1%
Calm 47.1%
Sad 51.9%
Disgusted 45.1%
Happy 45.1%
Surprised 45%
Angry 45.7%

AWS Rekognition

Age 32-48
Gender Male, 51.3%
Fear 45.2%
Calm 50.8%
Surprised 45.2%
Confused 45.9%
Disgusted 45.2%
Happy 45.4%
Sad 46.1%
Angry 46.1%

AWS Rekognition

Age 36-54
Gender Male, 54.4%
Angry 45.3%
Sad 47.6%
Calm 51.8%
Fear 45.1%
Happy 45%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 38-56
Gender Male, 54.3%
Happy 45.1%
Sad 48.6%
Angry 45.2%
Calm 50.7%
Fear 45%
Surprised 45%
Disgusted 45.3%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Male, 54.5%
Fear 45%
Disgusted 45%
Calm 45.1%
Angry 45%
Sad 54.9%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 54.1%
Fear 45%
Happy 45%
Confused 45.1%
Calm 54.1%
Disgusted 45%
Sad 45.6%
Angry 45.1%
Surprised 45%

AWS Rekognition

Age 27-43
Gender Male, 54.2%
Angry 45.4%
Sad 46.5%
Confused 45.2%
Calm 51.5%
Surprised 45.1%
Happy 45.6%
Disgusted 45.6%
Fear 45.2%

AWS Rekognition

Age 30-46
Gender Female, 50.1%
Happy 45.1%
Sad 50.9%
Disgusted 45.1%
Fear 45.1%
Calm 48.3%
Angry 45.2%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 31-47
Gender Male, 50.2%
Calm 49.7%
Sad 50.2%
Happy 49.5%
Angry 49.5%
Fear 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 49-67
Gender Male, 50.2%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.6%
Disgusted 49.5%
Sad 50.4%
Confused 49.5%

AWS Rekognition

Age 33-49
Gender Female, 50.2%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Fear 49.6%
Sad 50.4%
Surprised 49.5%
Confused 49.5%
Calm 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.4%
Sad 49.6%
Surprised 49.5%
Angry 49.6%
Calm 50%
Happy 49.5%
Fear 49.5%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.4%
Calm 49.5%
Sad 49.6%
Happy 49.5%
Angry 49.5%
Fear 50.3%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 50-68
Gender Female, 50.3%
Confused 49.5%
Surprised 49.5%
Fear 49.9%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Sad 50.1%
Calm 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.5%
Happy 49.5%
Fear 49.5%
Sad 50.4%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-35
Gender Female, 50%
Angry 49.5%
Calm 49.6%
Happy 49.6%
Sad 50%
Fear 49.7%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 29-45
Gender Female, 50.4%
Happy 49.7%
Disgusted 49.5%
Calm 49.9%
Sad 49.7%
Surprised 49.5%
Confused 49.5%
Fear 49.6%
Angry 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.9%
Calm 49.5%
Angry 49.6%
Fear 49.8%
Surprised 49.5%
Happy 49.6%

AWS Rekognition

Age 31-47
Gender Male, 50.1%
Confused 49.5%
Surprised 49.5%
Calm 49.5%
Fear 50.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.5%

AWS Rekognition

Age 40-58
Gender Male, 50.5%
Confused 49.5%
Surprised 49.5%
Calm 50.2%
Fear 49.6%
Disgusted 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.6%

AWS Rekognition

Age 8-18
Gender Male, 50%
Angry 49.6%
Surprised 49.5%
Sad 49.6%
Happy 49.5%
Calm 49.6%
Fear 50.2%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-51
Gender Male, 50.4%
Sad 49.9%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Calm 50%
Happy 49.5%
Fear 49.5%

AWS Rekognition

Age 45-63
Gender Male, 54.9%
Calm 47.9%
Angry 46.2%
Fear 45.3%
Happy 47.2%
Sad 48%
Confused 45.1%
Disgusted 45.1%
Surprised 45.2%

AWS Rekognition

Age 23-35
Gender Male, 50.4%
Happy 49.5%
Fear 49.7%
Angry 49.5%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%
Surprised 49.5%
Sad 50.1%

Feature analysis

Amazon

Person 98.9%
Chair 81.4%

Captions

Microsoft

a group of people standing in front of a crowd 87%
a group of people standing in front of a crowd of people 85.3%
a group of people that are standing in front of a crowd 81.9%