Human Generated Data

Title

Untitled (people standing and seated at banquet)

Date

1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4142

Human Generated Data

Title

Untitled (people standing and seated at banquet)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.2
Human 99.2
Person 98.9
Indoors 98.7
Person 98.1
Person 96.6
Room 96.1
Person 93.5
Person 90.3
Crowd 90.2
Audience 87.9
Person 86.2
Hall 83.8
Person 83.5
Person 79.2
Person 70.4
Theater 68.2
Auditorium 68.2
People 67.5
Classroom 65
School 65
Speech 63.3
Lecture 63.3
Person 54.5
Person 50.9
Person 50.8
Person 48
Person 41.9

Clarifai
created on 2019-06-01

people 99.9
many 99.5
group together 98.5
adult 97.1
group 96
woman 95.4
crowd 95.1
chair 93.3
man 92.7
furniture 91.8
room 87.8
wear 87.1
military 85.1
administration 81.9
indoors 79.9
leader 77
audience 77
war 76.5
outfit 72.3
sit 71.7

Imagga
created on 2019-06-01

interior 53.9
room 44.4
hall 39.1
modern 38.5
furniture 35.7
table 35.6
luxury 30.9
floor 27.9
decor 27.4
house 25.9
architecture 25.8
home 24.9
design 23.6
indoors 22.8
chair 22.7
inside 22.1
comfortable 22
window 19.5
style 18.5
glass 17.9
hospital 17.5
wood 17.5
restaurant 17.4
decoration 17.4
empty 17.2
living 17.1
light 16.7
indoor 16.4
nobody 16.3
lamp 16.2
sofa 15.6
apartment 15.3
business 15.2
lifestyle 15.2
relaxation 15.1
contemporary 15
wall 14.6
hotel 14.3
3d 13.9
elegant 13.7
elegance 13.4
building 13
bedroom 12.8
relax 12.6
boutique 12.1
residential 11.5
dining 11.4
bed 11.4
office 11
clean 10.9
pillow 10.8
living room 10.8
carpet 10.7
couch 10.6
expensive 10.5
urban 10.5
structure 10.3
dinner 10.1
space 10.1
vase 9.8
chairs 9.8
comfort 9.6
seat 9.6
rendering 9.5
shop 9.3
service 9.3
reflection 9.2
city 9.1
stylish 9
color 8.9
party 8.6
celebration 8
residence 7.9
life 7.7
wide 7.7
estate 7.6
nurse 7.5
place 7.4
classic 7.4
technology 7.4
warm 7.4
occupation 7.3
new 7.3
bright 7.1
travel 7
wooden 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

furniture 67.2
clothes 17.7

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Happy 45.4%
Disgusted 46.9%
Angry 46.4%
Surprised 45.5%
Sad 45.8%
Calm 49.5%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Male, 50.6%
Happy 47.1%
Calm 48.6%
Angry 45.2%
Surprised 45.3%
Disgusted 45.1%
Confused 45.5%
Sad 48.3%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Disgusted 49.5%
Sad 49.7%
Surprised 49.5%
Happy 49.6%
Angry 49.6%
Calm 50%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Confused 46.7%
Angry 45.8%
Sad 46.8%
Calm 46.5%
Disgusted 45.4%
Happy 48.2%
Surprised 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Sad 49.5%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.5%
Happy 50.4%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.5%
Disgusted 47.8%
Angry 45.4%
Confused 45.3%
Sad 46%
Happy 45.5%
Calm 49.4%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Female, 50%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Calm 50.1%
Surprised 49.5%
Sad 49.7%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 50.3%
Confused 49.5%

AWS Rekognition

Age 38-57
Gender Male, 50.1%
Calm 49.6%
Surprised 49.5%
Sad 50.2%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 15-25
Gender Female, 52.9%
Disgusted 45.8%
Sad 49.2%
Confused 45.6%
Happy 45.7%
Angry 45.5%
Surprised 45.6%
Calm 47.6%

AWS Rekognition

Age 35-55
Gender Female, 50.4%
Surprised 49.6%
Sad 49.7%
Angry 49.6%
Disgusted 49.6%
Calm 49.8%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Confused 49.6%
Disgusted 49.7%
Calm 49.6%
Angry 49.7%
Sad 49.9%
Happy 49.6%
Surprised 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 49.6%
Happy 49.6%
Surprised 49.6%
Calm 49.6%
Disgusted 49.9%
Confused 49.5%
Angry 49.7%

AWS Rekognition

Age 45-66
Gender Female, 53.1%
Angry 46.1%
Calm 46.7%
Sad 51%
Surprised 45.3%
Disgusted 45.3%
Happy 45.3%
Confused 45.4%

AWS Rekognition

Age 38-57
Gender Female, 50.4%
Happy 49.8%
Disgusted 49.7%
Angry 49.6%
Surprised 49.6%
Sad 49.6%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Sad 49.7%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Calm 50.2%

AWS Rekognition

Age 35-55
Gender Female, 50.1%
Confused 49.6%
Calm 49.9%
Sad 49.6%
Surprised 49.6%
Angry 49.5%
Disgusted 49.5%
Happy 49.8%

AWS Rekognition

Age 23-38
Gender Female, 52.8%
Happy 45.8%
Confused 45.6%
Disgusted 47.6%
Sad 48%
Calm 45.9%
Angry 46.6%
Surprised 45.6%

AWS Rekognition

Age 23-38
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.5%
Sad 49.6%
Surprised 49.5%
Angry 49.5%
Calm 50.3%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.8%
Calm 50.1%
Angry 49.5%

AWS Rekognition

Age 38-59
Gender Male, 50.5%
Disgusted 49.6%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.2%
Calm 49.5%
Happy 49.5%

AWS Rekognition

Age 45-63
Gender Female, 50%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Sad 50%
Disgusted 49.8%
Calm 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 50.3%
Angry 49.5%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Disgusted 50.3%
Calm 49.5%
Confused 49.5%
Sad 49.5%
Surprised 49.5%
Angry 49.5%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Confused 49.5%
Surprised 49.5%
Happy 49.6%
Calm 49.8%
Sad 49.6%
Disgusted 49.8%
Angry 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50%
Angry 49.5%
Calm 50.2%
Sad 49.7%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.3%
Disgusted 50.2%
Happy 49.5%
Surprised 49.5%
Sad 49.6%
Angry 49.6%
Confused 49.6%
Calm 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.6%
Sad 50.1%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Calm 49.6%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.6%
Sad 50.1%
Confused 49.5%
Angry 49.7%
Surprised 49.5%
Happy 49.5%

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people in a room 89.3%
a group of people standing in a room 85.4%
a group of people standing in front of a crowd 72.1%