Human Generated Data

Title

Untitled (people standing and seated at banquet)

Date

1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4141

Human Generated Data

Title

Untitled (people standing and seated at banquet)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.1
Person 99.1
Person 99.1
Person 98.7
Person 98.2
Person 95.5
Person 94.7
Indoors 94.2
Person 94.1
Person 93.5
Person 89.7
Room 89.4
Person 89.3
Person 88.8
Person 87.4
Electronics 81.2
Screen 81.2
Crowd 79.1
Monitor 75.6
Display 75.6
Person 75.5
Hall 72.2
People 71.4
Person 71.3
Audience 59.2
Cafeteria 57.6
Restaurant 57.6
Building 57.5
Workshop 56.7
School 56.6
Classroom 56.6

Clarifai
created on 2019-06-01

people 99.9
many 99.5
group together 98.6
adult 97.9
chair 97.2
furniture 97
group 96.7
woman 95.7
man 94.2
crowd 93.6
room 89.4
seat 85.9
leader 85
administration 84.1
military 83.7
wear 82.4
indoors 81.6
outfit 80.4
sit 80.4
several 75.2

Imagga
created on 2019-06-01

hall 68.9
interior 54.8
room 49.4
table 41.6
furniture 40.1
modern 37.2
house 32.6
decor 31.8
luxury 29.2
home 28.9
floor 28.8
chair 28.6
design 27.6
architecture 25.8
restaurant 23.4
wood 21.7
inside 20.2
apartment 20.1
contemporary 19.8
window 19.4
indoors 19.3
style 19.3
dining 19
empty 18.9
comfortable 18.1
light 18
glass 17.8
decoration 17.4
lamp 17.2
indoor 16.4
living 16.1
nobody 15.6
3d 15.5
sofa 15.4
hotel 15.3
boutique 14.9
chairs 14.7
kitchen 14.3
building 14.3
dinner 13.5
elegance 13.4
expensive 13.4
residential 13.4
lifestyle 13
wall 12.8
counter 11.7
elegant 11.1
bar 11.1
business 10.9
relaxation 10.9
stylish 10.9
estate 10.4
barroom 10.3
structure 10.2
relax 10.1
tables 9.8
carpet 9.7
new 9.7
rendering 9.5
shop 9.3
food 9.2
city 9.1
residence 8.9
dining room 8.9
living room 8.8
wooden 8.8
pillow 8.7
urban 8.7
decorating 8.7
couch 8.7
seat 8.6
tile 8.6
bed 8.5
space 8.5
office 8.5
classic 8.4
rest 8.3
reflection 8.2
plant 8.2
domestic 8.1
center 8.1
cabinet 7.9
classroom 7.9
mansion 7.8
vase 7.7
bedroom 7.7
comfort 7.7
decorate 7.6
cafeteria 7.6
lifestyles 7.6
eat 7.5
clean 7.5
service 7.4
people 7.3
salon 7.2
travel 7
case 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

furniture 76.5
black and white 64.1
building 62.7
clothing 61.9
person 59.2
clothes 16.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Sad 45.3%
Angry 45.3%
Calm 53.8%
Confused 45.1%
Disgusted 45.2%
Happy 45.1%
Surprised 45.2%

AWS Rekognition

Age 20-38
Gender Female, 52%
Confused 45.8%
Sad 51%
Calm 46.1%
Happy 46.1%
Surprised 45.4%
Disgusted 45.2%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Female, 54.9%
Disgusted 45.3%
Confused 45.1%
Surprised 45.2%
Calm 52.7%
Happy 45.5%
Angry 45.3%
Sad 45.9%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Confused 45.4%
Surprised 45.5%
Angry 46.2%
Calm 46.2%
Disgusted 47.6%
Sad 48%
Happy 46.1%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Confused 49.6%
Surprised 49.6%
Calm 49.9%
Sad 49.7%
Happy 49.7%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Disgusted 49.6%
Angry 49.6%
Confused 49.6%
Sad 49.6%
Happy 49.5%
Calm 50.1%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Male, 51.8%
Disgusted 45.5%
Surprised 45.4%
Angry 45.6%
Confused 45.5%
Sad 49.5%
Calm 47.5%
Happy 46.1%

AWS Rekognition

Age 35-52
Gender Male, 50.1%
Surprised 49.6%
Disgusted 49.6%
Calm 49.6%
Happy 49.6%
Sad 49.9%
Angry 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Disgusted 45.8%
Happy 45.5%
Surprised 45.5%
Sad 49.8%
Angry 45.8%
Confused 45.7%
Calm 46.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Confused 49.6%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.9%
Sad 49.9%

AWS Rekognition

Age 4-9
Gender Male, 50.4%
Happy 49.5%
Calm 49.8%
Angry 49.6%
Confused 49.5%
Surprised 49.5%
Sad 49.7%
Disgusted 49.9%

AWS Rekognition

Age 30-47
Gender Female, 50.1%
Calm 49.7%
Surprised 49.6%
Sad 49.8%
Confused 49.5%
Disgusted 49.7%
Happy 49.7%
Angry 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.7%
Sad 49.7%
Happy 49.7%
Confused 49.5%
Surprised 49.6%
Angry 49.7%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.5%
Sad 49.6%
Happy 49.6%
Confused 49.6%
Surprised 49.6%
Calm 50.1%
Disgusted 49.6%

AWS Rekognition

Age 17-27
Gender Female, 53.7%
Confused 45.6%
Happy 45.7%
Calm 47.6%
Disgusted 46.2%
Sad 48%
Angry 46.1%
Surprised 45.8%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50.1%
Angry 49.7%
Sad 49.9%
Disgusted 49.6%
Surprised 49.6%
Happy 49.6%
Calm 49.6%
Confused 49.6%

AWS Rekognition

Age 27-44
Gender Female, 50.2%
Sad 49.7%
Calm 49.9%
Surprised 49.6%
Angry 49.6%
Disgusted 49.5%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.6%
Calm 49.9%
Sad 49.7%
Surprised 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 27-44
Gender Male, 54.9%
Happy 47.9%
Confused 45.3%
Angry 45.5%
Disgusted 45.3%
Surprised 45.2%
Sad 48.5%
Calm 47.3%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Disgusted 49.6%
Calm 49.9%
Angry 49.6%
Sad 49.6%
Surprised 49.6%
Happy 49.7%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Surprised 46%
Happy 46.1%
Disgusted 45.8%
Calm 47%
Sad 47.7%
Confused 46.7%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Sad 46.9%
Happy 45.4%
Confused 45.3%
Angry 45.1%
Surprised 45.6%
Disgusted 45.2%
Calm 51.6%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Sad 49.7%
Angry 49.6%
Calm 50%
Confused 49.5%
Disgusted 49.6%
Happy 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Confused 45.6%
Surprised 45.4%
Angry 45.4%
Calm 49.5%
Disgusted 45.6%
Sad 47.3%
Happy 46.2%

AWS Rekognition

Age 23-38
Gender Female, 50.2%
Happy 49.6%
Calm 49.7%
Angry 49.5%
Confused 49.6%
Surprised 49.6%
Sad 50%
Disgusted 49.5%

AWS Rekognition

Age 16-27
Gender Female, 50%
Confused 49.6%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Calm 50.1%
Sad 49.8%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.7%
Sad 49.8%
Surprised 49.6%
Happy 49.7%
Calm 49.5%
Disgusted 49.6%
Confused 49.5%

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people standing in front of a crowd 64.3%
a group of people in a room 64.2%
a group of people standing in a room 64.1%