Human Generated Data

Title

Untitled (large group of girls at birthday party with cake in center of table)
Date

1939
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4137

Human Generated Data

Title

Untitled (large group of girls at birthday party with cake in center of table)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Person 99.7
Human 99.7
Person 99.6
Furniture 99.4
Person 99.1
Person 98.6
Helmet 98.5
Clothing 98.5
Apparel 98.5
Helmet 98.2
Person 96.7
Indoors 95.8
Room 95.8
Person 95.7
Table 95.2
Helmet 94.2
Dining Table 93.7
Person 93.6
Dining Room 93.3
Restaurant 92.7
Person 91.7
Interior Design 90.6
Person 90.5
Person 90.4
Tabletop 90
Meal 89.4
Food 89.4
Face 86.6
Person 84.1
Helmet 84.1
People 82.8
Person 82.1
Helmet 81.2
Helmet 81.1
Person 79.2
Person 78.8
Person 78.1
Person 77.8
Female 77.7
Dress 76.2
Dish 75.9
Helmet 73.7
Classroom 73.5
School 73.5
Child 71
Kid 71
Suit 68.5
Overcoat 68.5
Coat 68.5
Girl 66.4
Helmet 65.4
Chair 65
Living Room 64.9
Photo 64
Portrait 64
Photography 64
Helmet 63
Creme 62.4
Dessert 62.4
Cream 62.4
Cake 62.4
Icing 62.4
Crowd 61.5
Cafeteria 59.6
Workshop 58.6
Baby 58.2
Food Court 56.6
Person 52.3

Clarifai
created on 2019-06-01

people 99.9
many 99.3
group 99.2
group together 98.6
child 97.4
adult 96.1
music 95.4
woman 93.8
man 93.4
musician 90.6
boy 88.9
administration 88.8
portrait 88.1
crowd 86.6
leader 86.1
facial expression 85.3
education 84.8
chair 83.8
sit 82.6
several 82

Imagga
created on 2019-06-01

classroom 60
room 48.2
person 36.4
people 35.6
male 34.7
man 34.2
teacher 32.9
brass 31.6
group 26.6
businessman 26.4
education 25.1
cornet 24.4
business 24.3
wind instrument 24.2
adult 24
student 22.5
meeting 20.7
men 19.7
senior 19.7
team 18.8
blackboard 18.8
happy 17.5
together 17.5
school 17.5
smiling 17.3
professional 17
musical instrument 16.4
teamwork 15.7
couple 15.7
portrait 15.5
table 14.7
businesswoman 14.5
businesspeople 14.2
home 13.5
work 13.3
indoors 12.3
study 12.1
educator 12
students 11.7
teaching 11.7
class 11.6
30s 11.5
studying 11.5
to 11.5
sitting 11.1
women 11.1
indoor 10.9
board 10.8
hand 10.6
job 10.6
planner 10.6
success 10.4
office 10.4
desk 10.4
communication 10.1
laptop 10
cheerful 9.7
human 9.7
discussion 9.7
40s 9.7
colleagues 9.7
looking 9.6
boy 9.6
college 9.5
friends 9.4
learning 9.4
friendship 9.3
casual 9.3
mature 9.3
camera 9.2
confident 9.1
worker 8.9
working 8.8
computer 8.8
hands 8.7
lifestyle 8.7
knowledge 8.6
smile 8.5
enjoying 8.5
showing 8.4
20s 8.2
technology 8.1
idea 8
stage 7.9
explaining 7.9
sixties 7.8
60s 7.8
conference 7.8
black 7.8
child 7.8
corporate 7.7
modern 7.7
chart 7.6
talking 7.6
plan 7.6
fun 7.5
successful 7.3

Google
created on 2019-06-01

Photograph 95.8
Social group 93.5
Class 86.3
Snapshot 82
Team 76.1
School 72.5
Room 71.4
History 64.5
State school 64.2
Photography 62.4
Crew 61.7
Child 61.3
Black-and-white 56.4
Family 50.2

Microsoft
created on 2019-06-01

person 99.5
posing 98.9
clothing 95.8
group 92.9
human face 85.4
man 78.9
black 70.4
team 63
table 57.2
old 43.6
female 27.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 89.2%
Happy 52.2%
Confused 2.6%
Angry 4.1%
Disgusted 1.3%
Surprised 3.5%
Sad 32.3%
Calm 3.9%

AWS Rekognition

Age 20-38
Gender Female, 57.2%
Surprised 3.3%
Disgusted 3.4%
Calm 49.8%
Happy 14.1%
Sad 22.9%
Angry 3%
Confused 3.5%

AWS Rekognition

Age 35-52
Gender Female, 83.4%
Sad 7.1%
Confused 1.5%
Disgusted 0.9%
Surprised 1.8%
Angry 1.6%
Happy 57.9%
Calm 29.2%

AWS Rekognition

Age 23-38
Gender Male, 53.1%
Calm 51.1%
Disgusted 45.4%
Sad 46.5%
Surprised 45.3%
Happy 46.1%
Confused 45.2%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Disgusted 45.2%
Calm 52.2%
Confused 45.3%
Sad 45.6%
Surprised 45.5%
Angry 45.2%
Happy 46%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Disgusted 46.2%
Confused 45.5%
Sad 47.4%
Happy 48.3%
Angry 45.6%
Surprised 46.2%
Calm 45.8%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Calm 51.6%
Surprised 45.4%
Disgusted 45.2%
Happy 45.6%
Sad 46.4%
Confused 45.5%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Happy 45.5%
Surprised 45.4%
Calm 50.5%
Sad 47.9%
Disgusted 45.1%
Angry 45.2%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Angry 45.1%
Surprised 45.2%
Calm 53.8%
Sad 45.6%
Confused 45.2%
Disgusted 45.1%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Angry 45.5%
Happy 46.1%
Calm 49.2%
Surprised 45.3%
Sad 48.2%
Confused 45.3%
Disgusted 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Confused 45.6%
Surprised 46%
Sad 45.7%
Angry 45.5%
Happy 47.2%
Calm 49.6%
Disgusted 45.3%

AWS Rekognition

Age 27-44
Gender Female, 54.7%
Disgusted 45.1%
Sad 47.2%
Happy 48.5%
Surprised 45.3%
Calm 48.4%
Angry 45.4%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Sad 46.4%
Happy 46.5%
Surprised 45.5%
Calm 50.8%
Disgusted 45.2%
Confused 45.3%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Female, 53.8%
Happy 46.7%
Confused 45.5%
Angry 45.3%
Sad 47.7%
Calm 48.8%
Surprised 45.7%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Male, 57.9%
Disgusted 1.6%
Calm 51.7%
Angry 2.4%
Sad 7.9%
Surprised 4.5%
Happy 28.4%
Confused 3.5%

AWS Rekognition

Age 26-43
Gender Female, 98.7%
Happy 14.8%
Disgusted 1.7%
Angry 3.1%
Calm 44%
Sad 25.6%
Confused 5.4%
Surprised 5.3%

AWS Rekognition

Age 26-43
Gender Female, 76.5%
Sad 34.6%
Surprised 1%
Happy 2.3%
Angry 3.3%
Calm 57.2%
Confused 1.3%
Disgusted 0.3%

Feature analysis

Amazon

Person 99.7%
Helmet 98.5%
Chair 65%

Captions

Microsoft

a group of people posing for a photo 96.1%
a group of people posing for the camera 96%
a group of people posing for a picture 95.9%

Text analysis

Amazon

VEVVEETA ETI