Human Generated Data

Title

Untitled (men and women seated at banquet with men and women standing around room.)

Date

1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4144

Human Generated Data

Title

Untitled (men and women seated at banquet with men and women standing around room.)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Assembly Line 99.7
Factory 99.7
Building 99.7
Person 99.4
Human 99.4
Person 99
Person 98.4
Person 97.6
Person 97.4
Person 96.3
Person 94
Person 86.3
Person 86
Person 85.7
Person 85.1
Person 84.4
Food 81.1
Meal 81.1
Person 78.5
Person 77.9
Person 75.3
Person 73.8
Dessert 69.9
Person 68.5
People 63.9
Person 63.3
Person 62.4
Person 57.5
Person 55.3
Person 50.9
Person 47.7
Person 42.9

Clarifai
created on 2019-06-01

people 99.8
group together 98.2
group 98
man 97.7
many 97.5
adult 97.5
woman 94.9
war 89
crowd 86.5
audience 84.8
uniform 84.6
sit 84.1
leader 83.5
administration 82.8
chair 78.5
military 77.9
furniture 75.9
room 74.2
child 71.1
indoors 67.4

Imagga
created on 2019-06-01

shoe shop 100
shop 88.6
mercantile establishment 67.4
place of business 45.5
people 28.4
hospital 23.6
establishment 22.8
adult 21.5
case 21.2
man 20.8
person 20.4
work 19.6
room 17.7
male 17
business 16.4
medical 15.9
indoors 15.8
interior 15
doctor 15
patient 14.8
professional 14.7
women 14.2
technology 13.3
science 13.3
health 13.2
men 12.9
office 12.2
education 12.1
table 12.1
home 11.9
modern 11.9
smiling 11.6
working 11.5
occupation 11
worker 10.7
indoor 10
salon 10
happy 10
care 9.9
medicine 9.7
computer 9.6
window 9.5
lifestyle 9.4
treatment 9.2
to 8.8
job 8.8
illness 8.6
house 8.3
wood 8.3
inside 8.3
life 8.2
student 8.1
cheerful 8.1
group 8.1
face 7.8
luxury 7.7
equipment 7.7
casual 7.6
hand 7.6
college 7.6
chair 7.6
human 7.5
light 7.3
20s 7.3
passenger 7.3
businesswoman 7.3
looking 7.2
smile 7.1
portrait 7.1
day 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 98.5
clothing 94.4
wedding dress 91.1
man 90.9
bride 84.2
woman 83.4
food 80.7
people 74
group 69
old 47.3
posing 43.7

Face analysis

Amazon

AWS Rekognition

Age 26-44
Gender Female, 60.8%
Disgusted 0.3%
Confused 0.4%
Surprised 0.5%
Calm 92.5%
Happy 0.7%
Angry 1.7%
Sad 4%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Sad 69.9%
Confused 2.6%
Disgusted 0.6%
Surprised 1.8%
Angry 3.8%
Happy 0.8%
Calm 20.6%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Angry 45.5%
Confused 45.2%
Surprised 45.3%
Happy 46.8%
Sad 50.7%
Calm 46.2%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 52.9%
Calm 45.1%
Disgusted 45.1%
Sad 54%
Surprised 45.1%
Happy 45.5%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Sad 47.6%
Surprised 46%
Disgusted 45.5%
Angry 46.1%
Calm 46.3%
Happy 45.2%
Confused 48.3%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.9%
Angry 49.6%
Calm 49.8%
Surprised 49.6%
Confused 49.5%
Sad 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Sad 49.6%
Happy 49.8%
Surprised 49.5%
Calm 49.9%
Disgusted 49.5%
Confused 49.6%
Angry 49.5%

AWS Rekognition

Age 26-44
Gender Female, 50.4%
Surprised 49.5%
Sad 49.8%
Happy 49.6%
Angry 49.7%
Disgusted 49.7%
Confused 49.5%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Disgusted 49.6%
Calm 49.7%
Surprised 49.6%
Angry 49.5%
Happy 49.6%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Happy 49.6%
Disgusted 49.6%
Angry 49.9%
Calm 49.6%
Sad 49.7%
Confused 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.8%
Surprised 49.6%
Happy 49.6%
Angry 49.6%
Calm 49.8%
Confused 49.6%
Disgusted 49.6%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Sad 49.8%
Angry 49.7%
Happy 49.5%
Confused 49.6%
Calm 49.7%
Surprised 49.6%
Disgusted 49.6%

AWS Rekognition

Age 38-59
Gender Male, 97.9%
Happy 3.1%
Disgusted 1.5%
Angry 1.4%
Calm 88.6%
Surprised 2.4%
Confused 1.6%
Sad 1.2%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Angry 49.6%
Sad 50%
Disgusted 49.5%
Happy 49.6%
Calm 49.7%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Disgusted 49.7%
Sad 49.6%
Happy 49.6%
Confused 49.5%
Surprised 49.6%
Angry 49.5%
Calm 50%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Angry 45.3%
Happy 45.3%
Confused 45.2%
Calm 47%
Surprised 45.1%
Sad 51.9%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Angry 46%
Disgusted 45.7%
Confused 45.8%
Calm 49.6%
Sad 46.5%
Surprised 45.9%
Happy 45.6%

AWS Rekognition

Age 35-53
Gender Female, 50.2%
Disgusted 49.5%
Sad 49.9%
Happy 49.6%
Surprised 49.5%
Calm 49.8%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Confused 49.6%
Surprised 49.6%
Calm 49.8%
Sad 49.6%
Happy 49.8%
Disgusted 49.6%
Angry 49.5%

AWS Rekognition

Age 20-38
Gender Male, 50.3%
Happy 49.6%
Confused 49.5%
Disgusted 49.5%
Sad 49.6%
Calm 50.3%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Surprised 49.6%
Happy 49.7%
Disgusted 49.6%
Calm 49.9%
Sad 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Calm 47.3%
Disgusted 45.2%
Confused 45.4%
Surprised 45.6%
Happy 49.2%
Sad 46.8%
Angry 45.6%

AWS Rekognition

Age 15-25
Gender Female, 50.5%
Calm 50.1%
Surprised 49.5%
Disgusted 49.6%
Happy 49.6%
Sad 49.6%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 29-45
Gender Male, 50.8%
Angry 45.3%
Confused 45.1%
Surprised 45.1%
Happy 45.1%
Sad 49.5%
Calm 49.7%
Disgusted 45.1%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Disgusted 49.5%
Calm 49.7%
Angry 49.5%
Sad 49.9%
Surprised 49.6%
Happy 49.6%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Sad 49.6%
Angry 49.7%
Happy 49.6%
Confused 49.6%
Calm 49.6%
Surprised 49.6%
Disgusted 49.8%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Happy 49.6%
Sad 49.7%
Surprised 49.6%
Confused 49.7%
Disgusted 49.6%
Calm 49.8%
Angry 49.5%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Disgusted 49.8%
Calm 49.6%
Confused 49.6%
Sad 49.8%
Surprised 49.6%
Angry 49.6%
Happy 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Confused 49.6%
Disgusted 49.8%
Happy 49.7%
Surprised 49.6%
Calm 49.6%
Sad 49.5%
Angry 49.8%

AWS Rekognition

Age 35-52
Gender Female, 50.4%
Surprised 49.6%
Happy 49.9%
Disgusted 49.6%
Calm 49.7%
Sad 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 15-25
Gender Female, 54.4%
Angry 47%
Sad 49.1%
Happy 45.4%
Calm 45.5%
Confused 46%
Disgusted 46.4%
Surprised 45.6%

AWS Rekognition

Age 26-44
Gender Female, 50.1%
Angry 49.6%
Sad 49.6%
Disgusted 49.6%
Surprised 49.6%
Happy 49.6%
Calm 49.9%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Sad 49.6%
Angry 49.5%
Calm 50.2%
Confused 49.6%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50%
Angry 49.6%
Happy 49.6%
Confused 49.6%
Sad 49.7%
Calm 49.8%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 30-47
Gender Female, 50.1%
Angry 49.6%
Surprised 49.5%
Disgusted 49.7%
Sad 49.7%
Calm 49.8%
Happy 49.6%
Confused 49.5%

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 90.3%
a vintage photo of a group of people posing for the camera 87%
a vintage photo of a group of people standing in front of a crowd 84.7%