Human Generated Data

Title

Untitled (portrait on steps of large group of men and priests)

Date

c. 1937, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5807

Human Generated Data

Title

Untitled (portrait on steps of large group of men and priests)

People

Artist: Durette Studio, American 20th century

Date

c. 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.4
Human 99.4
Person 98.9
Person 95.4
Person 95.3
Person 95.2
Person 94
Person 93.6
Person 93.3
Person 93
Person 92.8
Crowd 91.6
Person 88.3
People 87.6
Clothing 84.1
Apparel 84.1
Person 83.1
Military 77.5
Military Uniform 75.9
Person 74.7
Person 73.1
Overcoat 73
Coat 73
Suit 73
Sitting 65.7
Officer 63.5
Audience 60.5
Person 60.3
Army 59.4
Troop 59.4
Armored 59.4
Room 59.3
Indoors 59.3
Classroom 57
School 57
Person 53.3

Clarifai
created on 2019-11-16

people 99.9
many 99.5
adult 98.3
group together 97.9
group 97.8
crowd 95.9
man 95.7
wear 94.1
woman 94
ceremony 93.6
leader 91.3
military 90.2
war 89.7
child 88.3
outfit 86.6
uniform 85.4
administration 84.6
soldier 84.3
boy 84.2
funeral 82.9

Imagga
created on 2019-11-16

musical instrument 26.1
man 22.8
wind instrument 21.5
snow 20.8
people 19.5
black 19.3
kin 17.9
winter 17.9
person 16.1
male 14.9
accordion 13.6
cold 12.9
men 12.9
silhouette 12.4
brass 12.1
grunge 11.9
old 11.8
city 11.6
group 11.3
keyboard instrument 11.3
portrait 11
walk 10.5
ice 10.4
street 10.1
pedestrian 10
dirty 9.9
world 9.9
adult 9.9
outdoors 9.7
couple 9.6
sport 9.4
trombone 9.4
season 9.3
singer 9.3
tree 9.2
business 9.1
park 9.1
businessman 8.8
urban 8.7
forest 8.7
women 8.7
scene 8.7
frost 8.6
walking 8.5
outdoor 8.4
dark 8.3
vintage 8.3
landscape 8.2
art 8
violin 7.8
travel 7.7
crowd 7.7
musician 7.5
pattern 7.5
happy 7.5
weather 7.4
design 7.3
clothing 7.3
active 7.2
together 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 97.6
outdoor 97.2
person 91.7
group 91.5
clothing 90.6
people 86
standing 78.2
posing 69.2
crowd 3.1

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-32
Gender Male, 54.9%
Fear 45%
Confused 46.2%
Happy 45%
Calm 52.2%
Surprised 45%
Sad 45.9%
Angry 45.3%
Disgusted 45.3%

AWS Rekognition

Age 12-22
Gender Female, 53.1%
Fear 45.6%
Sad 45.3%
Surprised 45.7%
Angry 46.6%
Disgusted 45.1%
Confused 45.2%
Happy 46.2%
Calm 50.3%

AWS Rekognition

Age 26-42
Gender Male, 54.9%
Happy 45%
Disgusted 45%
Sad 45.1%
Angry 45.5%
Surprised 45%
Fear 45%
Calm 54.4%
Confused 45%

AWS Rekognition

Age 26-42
Gender Male, 54.9%
Sad 52.9%
Fear 45.1%
Disgusted 45%
Surprised 45%
Angry 45.6%
Calm 46.1%
Happy 45.1%
Confused 45.2%

AWS Rekognition

Age 21-33
Gender Male, 51.2%
Disgusted 45.4%
Happy 45.1%
Surprised 45.1%
Sad 46.3%
Fear 45.1%
Calm 47.7%
Angry 49.8%
Confused 45.5%

AWS Rekognition

Age 21-33
Gender Male, 54.9%
Confused 45.2%
Fear 45%
Angry 47.8%
Sad 45.3%
Disgusted 45%
Surprised 45%
Happy 45%
Calm 51.7%

AWS Rekognition

Age 25-39
Gender Male, 53.3%
Confused 45.1%
Surprised 45%
Sad 45%
Calm 45.1%
Disgusted 45%
Happy 45%
Fear 45%
Angry 54.7%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Angry 49.5%
Surprised 49.5%
Sad 50%
Happy 49.5%
Disgusted 49.5%
Confused 49.6%
Calm 49.5%
Fear 49.7%

AWS Rekognition

Age 26-40
Gender Male, 54.6%
Angry 45.1%
Surprised 45%
Sad 45.1%
Happy 45.1%
Disgusted 45%
Confused 45%
Calm 54.7%
Fear 45%

AWS Rekognition

Age 37-55
Gender Male, 52.9%
Happy 45.1%
Sad 45.6%
Disgusted 46%
Calm 51.1%
Angry 45.9%
Surprised 45.2%
Fear 45%
Confused 46.2%

AWS Rekognition

Age 46-64
Gender Female, 53.1%
Happy 52.3%
Fear 45%
Sad 45.3%
Confused 45%
Disgusted 45.1%
Surprised 45.3%
Calm 46.7%
Angry 45.2%

AWS Rekognition

Age 23-37
Gender Male, 50.1%
Angry 49.5%
Calm 49.5%
Happy 49.5%
Sad 50.5%
Fear 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Angry 50.1%
Fear 49.8%
Disgusted 49.5%
Sad 49.6%
Confused 49.5%
Calm 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Confused 45.6%
Happy 45%
Fear 45.1%
Sad 45.1%
Surprised 45.4%
Angry 50.9%
Disgusted 45.2%
Calm 47.7%

AWS Rekognition

Age 24-38
Gender Male, 54.8%
Happy 45%
Disgusted 45%
Fear 45%
Calm 55%
Angry 45%
Confused 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 25-39
Gender Male, 54.3%
Angry 45.3%
Sad 46.3%
Happy 45.1%
Disgusted 47.1%
Calm 50.7%
Confused 45.1%
Surprised 45.1%
Fear 45.3%

AWS Rekognition

Age 22-34
Gender Male, 54.2%
Calm 45.3%
Angry 48.6%
Surprised 45%
Disgusted 45.1%
Happy 45%
Sad 49.9%
Fear 45%
Confused 46%

AWS Rekognition

Age 23-37
Gender Female, 50.2%
Fear 49.5%
Sad 49.5%
Happy 49.6%
Disgusted 49.5%
Calm 49.6%
Confused 49.5%
Angry 50.2%
Surprised 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.8%
Sad 46.9%
Angry 45.3%
Happy 49.1%
Calm 45.7%
Fear 45.2%
Disgusted 46.9%
Confused 45.7%
Surprised 45.2%

AWS Rekognition

Age 28-44
Gender Male, 52.7%
Happy 45.1%
Angry 45.7%
Disgusted 45.2%
Sad 45.3%
Surprised 45.3%
Calm 53.3%
Fear 45.1%
Confused 45.1%

AWS Rekognition

Age 42-60
Gender Male, 54.4%
Sad 45.3%
Disgusted 45.5%
Fear 45%
Angry 53.1%
Happy 45%
Surprised 45%
Calm 45.7%
Confused 45.3%

AWS Rekognition

Age 23-35
Gender Male, 50.3%
Sad 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 50.3%
Confused 49.5%

AWS Rekognition

Age 36-52
Gender Male, 52.8%
Disgusted 45.1%
Fear 45.1%
Surprised 45%
Angry 45.9%
Calm 45.2%
Happy 45%
Confused 45%
Sad 53.6%

AWS Rekognition

Age 24-38
Gender Male, 53.9%
Confused 46.5%
Fear 45%
Sad 45.2%
Disgusted 45.1%
Happy 45.1%
Angry 52.9%
Calm 45.2%
Surprised 45%

AWS Rekognition

Age 24-38
Gender Male, 50.1%
Angry 50.1%
Surprised 49.5%
Sad 49.6%
Happy 49.5%
Calm 49.8%
Fear 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 32-48
Gender Male, 50.4%
Angry 49.5%
Happy 49.6%
Disgusted 49.5%
Fear 49.6%
Confused 49.5%
Surprised 49.5%
Calm 50.2%
Sad 49.7%

AWS Rekognition

Age 39-57
Gender Male, 51.1%
Fear 45.1%
Calm 46.1%
Angry 50.3%
Disgusted 45.4%
Confused 47.4%
Surprised 45.2%
Sad 45.3%
Happy 45.1%

AWS Rekognition

Age 23-35
Gender Male, 53.4%
Angry 48%
Calm 45.2%
Fear 45.1%
Disgusted 45.2%
Surprised 45.1%
Happy 51.2%
Sad 45.1%
Confused 45.1%

AWS Rekognition

Age 23-35
Gender Male, 50.5%
Disgusted 49.5%
Sad 50.2%
Fear 49.5%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 27-43
Gender Male, 54.3%
Happy 45%
Angry 45.4%
Confused 45.3%
Calm 54%
Disgusted 45.1%
Fear 45%
Surprised 45%
Sad 45.2%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Fear 49.5%
Angry 49.6%
Sad 50.1%
Happy 49.5%
Calm 49.8%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 35-51
Gender Male, 53.8%
Angry 53.8%
Calm 45.2%
Sad 45.3%
Happy 45.2%
Fear 45.1%
Confused 45.2%
Surprised 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-40
Gender Male, 51.4%
Fear 45%
Calm 54.8%
Disgusted 45%
Angry 45%
Surprised 45%
Happy 45%
Sad 45.1%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Disgusted 45%
Fear 45%
Confused 45%
Calm 54.8%
Surprised 45%
Angry 45%
Sad 45.2%
Happy 45%

AWS Rekognition

Age 33-49
Gender Male, 50.2%
Happy 49.6%
Fear 49.8%
Sad 49.8%
Confused 49.6%
Disgusted 49.5%
Surprised 49.6%
Calm 49.6%
Angry 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Calm 50.2%
Sad 49.6%
Fear 49.5%
Confused 49.5%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 43-61
Gender Male, 52.9%
Surprised 45%
Calm 47.7%
Happy 45%
Angry 51.1%
Fear 45.1%
Sad 45.8%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 26-42
Gender Male, 50.4%
Happy 49.5%
Angry 50.5%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%
Sad 49.5%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 47-65
Gender Male, 50.4%
Fear 49.5%
Angry 49.5%
Calm 50.4%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 17-29
Gender Female, 50.4%
Fear 50.1%
Calm 49.7%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.6%
Angry 49.5%

AWS Rekognition

Age 25-39
Gender Female, 50%
Fear 49.5%
Sad 50.4%
Confused 49.5%
Angry 49.5%
Happy 49.5%
Calm 49.6%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.3%
Calm 49.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 50.4%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 8-18
Gender Male, 52.1%
Angry 45.9%
Surprised 47.3%
Disgusted 45.1%
Confused 45.1%
Fear 45.9%
Calm 46.7%
Happy 48.9%
Sad 45.1%

AWS Rekognition

Age 26-42
Gender Male, 54.5%
Angry 45.1%
Happy 45%
Calm 54.9%
Confused 45%
Disgusted 45%
Fear 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 24-38
Gender Male, 50.4%
Calm 50.3%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.6%
Fear 49.5%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.5%
Fear 49.5%
Disgusted 49.6%
Calm 49.6%
Angry 49.6%
Sad 49.6%
Surprised 49.5%
Happy 50.1%
Confused 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.4%
Happy 49.5%
Calm 50.4%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Disgusted 49.5%
Fear 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.9%
Happy 49.5%
Confused 49.5%
Sad 50%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Calm 54.8%
Sad 45%
Happy 45.2%
Angry 45%
Surprised 45%
Confused 45%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 23-35
Gender Male, 50.5%
Calm 50.1%
Happy 49.5%
Angry 49.6%
Disgusted 49.5%
Fear 49.5%
Sad 49.8%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-32
Gender Male, 51.2%
Calm 46.1%
Fear 45%
Angry 53.2%
Disgusted 45.3%
Sad 45.1%
Happy 45.1%
Surprised 45%
Confused 45.2%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Calm 50.5%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Fear 49.5%
Angry 49.5%
Calm 49.8%
Happy 49.5%
Sad 50.2%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 32-48
Gender Male, 50.4%
Disgusted 49.5%
Sad 49.5%
Calm 50.2%
Fear 49.5%
Happy 49.6%
Confused 49.5%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Calm 50.4%
Disgusted 49.5%
Sad 49.5%
Angry 49.5%
Fear 49.5%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Disgusted 49.5%
Calm 50.3%
Surprised 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Angry 49.6%

AWS Rekognition

Age 15-27
Gender Female, 50.3%
Fear 50.4%
Angry 49.5%
Calm 49.5%
Surprised 49.6%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-35
Gender Male, 54%
Surprised 45.1%
Angry 45.3%
Fear 45%
Calm 47.1%
Confused 45.1%
Sad 45.2%
Disgusted 52.3%
Happy 45%

Microsoft Cognitive Services

Age 41
Gender Male

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 96.9%
a group of people posing for a photo in front of a crowd 96.8%
a group of people posing for a photo in front of a building 96.7%

Text analysis

Google

a
a