Human Generated Data

Title

Untitled (group of men on stairway)
Date

c. 1975
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1384

Human Generated Data

Title

Untitled (group of men on stairway)

People

Artist: Ken Whitmire Associates, American

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Overcoat 99.8
Coat 99.8
Apparel 99.8
Person 98.7
Human 98.7
Shoe 97.9
Footwear 97.9
Tuxedo 97.2
Shoe 96.6
Person 95.6
Person 95.6
Person 94.3
Person 93.1
Tie 93
Accessories 93
Accessory 93
Person 90.9
Person 90.8
Person 89.9
Person 89.8
Potted Plant 87.8
Vase 87.8
Jar 87.8
Pottery 87.8
Plant 87.8
Suit 86.7
Person 86.2
Person 84.5
Face 82.1
Chair 80.9
Furniture 80.9
Suit 76.9
People 72.8
Shoe 69.6
Crowd 68.9
Blazer 66.3
Jacket 66.3
Man 64.1
Suit 62.6
Dress 62.6
Portrait 62.1
Photography 62.1
Photo 62.1
Shoe 58.9
Standing 58.8
Female 56.2
Flower 56.1
Blossom 56.1
Kid 55.8
Child 55.8
Smile 55.1
Tie 51

Imagga
created on 2022-01-22

brass 29.8
wind instrument 26.4
clothing 24.3
uniform 23.2
musical instrument 21.3
man 20.8
military uniform 20.4
people 20.1
male 17.7
person 14.3
military 13.5
trombone 12.3
covering 11.7
horse 11.4
outfit 11.3
travel 11.3
city 10.8
soldier 10.7
weapon 10.2
architecture 10.1
gun 10.1
bass 9.8
fashion 9.8
pedestrian 9.7
group 9.7
adult 9.6
men 9.4
leisure 9.1
holding 9.1
tourism 9.1
consumer goods 9
outdoors 8.9
camouflage 8.8
statue 8.8
war 8.7
walking 8.5
business 8.5
tourist 8.4
old 8.4
protection 8.2
mask 8.1
to 8
couple 7.8
sculpture 7.6
sport 7.5
monument 7.5
danger 7.3
industrial 7.3
history 7.2
women 7.1
day 7.1

Google
created on 2022-01-22

Plant 93
Coat 87
Military person 81.4
Suit 79.1
Vintage clothing 71.6
Crew 70.4
Formal wear 69.9
Monochrome 69.2
Event 69
Classic 68.3
Uniform 67.3
Monochrome photography 67.1
History 65.2
Stock photography 63.2
Art 62.9
Room 61.5
Team 60.9
Military officer 60
Non-commissioned officer 59.3
White-collar worker 59.2

Microsoft
created on 2022-01-22

clothing 92.5
black and white 91.6
man 90.3
person 88.4
standing 83.7
group 77.5
posing 76
white 64.3
suit 63.2
old 60.9
people 55
clothes 19.1
crowd 0.8

Face analysis

Amazon

Google

AWS Rekognition

Age 59-69
Gender Male, 100%
Happy 53.5%
Calm 44.2%
Sad 1%
Confused 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 99.8%
Surprised 0%
Confused 0%
Calm 0%
Disgusted 0%
Fear 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Happy 96%
Sad 1.1%
Calm 0.9%
Angry 0.7%
Surprised 0.4%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Happy 56.4%
Calm 36%
Angry 2%
Surprised 1.5%
Disgusted 1.3%
Sad 1.3%
Confused 1.2%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Happy 96%
Calm 1.6%
Confused 0.9%
Angry 0.5%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 26-36
Gender Male, 100%
Happy 41.8%
Sad 17.6%
Disgusted 14%
Confused 10.1%
Angry 8.9%
Calm 4.9%
Surprised 1.4%
Fear 1.4%

AWS Rekognition

Age 28-38
Gender Male, 100%
Sad 45.8%
Calm 17.7%
Happy 17.5%
Angry 6.1%
Disgusted 5%
Confused 4.1%
Fear 2.4%
Surprised 1.5%

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Happy 98.2%
Calm 0.6%
Sad 0.4%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Happy 87%
Sad 5.3%
Fear 2.9%
Calm 2%
Disgusted 1%
Confused 0.8%
Angry 0.7%
Surprised 0.4%

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 99.6%
Calm 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%
Sad 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Happy 98.4%
Calm 0.7%
Confused 0.4%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 70-80
Gender Male, 98.1%
Happy 98.6%
Calm 0.6%
Confused 0.2%
Disgusted 0.2%
Sad 0.2%
Fear 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 69-79
Gender Male, 100%
Happy 75.3%
Calm 24%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 48-56
Gender Male, 71.2%
Happy 96.8%
Calm 1.7%
Sad 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 43-51
Gender Male, 100%
Happy 99.6%
Confused 0.1%
Surprised 0.1%
Calm 0.1%
Sad 0.1%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 59-67
Gender Male, 99.4%
Calm 60.8%
Confused 32.5%
Happy 2%
Angry 1.8%
Sad 1.3%
Disgusted 1.1%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Happy 77.4%
Calm 19.8%
Confused 0.6%
Surprised 0.5%
Disgusted 0.5%
Fear 0.4%
Sad 0.4%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 95.3%
Angry 1.6%
Confused 1.4%
Happy 0.8%
Sad 0.4%
Disgusted 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 44.5%
Fear 25.9%
Happy 18.1%
Angry 4.5%
Disgusted 4.3%
Calm 1.1%
Confused 1%
Surprised 0.7%

AWS Rekognition

Age 34-42
Gender Male, 99.7%
Happy 97.9%
Surprised 0.5%
Calm 0.5%
Disgusted 0.3%
Fear 0.2%
Sad 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Happy 95.7%
Calm 2.5%
Surprised 0.4%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%
Sad 0.2%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Calm 64.6%
Sad 16.8%
Surprised 6.2%
Confused 4.1%
Angry 3.4%
Fear 2.4%
Happy 1.4%
Disgusted 1.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Happy 99.1%
Calm 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%

AWS Rekognition

Age 56-64
Gender Male, 99%
Happy 83.4%
Calm 10.7%
Confused 3.4%
Surprised 0.8%
Disgusted 0.7%
Angry 0.4%
Fear 0.4%
Sad 0.3%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Happy 93.5%
Disgusted 4.6%
Confused 0.6%
Calm 0.3%
Surprised 0.3%
Sad 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Happy 99.5%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%
Calm 0%

AWS Rekognition

Age 43-51
Gender Male, 99.4%
Happy 99.2%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Happy 98.9%
Calm 0.6%
Surprised 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 99%
Fear 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 98.8%
Calm 0.3%
Sad 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 99.4%
Angry 0.1%
Calm 0.1%
Confused 0.1%
Surprised 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 36-44
Gender Male, 100%
Happy 99.7%
Confused 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Sad 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 50-58
Gender Male, 100%
Happy 99.8%
Confused 0%
Calm 0%
Disgusted 0%
Angry 0%
Surprised 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 62.4%
Calm 34.7%
Angry 0.9%
Disgusted 0.7%
Confused 0.4%
Sad 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Sad 67.6%
Confused 13.8%
Calm 13.1%
Fear 1.6%
Surprised 1.4%
Angry 1%
Happy 0.9%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Female, 68.6%
Fear 57.1%
Sad 37.1%
Confused 1.8%
Calm 1.7%
Surprised 1.1%
Angry 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 100%
Happy 90.8%
Confused 2.7%
Calm 2.3%
Surprised 1.5%
Disgusted 1.1%
Sad 0.8%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 43-51
Gender Male, 100%
Sad 83.1%
Calm 13%
Happy 2.4%
Confused 0.4%
Fear 0.4%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.1%
Happy 71.4%
Sad 25.9%
Disgusted 0.7%
Angry 0.7%
Fear 0.5%
Surprised 0.4%
Confused 0.3%
Calm 0.2%

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Happy 97.9%
Calm 1.5%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Male, 93%
Calm 78.6%
Happy 13.8%
Sad 4%
Confused 1.1%
Fear 1%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 50-58
Gender Male, 100%
Happy 96.2%
Confused 1.8%
Disgusted 0.6%
Calm 0.5%
Sad 0.3%
Surprised 0.3%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Sad 86.4%
Calm 10.9%
Angry 0.7%
Disgusted 0.7%
Surprised 0.4%
Confused 0.4%
Fear 0.3%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 84.3%
Confused 4.3%
Sad 4%
Happy 3.3%
Surprised 2.4%
Disgusted 0.6%
Angry 0.6%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Shoe 97.9%
Tie 93%
Suit 86.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.6%
a vintage photo of a group of people posing for a picture 97.5%
a group of people posing for a photo 97.4%