Human Generated Data

Title

Untitled (large group portrait of men in pith helmets and military uniforms)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11218

Human Generated Data

Title

Untitled (large group portrait of men in pith helmets and military uniforms)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

School 99.1
Human 98.9
Person 98.9
Classroom 98.8
Room 98.8
Indoors 98.8
Person 98.2
Person 97.2
Person 96.1
Person 94.7
Person 93.6
Person 90.1
Person 87.3
Person 85.3
Person 84.6
Person 81.7
Person 81
Person 80.7
Person 80.6
Person 67.1
Person 66.1
Person 65.3
Person 62.5
Kindergarten 60.4
Person 57.8
Person 43.1

Imagga
created on 2022-01-23

classroom 100
room 79.7
building 25.1
structure 18.8
chair 18.4
row 17.7
group 14.5
travel 14.1
empty 13.7
school 13.4
business 13.4
seat 13.3
city 12.5
hall 11.9
architecture 11.7
landscape 11.2
industry 11.1
house 10.9
sky 10.8
furniture 10.8
water 10
support 10
modern 9.8
old 9.7
new 9.7
animal 9.4
nobody 9.3
horizontal 9.2
tourism 9.1
vacation 9
people 8.9
sun 8.8
construction 8.6
pattern 8.2
theater 8.2
metal 8
light 8
interior 8
design 7.9
urban 7.9
standing 7.8
sea 7.8
table 7.8
color 7.8
summer 7.7
baluster 7.5
exterior 7.4
shop 7.4
lake 7.3
window 7.3
center 7.1

Google
created on 2022-01-23

Martial arts uniform 96.4
Sports uniform 95.5
Dobok 95.4
Martial arts 90.5
Japanese martial arts 89.1
Combat sport 88.5
Karate 86.5
Contact sport 83.1
Striking combat sports 82.5
Sports 81
Doshu 74.7
Uniform 74.3
Kung fu 74.2
Team 71.2
Event 69.7
Competition event 67.5
Team sport 67.4
School uniform 66.6
Room 65.5
Class 65

Microsoft
created on 2022-01-23

person 94
group 74.3
posing 71
old 66.8

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 93.9%
Happy 71.3%
Calm 8.1%
Angry 5%
Fear 4.1%
Sad 3.6%
Confused 3.5%
Surprised 2.9%
Disgusted 1.4%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 66.5%
Angry 19.9%
Fear 4.8%
Surprised 4.3%
Happy 1.7%
Disgusted 1.1%
Confused 0.9%
Sad 0.8%

AWS Rekognition

Age 23-31
Gender Male, 82.4%
Calm 73.3%
Surprised 12.4%
Angry 7.4%
Happy 1.7%
Fear 1.5%
Sad 1.4%
Confused 1.4%
Disgusted 1%

AWS Rekognition

Age 38-46
Gender Male, 98.2%
Calm 95.5%
Fear 1.1%
Surprised 0.8%
Happy 0.6%
Confused 0.6%
Sad 0.6%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 97.5%
Happy 88.4%
Angry 4.9%
Fear 4%
Surprised 1.1%
Calm 0.8%
Confused 0.3%
Sad 0.3%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Male, 78.5%
Calm 99.1%
Sad 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 25-35
Gender Male, 82.3%
Angry 59.3%
Calm 17.2%
Surprised 10.4%
Disgusted 6.7%
Happy 4.1%
Fear 1.1%
Confused 0.6%
Sad 0.6%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 98.5%
Angry 0.6%
Surprised 0.3%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Female, 98.8%
Calm 98%
Angry 1.1%
Happy 0.4%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 10-18
Gender Male, 99.2%
Calm 99.3%
Surprised 0.2%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 100%
Angry 28.3%
Calm 23.3%
Fear 16.8%
Disgusted 10.8%
Confused 8.8%
Surprised 5.4%
Happy 3.6%
Sad 3%

AWS Rekognition

Age 30-40
Gender Female, 57.8%
Angry 49.5%
Calm 47%
Surprised 1.4%
Sad 0.7%
Happy 0.6%
Fear 0.4%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-26
Gender Female, 84.3%
Calm 78.5%
Fear 9.5%
Angry 3.6%
Surprised 2.5%
Happy 2.5%
Sad 2%
Disgusted 0.7%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 61.8%
Fear 32.4%
Surprised 2.9%
Angry 1.2%
Sad 0.9%
Disgusted 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 62.4%
Angry 23.9%
Surprised 6%
Happy 2%
Confused 1.8%
Sad 1.6%
Disgusted 1.4%
Fear 0.9%

AWS Rekognition

Age 23-33
Gender Female, 69%
Calm 64.3%
Angry 16.7%
Fear 8.2%
Surprised 5.6%
Sad 1.4%
Disgusted 1.4%
Confused 1.4%
Happy 0.9%

AWS Rekognition

Age 30-40
Gender Male, 72.7%
Angry 50.3%
Calm 28.7%
Fear 10.8%
Surprised 3.5%
Sad 3.2%
Happy 2%
Disgusted 1.2%
Confused 0.3%

AWS Rekognition

Age 30-40
Gender Male, 96.7%
Calm 98.1%
Angry 0.9%
Happy 0.2%
Sad 0.2%
Fear 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 98.1%
Confused 0.7%
Surprised 0.5%
Angry 0.4%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99.8%
Fear 0.1%
Happy 0%
Confused 0%
Angry 0%
Surprised 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Male, 100%
Calm 66.1%
Angry 32.5%
Sad 0.4%
Surprised 0.3%
Happy 0.2%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 99.8%
Happy 0%
Surprised 0%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 97.1%
Fear 1.5%
Happy 0.4%
Angry 0.3%
Surprised 0.3%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 50.5%
Calm 99.5%
Angry 0.2%
Surprised 0.2%
Fear 0%
Happy 0%
Disgusted 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Angry 72.5%
Sad 15.7%
Surprised 4.7%
Fear 2.2%
Confused 1.6%
Calm 1.4%
Disgusted 1.1%
Happy 0.7%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 66.4%
Happy 30.5%
Angry 1.3%
Confused 0.5%
Sad 0.5%
Surprised 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 89.4%
Happy 60.7%
Calm 19.9%
Surprised 10.8%
Fear 3.5%
Angry 2.5%
Disgusted 1.2%
Sad 0.9%
Confused 0.6%

AWS Rekognition

Age 24-34
Gender Male, 99.3%
Fear 55.6%
Happy 23.9%
Calm 16.6%
Surprised 1.5%
Angry 1.3%
Disgusted 0.4%
Confused 0.3%
Sad 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 96.4%
Surprised 0.9%
Fear 0.8%
Angry 0.8%
Happy 0.4%
Confused 0.3%
Sad 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Fear 78.9%
Calm 16.2%
Happy 3.8%
Surprised 0.3%
Confused 0.3%
Sad 0.2%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-31
Gender Male, 65.7%
Happy 34.7%
Fear 33.3%
Calm 11.4%
Surprised 10.9%
Angry 4.8%
Disgusted 2.1%
Sad 1.6%
Confused 1.1%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 48.3%
Confused 39.1%
Surprised 8%
Fear 1.8%
Happy 1.4%
Angry 0.7%
Sad 0.5%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 95%
Happy 2.3%
Confused 1.4%
Surprised 0.6%
Fear 0.2%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 83.6%
Confused 9.7%
Angry 2.4%
Surprised 2.1%
Sad 0.8%
Happy 0.5%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Calm 58.2%
Happy 18.8%
Surprised 10.5%
Angry 5.6%
Fear 4.1%
Confused 1.4%
Sad 0.7%
Disgusted 0.6%

AWS Rekognition

Age 56-64
Gender Male, 99.9%
Happy 44.3%
Angry 17.6%
Calm 13.7%
Surprised 13.6%
Fear 4.5%
Confused 3.1%
Disgusted 2.3%
Sad 1%

AWS Rekognition

Age 14-22
Gender Male, 99.5%
Calm 99.9%
Fear 0%
Confused 0%
Happy 0%
Angry 0%
Surprised 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 99.7%
Happy 0.1%
Surprised 0.1%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Calm 92.8%
Sad 2.1%
Angry 1.5%
Happy 1.1%
Confused 1%
Fear 0.6%
Surprised 0.6%
Disgusted 0.3%

AWS Rekognition

Age 59-69
Gender Male, 76%
Calm 54.1%
Fear 13.8%
Angry 9.2%
Disgusted 6.9%
Sad 5.9%
Happy 3.7%
Surprised 3.7%
Confused 2.7%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 99.1%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 98.8%
Happy 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 94.8%
Angry 2.5%
Happy 0.8%
Surprised 0.7%
Sad 0.5%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 87.5%
Happy 63.6%
Fear 17.8%
Surprised 6.6%
Angry 5.1%
Calm 3.7%
Confused 1.3%
Sad 1.1%
Disgusted 0.9%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 76.3%
Angry 18.8%
Surprised 2%
Sad 0.8%
Confused 0.7%
Disgusted 0.6%
Fear 0.6%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 97.6%
Happy 1.6%
Fear 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0%

AWS Rekognition

Age 23-31
Gender Male, 92%
Calm 53.7%
Fear 39.6%
Angry 2.1%
Disgusted 1.5%
Surprised 1.4%
Sad 0.7%
Confused 0.6%
Happy 0.3%

AWS Rekognition

Age 20-28
Gender Male, 64.5%
Happy 80.5%
Calm 16.8%
Surprised 0.9%
Disgusted 0.4%
Sad 0.4%
Angry 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.1%
Calm 44.9%
Fear 24%
Angry 16.2%
Happy 9.1%
Surprised 2.7%
Confused 1.5%
Disgusted 1.2%
Sad 0.4%

AWS Rekognition

Age 23-33
Gender Female, 60.6%
Calm 55.6%
Angry 23.5%
Disgusted 5.1%
Sad 5%
Surprised 3.8%
Happy 3%
Fear 2.1%
Confused 1.9%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 46.2%
Happy 20.3%
Angry 19.2%
Disgusted 4.2%
Fear 3.8%
Surprised 2.9%
Sad 1.7%
Confused 1.6%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 85.3%
Fear 13.7%
Angry 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.4%
Calm 76.7%
Angry 10.7%
Fear 3.5%
Happy 2.6%
Confused 2.3%
Surprised 1.8%
Disgusted 1.3%
Sad 1.1%

AWS Rekognition

Age 26-36
Gender Female, 90.4%
Calm 41.6%
Angry 21.9%
Happy 13.9%
Surprised 12.7%
Fear 5.1%
Disgusted 1.7%
Sad 1.6%
Confused 1.4%

AWS Rekognition

Age 36-44
Gender Female, 87%
Calm 95.3%
Angry 3.2%
Sad 0.9%
Surprised 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Male, 84.7%
Calm 88.2%
Angry 3.3%
Disgusted 2.7%
Fear 2%
Sad 1.5%
Confused 1.1%
Surprised 1%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 87.7%
Calm 76.2%
Angry 11.9%
Disgusted 3.4%
Surprised 3.4%
Fear 1.8%
Confused 1.5%
Sad 1.4%
Happy 0.4%

AWS Rekognition

Age 30-40
Gender Male, 99.1%
Calm 70.1%
Fear 15.5%
Happy 6%
Sad 2.1%
Surprised 2%
Angry 1.8%
Confused 1.4%
Disgusted 1.1%

AWS Rekognition

Age 29-39
Gender Female, 82.3%
Calm 50.8%
Happy 22.5%
Fear 7.8%
Angry 6.3%
Sad 4%
Surprised 4%
Confused 2.8%
Disgusted 1.8%

AWS Rekognition

Age 27-37
Gender Male, 54.3%
Calm 96%
Angry 1.2%
Fear 1.1%
Happy 0.6%
Surprised 0.5%
Sad 0.3%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Male, 98.5%
Calm 92.8%
Angry 2.7%
Surprised 1.6%
Sad 1.2%
Confused 0.6%
Fear 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 96.3%
Calm 90.9%
Happy 5.9%
Surprised 2%
Fear 0.5%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 96.9%
Angry 2%
Surprised 0.2%
Happy 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 23-33
Gender Female, 96.9%
Angry 67.8%
Fear 8%
Calm 6.4%
Sad 5.7%
Happy 4.7%
Surprised 3.9%
Confused 2.2%
Disgusted 1.3%

AWS Rekognition

Age 29-39
Gender Female, 99.1%
Calm 71.2%
Angry 9.7%
Happy 8.6%
Fear 4.3%
Surprised 3.3%
Sad 1.8%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-33
Gender Male, 89.8%
Calm 92.6%
Sad 2.3%
Angry 1.5%
Fear 1.1%
Surprised 1.1%
Confused 0.6%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 31-41
Gender Female, 78.3%
Calm 91.7%
Angry 5.2%
Happy 1.2%
Sad 0.7%
Confused 0.6%
Surprised 0.3%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Female, 68.9%
Angry 77.8%
Surprised 8.9%
Calm 8.6%
Happy 1.9%
Sad 1%
Confused 0.7%
Fear 0.6%
Disgusted 0.5%

AWS Rekognition

Age 12-20
Gender Female, 99.3%
Calm 89.1%
Surprised 3.3%
Confused 2.8%
Angry 1.9%
Happy 1.1%
Sad 0.8%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 30-40
Gender Male, 96.8%
Angry 46.6%
Calm 21.2%
Fear 16.8%
Happy 6%
Surprised 4.9%
Disgusted 1.7%
Sad 1.6%
Confused 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Possible

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 91.4%
a group of people posing for a photo in front of a building 90.8%
a group of people posing for the camera 90.7%