Human Generated Data

Title

Untitled (five men standing behind four women on porch)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11252

Human Generated Data

Title

Untitled (five men standing behind four women on porch)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.8
Person 97.8
Person 97.6
Person 97.3
Clothing 97.1
Apparel 97.1
Person 97.1
Person 96.7
Person 96.7
Person 95.9
Person 95.6
Tie 94.4
Accessory 94.4
Accessories 94.4
Person 92.8
Coat 91.6
Overcoat 91.6
Suit 91.6
Tie 90.8
Tie 89
Suit 88.8
People 84.2
Suit 78.4
Jury 74
Court 68.7
Room 68.7
Indoors 68.7
Standing 68.5

Imagga
created on 2022-01-23

kin 48.6
man 35.7
people 30.1
business 29.1
male 29.1
corporate 26.6
businessman 25.6
person 24.7
adult 23.5
black 22.3
men 21.5
office 21.1
group 20.1
professional 18.7
building 17.7
suit 17.6
happy 16.9
attractive 15.4
executive 15
businesswoman 14.5
women 14.2
portrait 14.2
businesspeople 14.2
happiness 14.1
room 14
team 13.4
work 13.3
silhouette 13.2
meeting 13.2
couple 13.1
groom 12.7
job 12.4
worker 12.2
smile 12.1
success 12.1
classroom 11.6
standing 11.3
teamwork 11.1
youth 11.1
family 10.7
modern 10.5
looking 10.4
employee 10.1
indoor 10
face 9.9
jacket 9.9
indoors 9.7
formal 9.5
career 9.5
confident 9.1
home 8.8
corporation 8.7
diversity 8.6
clothing 8.6
casual 8.5
pretty 8.4
manager 8.4
hand 8.3
successful 8.2
handsome 8
lifestyle 7.9
diverse 7.8
businessmen 7.8
staff 7.8
colleagues 7.8
boss 7.6
walk 7.6
ethnic 7.6
communication 7.6
fashion 7.5
pose 7.2
night 7.1

Google
created on 2022-01-23

Coat 91.4
Suit 83.4
Plant 77.6
Classic 75.8
Vintage clothing 74.1
White-collar worker 73.9
Event 73.6
Formal wear 71.6
Monochrome 69.1
Team 66.6
History 66.5
Waste container 62.3
Monochrome photography 62.1
Uniform 58.2
Retro style 54.5
Family 53.9
Room 50.9

Microsoft
created on 2022-01-23

smile 97.9
clothing 97
person 96.8
suit 93.5
outdoor 90.8
posing 88.5
woman 88.2
man 86.8
standing 83.4
human face 82.1
group 70.4
dress 67.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 76.1%
Confused 22.5%
Happy 0.5%
Angry 0.3%
Sad 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 59-67
Gender Male, 100%
Calm 96.9%
Sad 1.6%
Angry 0.6%
Confused 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 98.8%
Confused 0.6%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 98.7%
Angry 0.5%
Sad 0.3%
Confused 0.3%
Disgusted 0.1%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 48-54
Gender Female, 99.9%
Calm 92.8%
Happy 2.4%
Sad 1.4%
Confused 1%
Angry 0.8%
Surprised 0.6%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 52-60
Gender Female, 100%
Calm 81.3%
Sad 7.7%
Confused 3.8%
Disgusted 2.3%
Fear 2%
Angry 1.2%
Happy 1%
Surprised 0.8%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 99.9%
Angry 0%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Female, 100%
Calm 98.5%
Happy 0.7%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 99.5%
Angry 0.3%
Sad 0.1%
Confused 0%
Happy 0%
Disgusted 0%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Tie 94.4%
Suit 91.6%

Captions

Microsoft

Peggy Seeger, Walter Damrosch posing for a photo 97.8%
Peggy Seeger, Walter Damrosch posing for a picture 97.7%
Peggy Seeger, Walter Damrosch posing for the camera 97.6%