Human Generated Data

Title

Untitled (group portrait of Pan Am Life Insurance Company of New Orleans)

Date

1973

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8138

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group portrait of Pan Am Life Insurance Company of New Orleans)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1973

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 98.9
Person 98.7
Person 98.5
Person 98.4
Person 97.2
Person 96.4
Person 93.5
Apparel 93.4
Clothing 93.4
Crowd 92.9
Accessory 89.6
Accessories 89.6
Tie 89.6
Furniture 85.3
Chair 85.3
Person 84.5
Person 83.9
Room 83.6
Indoors 83.6
Tie 81.2
Military 78.5
Audience 78.4
Person 76.9
Person 75.8
Person 72.1
People 71.6
Stage 70.5
Person 69.7
Military Uniform 65.2
Shorts 64.4
Sailor Suit 59.8
Parade 58.2
Officer 56.4
Kid 55.6
Child 55.6
Person 51.1
Person 43.1

Imagga
created on 2022-01-08

stage 39.8
platform 29.1
crowd 28.8
people 25.6
art 21.2
group 20.9
silhouette 20.7
sculpture 16.6
person 16
gymnasium 15.3
men 14.6
flag 14.5
dance 14.4
facility 14.4
team 14.3
business 13.3
athletic facility 12.8
audience 12.7
patriotic 12.5
symbol 12.1
male 12
party 11.2
lights 11.1
teamwork 11.1
man 11
black 10.8
nighttime 10.8
statue 10.7
businessman 10.6
nation 10.4
dancer 10.3
event 10.2
stadium 10.1
cheering 9.8
vibrant 9.6
design 9.6
icon 9.5
famous 9.3
vivid 9.3
city 9.1
old 9
human 9
women 8.7
bright 8.6
adult 8.6
building 8.4
training 8.3
fashion 8.3
spectator 8.3
fun 8.2
history 8
work 7.8
ancient 7.8
travel 7.7
athlete 7.7
performer 7.6
muscular 7.6
architecture 7.4
tourist 7.2
sexy 7.2
body 7.2
job 7.1

Google
created on 2022-01-08

Font 77.4
Event 71.9
Monochrome 71.6
Monochrome photography 71.6
Shorts 69.9
Uniform 67.2
Room 65.5
History 64.9
Team 64.8
Photo caption 63.8
Class 57.5
Vintage clothing 56.6
Crew 53.3
Team sport 51
Suit 50

Microsoft
created on 2022-01-08

text 98.6
posing 92.9
person 87.1
clothing 86.7
group 84.9
baseball 83.7
player 83.5
old 81.2
standing 76.2
man 68.9
white 64.9
team 64.6
clothes 24.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 58.4%
Happy 85%
Calm 6.4%
Disgusted 3.5%
Sad 2.7%
Fear 1%
Angry 0.5%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 18-24
Gender Female, 54.8%
Calm 50.4%
Confused 12.2%
Sad 11%
Angry 9.6%
Disgusted 7.1%
Fear 5.2%
Happy 2.6%
Surprised 2%

AWS Rekognition

Age 34-42
Gender Male, 95.5%
Happy 81.5%
Calm 15%
Sad 1.2%
Surprised 0.8%
Angry 0.4%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 36-44
Gender Female, 62.4%
Calm 98.9%
Fear 0.3%
Happy 0.3%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 41-49
Gender Female, 79.4%
Calm 97.8%
Sad 1.3%
Happy 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Female, 98.7%
Happy 82.4%
Calm 7%
Sad 6.1%
Fear 1.9%
Angry 0.7%
Confused 0.7%
Disgusted 0.6%
Surprised 0.6%

AWS Rekognition

Age 24-34
Gender Male, 96.2%
Calm 99.7%
Confused 0.1%
Happy 0.1%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Happy 79.6%
Calm 7%
Sad 3.7%
Angry 3.1%
Surprised 2.1%
Disgusted 1.8%
Confused 1.5%
Fear 1.1%

AWS Rekognition

Age 14-22
Gender Female, 95.2%
Calm 83.3%
Happy 5.3%
Sad 3.4%
Disgusted 2.3%
Confused 2.3%
Angry 1.2%
Fear 1.1%
Surprised 1.1%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Calm 57.6%
Sad 27.4%
Disgusted 4.4%
Surprised 3.7%
Happy 2.4%
Angry 2%
Fear 1.3%
Confused 1.1%

AWS Rekognition

Age 28-38
Gender Male, 83.4%
Calm 80.5%
Happy 9.1%
Sad 2.9%
Disgusted 2.3%
Confused 1.6%
Fear 1.5%
Surprised 1.4%
Angry 0.7%

AWS Rekognition

Age 27-37
Gender Male, 78.2%
Calm 99.1%
Happy 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 99.7%
Happy 0.2%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 99%
Confused 0.3%
Happy 0.2%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 98.3%
Calm 71.4%
Sad 11%
Disgusted 8.8%
Happy 2.8%
Confused 2.1%
Surprised 1.6%
Angry 1.3%
Fear 1.1%

AWS Rekognition

Age 30-40
Gender Male, 96.6%
Sad 43%
Happy 42.7%
Calm 10.4%
Angry 1%
Fear 0.9%
Disgusted 0.8%
Confused 0.7%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Female, 86.2%
Calm 98.2%
Happy 0.8%
Sad 0.5%
Fear 0.3%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Happy 65.7%
Calm 13.6%
Disgusted 9%
Sad 4%
Angry 3.8%
Fear 1.6%
Confused 1.4%
Surprised 0.8%

AWS Rekognition

Age 29-39
Gender Male, 98%
Calm 75.5%
Happy 16.8%
Disgusted 3.1%
Confused 2%
Surprised 1%
Angry 0.7%
Sad 0.6%
Fear 0.5%

AWS Rekognition

Age 30-40
Gender Male, 93.5%
Calm 71.4%
Confused 8.8%
Sad 6.7%
Happy 6.6%
Surprised 4%
Angry 1.4%
Disgusted 0.9%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 93.3%
Calm 63.4%
Confused 25.9%
Sad 3.2%
Happy 3.1%
Surprised 1.6%
Disgusted 1.4%
Angry 1%
Fear 0.5%

AWS Rekognition

Age 48-54
Gender Male, 75.4%
Happy 70.7%
Calm 20.5%
Sad 4.2%
Surprised 2.9%
Angry 0.6%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 51-59
Gender Male, 98.4%
Calm 89.2%
Sad 5.3%
Happy 4%
Confused 0.8%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 93.2%
Calm 99.5%
Happy 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 96.7%
Disgusted 24.4%
Calm 21.6%
Fear 16.3%
Happy 12.6%
Confused 8.3%
Surprised 8.2%
Sad 7.1%
Angry 1.5%

AWS Rekognition

Age 36-44
Gender Male, 57.4%
Happy 48.2%
Calm 21.4%
Fear 13.2%
Angry 8.4%
Disgusted 3%
Sad 2.8%
Confused 2%
Surprised 1%

AWS Rekognition

Age 48-56
Gender Female, 99.2%
Sad 36.7%
Happy 20.8%
Disgusted 11.2%
Fear 8.7%
Angry 7.9%
Confused 6.4%
Calm 5.5%
Surprised 2.9%

AWS Rekognition

Age 4-12
Gender Female, 70.9%
Calm 82.7%
Happy 7.4%
Sad 6.2%
Disgusted 2.2%
Fear 0.7%
Confused 0.4%
Angry 0.4%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 100%
Happy 39.2%
Disgusted 32.1%
Fear 8.3%
Calm 4.8%
Angry 4.3%
Surprised 4.1%
Sad 3.9%
Confused 3.3%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Happy 81.8%
Fear 6.2%
Calm 2.9%
Confused 2.5%
Surprised 2.4%
Sad 1.9%
Disgusted 1.2%
Angry 1%

AWS Rekognition

Age 16-24
Gender Male, 93.6%
Disgusted 28.9%
Calm 27.2%
Sad 25.6%
Angry 8.4%
Fear 5.1%
Confused 2.6%
Happy 1.2%
Surprised 0.9%

AWS Rekognition

Age 45-51
Gender Male, 76%
Happy 90.5%
Calm 6.1%
Surprised 2.1%
Disgusted 0.5%
Angry 0.3%
Sad 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 59.7%
Sad 82.8%
Calm 3.7%
Confused 3.7%
Disgusted 3.4%
Fear 3.4%
Angry 1.4%
Happy 1.1%
Surprised 0.5%

AWS Rekognition

Age 27-37
Gender Male, 99.1%
Sad 42.6%
Calm 41.1%
Confused 13.1%
Happy 0.9%
Surprised 0.6%
Fear 0.6%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 35-43
Gender Female, 58.4%
Happy 93.7%
Sad 2%
Fear 1.2%
Angry 1%
Disgusted 0.8%
Calm 0.7%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 49-57
Gender Male, 96.9%
Sad 68.2%
Happy 14.9%
Fear 7.5%
Calm 2.9%
Confused 2.2%
Disgusted 1.8%
Angry 1.7%
Surprised 0.8%

AWS Rekognition

Age 31-41
Gender Male, 76.2%
Calm 86.8%
Sad 8.9%
Happy 1.5%
Fear 0.9%
Confused 0.8%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%

AWS Rekognition

Age 35-43
Gender Male, 86.6%
Calm 91.8%
Happy 6.6%
Sad 0.5%
Disgusted 0.3%
Angry 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Female, 91.6%
Happy 72.7%
Calm 14.5%
Sad 6.9%
Surprised 1.8%
Confused 1.8%
Fear 0.9%
Disgusted 0.8%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 89.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 92.6%
a group of people posing for a photo 92.5%
a vintage photo of a group of people posing for a picture 92.4%

Text analysis

Amazon

606.38.