Human Generated Data

Title

Untitled (Mask and Wig members dancing at clubhouse)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8363

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Mask and Wig members dancing at clubhouse)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.7
Person 99.7
Person 99.6
Person 98.7
Person 98.7
Dance 96.3
Person 94.8
Ballet 92.4
Person 90
Apparel 88.3
Shoe 88.3
Clothing 88.3
Footwear 88.3
Ballerina 85.6
Person 84.2
Person 77
Leisure Activities 76.4
Person 76.2
Dance Pose 69.6
Shoe 57.4
Person 51
Person 49

Imagga
created on 2022-01-09

people 30.1
person 26.2
man 24.3
classroom 22.8
group 22.6
team 21.5
men 20.6
room 20.4
silhouette 19
sport 18.2
business 17.6
male 17
athlete 16.8
professional 16
training 15.7
businessman 15
teacher 14.7
adult 14.4
crowd 14.4
teamwork 13.9
hall 13.8
competition 13.7
photographer 13.3
black 12.6
corporate 12
work 11.8
equipment 11.1
women 11.1
3d 10.8
match 10.6
office 10.6
muscular 10.5
human 10.5
success 10.5
event 10.2
happy 10
city 10
worker 9.8
fight 9.7
skill 9.6
weapon 9.4
building 9.3
sword 9.3
modern 9.1
suit 9.1
exercise 9.1
championship 8.7
brass 8.6
dangerous 8.6
meeting 8.5
strength 8.4
manager 8.4
lights 8.3
sports equipment 8.3
body 8
cheering 7.8
nighttime 7.8
standing 7.8
audience 7.8
scene 7.8
stadium 7.8
figure 7.8
portrait 7.8
motion 7.7
train 7.7
patriotic 7.7
flag 7.6
player 7.6
weight 7.6
executive 7.6
nation 7.6
power 7.6
fashion 7.5
technology 7.4
symbol 7.4
pose 7.2
job 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99.9
outdoor 94.6
old 62.4
gun 25.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 97.7%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 86.6%
Calm 95.2%
Sad 2.9%
Disgusted 0.5%
Happy 0.4%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Female, 92.9%
Sad 36.3%
Calm 31.6%
Happy 22.3%
Fear 4%
Angry 1.6%
Surprised 1.6%
Confused 1.5%
Disgusted 1.2%

AWS Rekognition

Age 47-53
Gender Male, 98.9%
Sad 81.4%
Happy 6.1%
Calm 5.7%
Confused 2.7%
Surprised 1.3%
Disgusted 1.2%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 50-58
Gender Female, 62%
Calm 64.4%
Sad 20.7%
Happy 7.8%
Confused 3.6%
Angry 1.5%
Disgusted 0.9%
Surprised 0.9%
Fear 0.2%

AWS Rekognition

Age 14-22
Gender Male, 98.3%
Calm 99.3%
Sad 0.4%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 88.3%

Captions

Microsoft

a vintage photo of a group of people around each other 77.3%
a vintage photo of a group of people 77.2%
a group of people in an old photo of a man 73.6%

Text analysis

Amazon

14358

Google

14358·
14358· 14358.
14358.