Human Generated Data

Title

Untitled (Mask + Wig members dancing in a line at Club House)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12161
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Mask + Wig members dancing in a line at Club House)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Person 99.8
Person 99.8
Person 99.8
Person 99.7
Person 97.8
Shoe 96.3
Footwear 96.3
Clothing 96.3
Apparel 96.3
Person 95.2
Person 86
Person 85.2
Person 84
Crowd 80
Accessories 78.1
Tie 78.1
Accessory 78.1
People 77.2
Sport 76.7
Sports 76.7
Word 70.2
Text 68.5
Person 68
Leisure Activities 63.9
Suit 62.7
Coat 62.7
Overcoat 62.7
Face 59.5
Person 53.9

Imagga
created on 2022-01-22

people 42.4
businessman 40.6
business 40.1
person 38
team 36.7
group 35.4
crowd 33.6
teamwork 33.4
man 32.2
businesswoman 31.8
male 30.5
silhouette 29
men 27.5
job 25.6
work 25.1
women 21.3
boss 20.1
adult 19.7
flag 19.6
patriotic 19.2
nation 18.9
office 18.7
occupation 18.3
cheering 17.6
nighttime 17.6
audience 17.5
happy 17.5
stadium 17.5
meeting 16.9
success 16.9
design 16.9
presentation 16.8
lights 16.7
professional 16.7
together 16.6
vibrant 16.6
leader 16.4
corporate 16.3
symbol 16.2
icon 15
vivid 14.9
gymnasium 14.2
nurse 13.9
worker 13.8
speech 13.7
company 13
supporters 12.8
president 12.8
bright 12.2
executive 12
room 12
hall 11.8
smiling 11.6
teacher 11.4
talking 11.4
athletic facility 11.3
modern 11.2
portrait 11
communication 10.9
sexy 10.4
manager 10.2
finance 10.1
successful 10.1
suit 10
human 9.7
working 9.7
partnership 9.6
world 9.5
happiness 9.4
friendship 9.4
document 9.3
facility 8.7
hands 8.7
dancer 8.6
educator 8.6
walking 8.5
clothing 8.5
togetherness 8.5
classroom 8.4
hand 8.4
art 8.2
lifestyle 7.9
employee 7.9
couple 7.8
smile 7.8
standing 7.8
black 7.8
table 7.8
sitting 7.7
casual 7.6
businesspeople 7.6
fun 7.5
building 7.3
life 7

Google
created on 2022-01-22

Gesture 85.3
Font 84.8
Black-and-white 84.1
Style 83.8
Snapshot 74.3
Monochrome photography 73
Team 72.5
Monochrome 70.7
Event 70.5
Advertising 70
Room 68.9
Poster 65.8
Photo caption 64.3
History 64.1
Stock photography 63.6
Crew 62.7
Smile 57.9
Rectangle 57.6
Handwriting 56.2
Knee 52.8

Microsoft
created on 2022-01-22

text 99.8
person 97.2
clothing 94.5
man 89.3
group 66
baseball 59.3
footwear 53.9
line 18.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 98.2%
Calm 56%
Sad 25.7%
Surprised 9%
Confused 3.5%
Fear 2.1%
Happy 1.5%
Angry 1.2%
Disgusted 1.1%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Sad 62.5%
Calm 30.4%
Confused 4.5%
Angry 0.9%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Female, 90.6%
Happy 31.7%
Calm 30.3%
Sad 15%
Fear 12.4%
Surprised 3.9%
Angry 2.5%
Confused 2.3%
Disgusted 1.9%

AWS Rekognition

Age 49-57
Gender Male, 99%
Sad 50.8%
Calm 37.4%
Confused 4.6%
Angry 2.7%
Happy 1.9%
Surprised 1.1%
Disgusted 1.1%
Fear 0.5%

AWS Rekognition

Age 22-30
Gender Male, 91.3%
Sad 50.4%
Confused 19.6%
Calm 18.6%
Surprised 5%
Fear 2%
Angry 1.9%
Disgusted 1.3%
Happy 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 96.3%
Tie 78.1%
Suit 62.7%

Captions

Microsoft

a group of people posing for a photo 88.3%
a group of people posing for the camera 88.2%
a group of people posing for a picture 88.1%

Text analysis

Amazon

21
2)
2) 010
MAMT
010
٥١٥ 21
ever
A00%
٥١٥

Google

21010.
21010.