Human Generated Data

Title

Untitled (men and women standing near ledge in Fairmont Park, PA)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8533
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women standing near ledge in Fairmont Park, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.9
Human 98.9
Person 98.7
Person 97.8
Person 97.1
Person 96.2
Person 94.3
Person 93.4
Person 92.5
Crowd 91.5
Person 90.1
Person 87.3
Clothing 85.7
Apparel 85.7
Person 85.6
Person 81.8
Person 80.6
Person 80.3
Person 78.8
Audience 75.6
Person 73.4
People 72.9
Silhouette 69.6
Suit 69.5
Coat 69.5
Overcoat 69.5
Shorts 69.4
Person 68
Person 66.2
Person 62.3
Person 60.8
Leisure Activities 59.1
Face 58.5
Text 57.9
Photography 57.5
Photo 57.5
Pedestrian 56.1
Person 52.6

Imagga
created on 2022-01-09

blackboard 35.5
man 28.9
stage 26.7
silhouette 24.8
people 24.5
male 24.1
person 23.2
television 21.3
platform 20.1
business 17
businessman 15.9
water 14.7
men 14.6
black 13.2
group 12.9
telecommunication system 12.2
adult 12.2
sunset 11.7
office 11.5
happy 11.3
team 10.8
teacher 10.7
youth 10.2
work 10.2
relax 10.1
classroom 9.7
job 9.7
couple 9.6
boss 9.6
education 9.5
light 9.4
manager 9.3
travel 9.2
tourism 9.1
sky 8.9
laptop 8.9
working 8.8
lifestyle 8.7
crowd 8.6
corporate 8.6
board 8.6
world 8.4
beach 8.4
summer 8.4
hand 8.4
student 8.3
school 8.3
landscape 8.2
music 8.1
percussion instrument 8.1
room 8
women 7.9
boy 7.8
sea 7.8
concert 7.8
child 7.7
class 7.7
modern 7.7
ocean 7.7
power 7.6
outdoors 7.5
symbol 7.4
executive 7.4
vacation 7.4
design 7.3
equipment 7.3
musical instrument 7.3
tourist 7.2
sun 7.2
smiling 7.2
color 7.2
suit 7.2
table 7.1
love 7.1
day 7.1
happiness 7.1

Google
created on 2022-01-09

Font 81.1
Adaptation 79.4
Vintage clothing 73
Monochrome photography 72.5
Room 69.4
Monochrome 68.5
History 64.3
Event 63
Rectangle 62.6
Tree 61.7
Photographic paper 61.3
Suit 60.8
Chair 58.5
Photo caption 57.4
Paper product 56.7
Art 54.4
Classic 53.2
Team 52.3

Microsoft
created on 2022-01-09

text 99.7
person 96.2
outdoor 90.7
clothing 86.4
man 85.9
people 63.7
white 60.8
black and white 53.4

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 92.1%
Calm 51.8%
Sad 38.4%
Confused 4.4%
Happy 3%
Angry 1.1%
Fear 0.8%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 40-48
Gender Male, 80%
Sad 96.9%
Happy 1.5%
Fear 0.7%
Calm 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 28-38
Gender Male, 96.4%
Sad 95.9%
Fear 1.5%
Calm 1%
Confused 0.8%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 14-22
Gender Male, 97.4%
Calm 56.7%
Sad 22.5%
Happy 12.7%
Confused 5.8%
Surprised 0.9%
Angry 0.5%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 21-29
Gender Female, 56.6%
Sad 47%
Calm 18.4%
Angry 9.3%
Disgusted 7.6%
Happy 5.8%
Confused 4.3%
Fear 4.2%
Surprised 3.3%

AWS Rekognition

Age 47-53
Gender Male, 95.3%
Calm 91%
Sad 2.9%
Happy 2.3%
Confused 1.4%
Angry 1.4%
Disgusted 0.5%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 34-42
Gender Male, 57.7%
Calm 99.6%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Confused 0%
Surprised 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 42-50
Gender Male, 95.8%
Sad 45.9%
Calm 15.3%
Confused 12%
Angry 11.6%
Disgusted 6.9%
Fear 3.5%
Happy 2.9%
Surprised 2%

AWS Rekognition

Age 19-27
Gender Female, 61.4%
Calm 67.7%
Happy 11.8%
Sad 8.5%
Angry 3.5%
Confused 3.4%
Fear 3.1%
Surprised 1.1%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Female, 88.2%
Sad 73.2%
Calm 21.2%
Confused 1.6%
Fear 1%
Happy 0.8%
Angry 0.8%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Female, 66%
Calm 54.1%
Sad 23.3%
Happy 16.4%
Angry 3%
Confused 1.6%
Disgusted 0.7%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 9-17
Gender Female, 82.7%
Calm 47.2%
Sad 27%
Confused 10.2%
Happy 6.6%
Fear 3.5%
Angry 2.2%
Surprised 1.9%
Disgusted 1.5%

AWS Rekognition

Age 23-31
Gender Female, 97.5%
Calm 94.2%
Sad 4.1%
Happy 1%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 57.7%
Calm 98.9%
Happy 0.8%
Sad 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 27-37
Gender Female, 86.2%
Sad 73.7%
Fear 9.9%
Confused 6.4%
Calm 2.8%
Surprised 2%
Disgusted 1.9%
Happy 1.8%
Angry 1.5%

AWS Rekognition

Age 19-27
Gender Female, 83.9%
Calm 89.4%
Sad 6.6%
Fear 2.4%
Happy 0.7%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 20-28
Gender Male, 84.5%
Sad 64.4%
Happy 14.2%
Fear 6%
Calm 4.6%
Confused 4.4%
Disgusted 3%
Angry 2.8%
Surprised 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Sad 89.1%
Calm 4.2%
Confused 3%
Happy 1.9%
Disgusted 0.6%
Fear 0.6%
Surprised 0.4%
Angry 0.2%

AWS Rekognition

Age 18-24
Gender Female, 67%
Calm 76%
Sad 8.1%
Surprised 6.6%
Disgusted 2.5%
Confused 2%
Fear 1.8%
Angry 1.6%
Happy 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people standing in front of a crowd 91.3%
a group of people standing in front of a crowd of people 89.7%
a group of people that are standing in front of a crowd 86.4%

Text analysis

Amazon

17423
19423
BB
MADOX

Google

17423.
17423.