Human Generated Data

Title

Untitled (group gathered in courtyard)
Date

c. 1965
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10797
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group gathered in courtyard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Shorts 100
Clothing 100
Apparel 100
Person 99.8
Human 99.8
Person 99.6
Person 99.5
Person 98.9
Person 98.8
Person 98.7
Person 97.2
Person 95.7
Crowd 87.3
Person 85.8
Person 84.1
Person 83.5
Tree 83.1
Plant 83.1
Person 83
Person 81.3
People 79.2
Female 72.5
Person 66.7
Suit 66.3
Coat 66.3
Overcoat 66.3
Sailor Suit 59.6
Stage 58.9
Woman 57.1
Flooring 55.3
Person 50.2

Imagga
created on 2022-01-15

architecture 35.4
city 28.3
building 24
old 17.4
travel 16.9
history 16.1
palace 16.1
world 15.5
tourism 14.8
flag 14.8
monument 14
sculpture 13.7
fountain 13.3
column 13.1
urban 13.1
light 12.9
house 12.5
structure 12.3
people 12.3
stone 12
night 11.5
art 11.5
crowd 11.5
tourist 11.2
famous 11.2
culture 11.1
statue 11
historical 10.3
street 10.1
park 10
landmark 9.9
spectator 9.8
sky 9.6
window 9.4
emblem 9.4
historic 9.2
square 9
summer 9
religion 9
hall 8.7
capital 8.5
place 8.4
outdoors 8.2
facade 8.2
transportation 8.1
pedestrian 8.1
center 8
water 8
wall 7.9
ancient 7.8
life 7.7
outdoor 7.6
bridge 7.6
exterior 7.4
business 7.3
marble 7.2
trees 7.1
station 7

Google
created on 2022-01-15

Black 89.6
Black-and-white 86.1
Style 83.9
Line 82.8
Tree 81.6
Adaptation 79.3
Plant 79.3
Tints and shades 76.6
Monochrome photography 76.6
Font 75.8
Beauty 75
Arecales 74.9
Monochrome 74.8
Event 69.2
Vintage clothing 68.4
Art 67.6
Pole 66.2
History 63.8
Room 63.6
Stock photography 63.3

Microsoft
created on 2022-01-15

text 97
outdoor 96.1
black 84.9
person 83.7
white 83.5
black and white 73
clothing 57
man 56.1
dance 55.3
tree 55.3
crowd 0.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 98.1%
Sad 71.2%
Calm 13.2%
Disgusted 8.3%
Angry 1.6%
Surprised 1.5%
Happy 1.4%
Confused 1.4%
Fear 1.4%

AWS Rekognition

Age 36-44
Gender Male, 99%
Happy 84%
Calm 4.4%
Sad 3%
Fear 2.9%
Disgusted 2.7%
Confused 1.2%
Angry 1%
Surprised 0.8%

AWS Rekognition

Age 48-54
Gender Male, 98.6%
Happy 34.3%
Calm 22.4%
Fear 14.1%
Confused 12%
Surprised 9.5%
Disgusted 3.6%
Sad 2.2%
Angry 2%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 89.4%
Disgusted 2.6%
Surprised 2.1%
Angry 1.8%
Sad 1.3%
Confused 1.3%
Happy 0.8%
Fear 0.7%

AWS Rekognition

Age 27-37
Gender Male, 55.9%
Sad 53.8%
Calm 20.8%
Happy 17.4%
Confused 4.6%
Angry 1.1%
Disgusted 0.9%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 40-48
Gender Female, 72.5%
Calm 86%
Happy 7.1%
Surprised 4.8%
Disgusted 0.6%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 21-29
Gender Male, 97.2%
Calm 95.8%
Happy 1.6%
Sad 1.2%
Fear 0.6%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Female, 99.4%
Happy 94%
Calm 4.3%
Sad 0.4%
Fear 0.3%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 31-41
Gender Male, 74.9%
Calm 92.5%
Happy 2.5%
Sad 1.6%
Disgusted 1.1%
Surprised 0.8%
Fear 0.7%
Angry 0.4%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Female, 94.1%
Calm 89.3%
Happy 4.5%
Disgusted 2.4%
Fear 2.1%
Angry 0.6%
Surprised 0.6%
Sad 0.5%
Confused 0.2%

AWS Rekognition

Age 45-53
Gender Male, 96.7%
Calm 57.6%
Happy 26.9%
Sad 8.6%
Fear 4.3%
Angry 0.9%
Confused 0.7%
Surprised 0.6%
Disgusted 0.4%

AWS Rekognition

Age 25-35
Gender Male, 54.5%
Calm 69.2%
Sad 18.8%
Happy 3.5%
Fear 2.6%
Disgusted 2.3%
Angry 1.7%
Confused 1%
Surprised 0.9%

AWS Rekognition

Age 25-35
Gender Male, 65.8%
Calm 92.8%
Sad 2.7%
Happy 2.3%
Disgusted 0.7%
Confused 0.6%
Fear 0.4%
Surprised 0.3%
Angry 0.2%

AWS Rekognition

Age 24-34
Gender Female, 56.8%
Fear 39.2%
Sad 27.1%
Calm 17.4%
Happy 7.1%
Angry 4.1%
Disgusted 1.9%
Surprised 1.8%
Confused 1.3%

AWS Rekognition

Age 51-59
Gender Male, 96.8%
Confused 27.2%
Calm 19.6%
Sad 18.8%
Surprised 16.9%
Disgusted 7.1%
Happy 6.3%
Angry 2.2%
Fear 2%

AWS Rekognition

Age 34-42
Gender Female, 88.7%
Calm 82.6%
Happy 14.8%
Surprised 1.1%
Disgusted 0.6%
Angry 0.4%
Sad 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 63.5%
Fear 50.5%
Calm 42.6%
Happy 3.7%
Confused 0.8%
Sad 0.8%
Disgusted 0.6%
Surprised 0.6%
Angry 0.3%

AWS Rekognition

Age 19-27
Gender Male, 69.8%
Calm 62.8%
Fear 26.6%
Happy 4.5%
Sad 2%
Surprised 1.7%
Angry 0.9%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 20-28
Gender Male, 53.2%
Calm 88.4%
Happy 4.7%
Fear 1.8%
Angry 1.6%
Sad 1.6%
Surprised 0.9%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 31-41
Gender Male, 90.7%
Sad 44.8%
Happy 36.8%
Calm 7.1%
Confused 4.6%
Disgusted 2.6%
Fear 2.3%
Angry 0.9%
Surprised 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing in front of a building 93%
an old photo of a group of people standing in front of a building 89.2%
a group of people that are standing in front of a building 88%

Text analysis

Amazon

58260.

Google

587
587