Human Generated Data

Title

Untitled (men and women dressed in Haiwaiian outfits for luau on the beach)

Date

1960

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11473

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women dressed in Haiwaiian outfits for luau on the beach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Plant 99.5
Tree 99.5
Person 96.7
Human 96.7
Person 96.1
Person 95.5
Nature 95.3
Ice 94.8
Outdoors 94.8
Person 94.3
Person 94.2
Person 93.4
Forest 93.3
Woodland 93.3
Vegetation 93.3
Land 93.3
Person 92.9
Person 92.1
Person 91.3
Person 89.6
Person 88.6
Person 85.7
Grove 84
Fir 83.7
Abies 83.7
Person 82.3
Person 82
Person 76.5
Snow 75
Person 67
Frost 66.3
Person 57.6
Conifer 56.4
People 55.3

Imagga
created on 2022-01-14

fountain 55.6
structure 49.6
picket fence 35.7
tree 33.4
fence 31.8
snow 30.5
landscape 29.8
trees 24.9
sky 24.3
travel 24
architecture 23.6
park 21.8
weather 21.4
barrier 21.3
forest 20
winter 18.7
cemetery 17.8
negative 17.2
scenery 17.1
ice 16.6
tourism 16.5
building 16
night 16
outdoors 15.8
old 15.3
river 15.1
city 15
cold 14.6
outdoor 14.5
obstruction 14.3
country 14.1
scenic 14
water 14
scene 13.9
house 13.8
historic 13.8
film 13
history 12.5
rural 12.3
summer 12.2
church 12
sun 11.3
cloud 11.2
stone 11.1
season 10.9
mountain 10.8
snowy 10.7
vacation 10.6
woods 10.5
culture 10.3
spring 10.2
clouds 10.1
light 10
dark 10
tourist 10
national 10
sunset 9.9
religion 9.9
frost 9.6
attraction 9.6
crystal 9.5
natural 9.4
photographic paper 9.3
famous 9.3
field 9.2
wood 9.2
landmark 9
autumn 8.8
urban 8.7
grass 8.7
frozen 8.6
england 8.6
destination 8.4
evening 8.4
lake 8.2
peaceful 8.2
countryside 8.2
fall 8.1
palace 8.1
yellow 8
holiday 7.9
day 7.9
sunny 7.8
construction 7.7
bridge 7.6
town 7.4
street 7.4
branch 7.3
new 7.3
road 7.2
horizon 7.2
home 7.2
tower 7.2
sunlight 7.1

Google
created on 2022-01-14

Microsoft
created on 2022-01-14

text 99.7
tree 97.6
outdoor 94.8
grave 92
cemetery 90.2
black and white 74.7
people 55
infrared 52.4
christmas tree 51.2
old 46.1

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Female, 98.2%
Calm 88.1%
Happy 3.7%
Sad 2.6%
Fear 2.1%
Surprised 1.6%
Angry 0.9%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Female, 56.3%
Happy 48.2%
Calm 42%
Confused 4.9%
Sad 2%
Fear 1.3%
Disgusted 0.6%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 40-48
Gender Male, 95.4%
Happy 89%
Calm 4.5%
Sad 1.9%
Angry 1.6%
Surprised 1.5%
Fear 0.6%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Female, 85.9%
Happy 45.1%
Calm 29.7%
Sad 12.8%
Angry 7.1%
Fear 1.9%
Surprised 1.2%
Confused 1.2%
Disgusted 0.8%

AWS Rekognition

Age 19-27
Gender Male, 80.3%
Calm 49.7%
Happy 25.1%
Sad 16.9%
Confused 3.7%
Disgusted 1.3%
Angry 1.3%
Fear 1.2%
Surprised 0.7%

AWS Rekognition

Age 33-41
Gender Male, 94%
Calm 75.9%
Sad 12.4%
Confused 5.6%
Disgusted 1.7%
Happy 1.6%
Angry 1.4%
Surprised 1%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Female, 98.1%
Calm 83.7%
Sad 5.4%
Happy 4.4%
Fear 3.9%
Disgusted 1.1%
Angry 0.8%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 16-22
Gender Male, 98.3%
Fear 29.9%
Calm 26.2%
Happy 9.8%
Disgusted 9.4%
Sad 9.4%
Angry 6.5%
Surprised 6%
Confused 2.8%

AWS Rekognition

Age 23-33
Gender Female, 91.9%
Calm 92.7%
Sad 3.7%
Fear 2%
Happy 0.9%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 16-22
Gender Female, 97.4%
Calm 60.5%
Fear 13.7%
Sad 11%
Happy 3.8%
Confused 3.2%
Disgusted 3.1%
Angry 2.7%
Surprised 2%

AWS Rekognition

Age 29-39
Gender Male, 98%
Calm 93.2%
Sad 3.1%
Happy 2.7%
Angry 0.3%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 16-24
Gender Female, 59.7%
Calm 96.3%
Sad 2%
Happy 0.6%
Confused 0.5%
Angry 0.4%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99%
Calm 99.1%
Happy 0.5%
Sad 0.2%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 26-36
Gender Female, 94.4%
Calm 77.8%
Happy 9.8%
Sad 4.5%
Fear 2.6%
Angry 1.5%
Disgusted 1.5%
Confused 1.4%
Surprised 0.9%

AWS Rekognition

Age 13-21
Gender Female, 76.4%
Happy 84.5%
Calm 9.7%
Sad 3.9%
Fear 0.5%
Angry 0.5%
Surprised 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Female, 59%
Calm 89.6%
Happy 6.4%
Sad 2.8%
Confused 0.4%
Angry 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Male, 98.9%
Calm 44.3%
Happy 27.7%
Sad 8.2%
Fear 7.2%
Angry 6.6%
Surprised 3.7%
Disgusted 1.5%
Confused 0.7%

Feature analysis

Amazon

Person 96.7%

Captions

Microsoft

a group of people standing in front of a building 80.3%
an old photo of a group of people standing in front of a building 73.2%
a group of people in an old photo of a man 68.3%

Text analysis

Amazon

E
1985m
YY33A2
E MUEL YY33A2 002KA
002KA
MUEL

Google

B61.
B61.