Human Generated Data

Title

Untitled (Steinmetz's with Cardozos family seated on bench)

Date

1953

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8168

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz's with Cardozos family seated on bench)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.2
Nature 98.5
Yard 98.5
Outdoors 98.5
Person 98.1
Apparel 98
Clothing 98
Person 97.6
Countryside 97
Building 97
Rural 97
Shelter 97
Person 94.1
Face 93.7
People 90.3
Female 89.7
Smile 87.1
Housing 84.3
Plant 83.7
Grass 83.7
Shorts 79
Vegetation 78
Woman 76.6
Kid 72.7
Child 72.7
Girl 71.1
Tree 69.7
Photography 66.9
Portrait 66.9
Photo 66.9
Dress 66.7
House 65.5
Mammal 58.5
Canine 58.5
Animal 58.5
Shoe 57.6
Footwear 57.6
Blonde 56.5
Teen 56.5
Backyard 56.2
Pet 55.6
Man 55.5

Imagga
created on 2022-01-08

kin 95
outdoor 21.4
people 21.2
adult 15.5
summer 15.4
man 14.8
person 14.5
portrait 13.6
happy 11.9
happiness 11.8
leisure 11.6
couple 11.3
outdoors 11.3
fun 11.2
sky 10.8
lifestyle 10.8
black 10.8
sunset 10.8
sun 10.5
love 10.3
sport 10.2
two 10.2
male 10
silhouette 9.9
park 9.9
old 9.8
together 9.6
world 9.6
men 9.4
child 9.3
field 9.2
active 9
women 8.7
water 8.7
beach 8.5
pretty 8.4
joy 8.4
dark 8.4
vacation 8.2
landscape 8.2
history 8
smiling 8
day 7.8
smile 7.8
forest 7.8
outside 7.7
bride 7.7
sibling 7.7
free 7.5
life 7.4
freedom 7.3
cheerful 7.3
road 7.2
transportation 7.2
activity 7.2
grass 7.1
travel 7

Google
created on 2022-01-08

Photograph 94.1
Smile 93.5
Plant 89.8
Hat 85.8
Black-and-white 82.1
Adaptation 79.4
Grass 76
Monochrome 75.4
Monochrome photography 74.8
Vintage clothing 74.5
Event 71.6
Photo caption 70.9
Room 68.1
Art 67.4
History 65.4
Font 64.3
Sitting 63.2
Stock photography 63
Team 62.2
Classic 62.2

Microsoft
created on 2022-01-08

outdoor 99.8
person 97.9
grass 96.8
clothing 96.7
smile 96.3
text 92.9
posing 89.5
woman 87.4
dance 81.9
footwear 78.1
people 59.9
dress 58.1
man 53.2
human face 53
old 40.4

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 84%
Surprised 98%
Calm 1.7%
Confused 0.1%
Disgusted 0%
Fear 0%
Sad 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 99.8%
Surprised 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Female, 95.8%
Calm 70.4%
Confused 13.5%
Happy 10.1%
Sad 2.6%
Angry 1.1%
Surprised 1.1%
Disgusted 0.8%
Fear 0.2%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 87%
Happy 3.6%
Confused 3.3%
Surprised 2%
Sad 1.8%
Disgusted 0.9%
Fear 0.7%
Angry 0.5%

AWS Rekognition

Age 48-56
Gender Female, 98.8%
Surprised 51.9%
Calm 43.6%
Disgusted 1.9%
Angry 1.1%
Confused 0.5%
Sad 0.4%
Happy 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 57.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 96.5%
a group of people posing for a photo 96.4%
a vintage photo of a group of people posing for a picture 96.3%

Text analysis

Amazon

390
390 83-A.
83-A.

Google

390
8
3
390 8 3 -A.
-A.