Human Generated Data

Title

Untitled (Steinmetz's with Cardozos family seated on bench)
Date

1953
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8169
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz's with Cardozos family seated on bench)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.8
Human 99.8
Person 99.7
Clothing 99.5
Apparel 99.5
Shorts 99.5
Person 99.2
Person 99.1
Smile 98.9
Face 98.9
Yard 98.7
Outdoors 98.7
Nature 98.7
Shelter 97.8
Countryside 97.8
Building 97.8
Rural 97.8
Person 96.4
Grass 95.4
Plant 95.4
Female 95
Dress 91.3
People 85.3
Woman 82.6
Girl 76.3
Helmet 75.1
Housing 73.3
Kid 69.4
Child 69.4
Portrait 65.1
Photography 65.1
Photo 65.1
Chair 63.5
Furniture 63.5
Shoe 61.8
Footwear 61.8
House 61.4
Skirt 61.4
Vegetation 61.1
Tree 60.3
Blonde 59.7
Teen 59.7
Backyard 56.3
Barefoot 55.7
Man 55.5

Imagga
created on 2022-01-08

kin 58.4
sprinkler 28.5
people 25.7
adult 24.6
outdoor 23.7
mechanical device 23.4
summer 21.9
portrait 19.4
happiness 18.8
mechanism 17.4
person 17.4
outdoors 17.4
lifestyle 17.3
bikini 17.3
beach 17.3
happy 16.9
child 15.5
sexy 14.5
fun 13.5
swimsuit 13.4
man 13.4
joy 13.4
pretty 13.3
smiling 13
two 12.7
attractive 12.6
vacation 12.3
couple 12.2
smile 12.1
hair 11.9
girls 11.8
love 11.8
leisure 11.6
ocean 11.6
cute 11.5
device 11.4
together 11.4
male 11.3
water 11.3
one 11.2
outside 11.1
day 11
model 10.9
park 10.7
dog 10.5
women 10.3
grass 10.3
garment 10.2
face 9.9
family 9.8
cheerful 9.8
body 9.6
life 9.6
sitting 9.4
enjoy 9.4
youth 9.4
parent 9.2
sand 9.1
clothing 9
fashion 9
human 9
active 9
sunset 9
childhood 9
sky 8.9
sun 8.9
sunny 8.6
men 8.6
sibling 8.5
relax 8.4
field 8.4
blond 8.2
children 8.2
lady 8.1
kid 8
rural 7.9
boy 7.8
skin 7.6
hand 7.6
friendship 7.5
slim 7.4
joyful 7.3
black 7.2
wet 7.2
farm 7.1
little 7.1
travel 7
country 7

Google
created on 2022-01-08

Photograph 94.2
Plant 89.1
Grass 80.5
Adaptation 79.4
Monochrome 77.5
Hat 75.7
Vintage clothing 75.2
Monochrome photography 75.2
Event 70.2
Chair 69.6
Photo caption 68.7
Font 68.3
Room 66.5
Smile 65.6
Team 65.3
Sitting 64.5
History 63.3
Classic 58.3
Fun 57
Photographic paper 55.3

Microsoft
created on 2022-01-08

outdoor 99.5
clothing 96.8
person 94.2
text 93
smile 92.2
footwear 90
man 70.9
posing 70.8
black 69.5
white 60.1
woman 58.4
old 53.8
crowd 0.5

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Female, 58.9%
Happy 90.4%
Calm 7.5%
Surprised 0.7%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Female, 98.9%
Calm 64.8%
Happy 33.8%
Sad 0.5%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Female, 85.6%
Calm 97.7%
Happy 1%
Confused 0.5%
Sad 0.3%
Disgusted 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 88%
Happy 99.6%
Calm 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%
Sad 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 99.1%
Happy 0.4%
Surprised 0.3%
Disgusted 0%
Confused 0%
Sad 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Helmet 75.1%
Shoe 61.8%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.8%
a vintage photo of a group of people posing for a picture 93.7%
a group of people posing for a photo 93.6%

Text analysis

Amazon

390
390 83.
83.

Google

390 83.
390
83.