Human Generated Data

Title

Untitled (backgammon game on porch, Coral Beach, Florida)
Date

1948, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.294
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (backgammon game on porch, Coral Beach, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.6
Person 99.6
Person 99.2
Person 98.5
Person 97.8
People 93.8
Furniture 82.3
Wood 80.8
Shoe 78.3
Footwear 78.3
Clothing 78.3
Apparel 78.3
Bench 76.6
Chair 74.7
Family 73.4
Tie 70.2
Accessories 70.2
Accessory 70.2
Bench 65.8
Plywood 57.6
Porch 57.5
Workshop 56.1

Imagga
created on 2022-01-08

kin 52.4
beach 49
vacation 40.9
sea 39.9
chair 36.3
man 32.9
sand 31.4
summer 30.2
water 30
ocean 29.9
couple 29.6
holiday 29.4
tropical 23.8
people 22.9
sitting 22.3
travel 21.1
love 20.5
outdoors 20.2
leisure 19.9
coast 19.8
father 18.8
sky 17.9
male 17.1
happy 16.9
relax 16.8
resort 16.8
sibling 16.7
dad 16.5
relaxing 16.4
family 16
relaxation 15.9
lifestyle 15.9
shore 15.8
together 15.8
tourism 15.7
parent 15.2
sun 14.5
sunny 13.8
two 13.6
day 13.3
happiness 13.3
holidays 13.1
seat 12.8
smiling 12.3
adult 12.3
waves 12.1
person 12
chaise lounge 11.9
sandy 11.7
fun 11.2
child 11.2
men 11.2
mother 11.1
portrait 11
grandfather 10.8
boy 10.4
coastline 10.3
relationship 10.3
folding chair 10.2
tranquil 10
sunset 9.9
romantic 9.8
rocking chair 9.5
sit 9.5
idyllic 9.4
paradise 9.4
vacations 9.4
seller 9.3
attendant 9.2
hat 9.1
furniture 9.1
romance 8.9
destinations 8.6
luxury 8.6
walk 8.6
outside 8.6
smile 8.6
togetherness 8.5
joy 8.4
color 8.3
cheerful 8.1
seaside 7.8
son 7.8
wave 7.8
recreational 7.7
attractive 7.7
married 7.7
outdoor 7.6
husband 7.6
loving 7.6
casual 7.6
walking 7.6
enjoyment 7.5
senior 7.5
landscape 7.4
horizon 7.2
active 7.2
kid 7.1
businessman 7.1

Google
created on 2022-01-08

Water 94.5
Folding chair 89.1
Shorts 88.1
Outdoor furniture 82.9
Adaptation 79.3
Chair 76.2
Leisure 75.8
Sky 73.6
Vintage clothing 71.3
Sitting 70.5
Monochrome 70.2
Monochrome photography 69.8
Event 69.3
People on beach 69.2
Recreation 68.9
Beach 67.8
Room 66.3
Fun 65.9
Table 65.6
Stock photography 62.6

Microsoft
created on 2022-01-08

person 98.9
furniture 96.1
outdoor 95.7
table 92.4
clothing 91.7
text 90.8
chair 86.7
man 82.8
bench 75.1
footwear 70.3
people 67.8
beach 67.6
group 66.4
black and white 62.1
smile 53.3
posing 38.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 90.4%
Disgusted 5.6%
Sad 1.7%
Happy 1%
Confused 0.4%
Surprised 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 47-53
Gender Male, 100%
Sad 87.7%
Calm 4.9%
Confused 2.4%
Disgusted 1.8%
Fear 1.3%
Angry 0.9%
Surprised 0.6%
Happy 0.3%

AWS Rekognition

Age 48-54
Gender Female, 100%
Calm 42.1%
Sad 22.8%
Confused 22.1%
Surprised 4.6%
Angry 3%
Fear 2.5%
Disgusted 2.1%
Happy 0.8%

AWS Rekognition

Age 43-51
Gender Female, 100%
Calm 99.7%
Sad 0.2%
Confused 0%
Happy 0%
Surprised 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 39-47
Gender Female, 100%
Happy 99.2%
Fear 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Calm 0%

AWS Rekognition

Age 38-46
Gender Male, 99.2%
Happy 32.4%
Sad 27.2%
Confused 16.8%
Angry 9.9%
Disgusted 5.1%
Fear 4.7%
Calm 3.1%
Surprised 0.8%

AWS Rekognition

Age 43-51
Gender Male, 99.1%
Sad 69.6%
Happy 14%
Calm 8.2%
Confused 4.2%
Angry 1.3%
Fear 1%
Disgusted 0.9%
Surprised 0.9%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 78.3%
Bench 76.6%
Chair 74.7%
Tie 70.2%

Captions

Microsoft

a group of people sitting on a bench 90.1%
a group of people posing for a photo 90%
a group of people sitting posing for the camera 89.9%