Human Generated Data

Title

Untitled (parents walking with three children on sidewalk)
Date

1953
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8785
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (parents walking with three children on sidewalk)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Clothing 99.2
Apparel 99.2
Person 99.1
Shorts 98.4
Female 89.1
Shoe 85.8
Footwear 85.8
Woman 77.8
People 77.4
Plant 76.1
Tree 73
Face 71.7
Portrait 62.1
Photography 62.1
Photo 62.1
Palm Tree 60.2
Arecaceae 60.2
Skirt 57.4
Dress 56.6
Suit 56
Coat 56
Overcoat 56
Tarmac 56
Asphalt 56

Imagga
created on 2022-01-09

musical instrument 55
stringed instrument 31.6
stage 29.2
music 28.9
man 28.2
person 26.6
adult 24.8
guitar 24.6
wind instrument 23.8
musician 23.7
male 22.7
platform 19.7
device 19.5
bowed stringed instrument 17
people 16.7
play 16.4
black 15.6
singer 15.5
banjo 15.5
musical 15.3
instrument 15.1
performer 14.4
portrait 14.2
woodwind 14.1
rock 13.9
flute 13.6
concert 13.6
one 13.4
electronic instrument 12.9
playing 12.8
attractive 12.6
violin 12
holding 11.6
business 11.5
studio 11.4
lifestyle 10.8
guitarist 10.8
acoustic 10.8
silhouette 10.8
hand 10.6
businessman 10.6
sexy 10.4
player 10.4
sound 10.3
smoke 10.2
youth 10.2
entertainment 10.1
happy 10
performance 9.6
women 9.5
art 9.1
fashion 9
working 8.8
guy 8.7
hair 8.7
brass 8.7
human 8.2
danger 8.2
star 8.1
clothing 8.1
bass 8.1
computer 8
oboe 8
smile 7.8
song 7.8
percussion instrument 7.7
sitting 7.7
men 7.7
microphone 7.7
professional 7.7
hot 7.5
dark 7.5
fun 7.5
city 7.5
style 7.4
protection 7.3
office 7.2
dirty 7.2
suit 7.2
body 7.2
handsome 7.1
worker 7.1
posing 7.1
job 7.1
happiness 7

Google
created on 2022-01-09

Photograph 94.2
Black 89.7
Plant 87.5
Black-and-white 85.3
Style 83.9
Font 79.7
Adaptation 79.3
Monochrome photography 77.4
Tints and shades 76.9
Monochrome 76.1
Snapshot 74.3
Tree 71.8
Vintage clothing 71.3
Rectangle 67.7
Photo caption 67.1
Room 66.9
Boot 64.6
Stock photography 63.5
History 63.2
Classic 61.3

Microsoft
created on 2022-01-09

text 99
clothing 93.9
person 91.6
footwear 89.8
outdoor 89.6
black and white 79.1
black 71.3

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 96.9%
Happy 88.9%
Surprised 3.1%
Fear 2%
Confused 2%
Calm 1.7%
Sad 1%
Disgusted 0.9%
Angry 0.5%

AWS Rekognition

Age 34-42
Gender Male, 73.4%
Calm 79.9%
Surprised 11.1%
Sad 4.7%
Fear 2.5%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 49-57
Gender Female, 98.1%
Happy 76.4%
Fear 9.3%
Sad 9.2%
Calm 3.1%
Confused 0.6%
Disgusted 0.6%
Surprised 0.4%
Angry 0.3%

AWS Rekognition

Age 6-12
Gender Female, 54.5%
Calm 52.2%
Sad 27.5%
Disgusted 10.3%
Surprised 3.5%
Happy 2.1%
Angry 1.8%
Fear 1.4%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 85.8%

Captions

Microsoft

a person standing in front of a building 74.7%
a man and a woman standing in front of a building 54.2%
a person standing in front of a building 54.1%

Text analysis

Amazon

8SA
39293.
KODAKSLA

Google

00 392 9 3.
00
392
9
3.