Human Generated Data

Title

Untitled (man with guitar and another man sitting by fountain, Central Park, New York City)
Date

c. 1960 - c. 1975
People

Artist: Leon Levinstein, American 1910 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Donald Fineberg, P2001.55

Human Generated Data

Title

Untitled (man with guitar and another man sitting by fountain, Central Park, New York City)

People

Artist: Leon Levinstein, American 1910 - 1988

Date

c. 1960 - c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Person 98.4
Guitar 97.5
Leisure Activities 97.5
Musical Instrument 97.5
Musician 91.9
Guitarist 90.8
Performer 90.8
Person 83
Weapon 77.5
Weaponry 77.5
Shoe 77.3
Footwear 77.3
Clothing 77.3
Apparel 77.3
Pants 68.3
Face 63.2
Portrait 61.2
Photography 61.2
Photo 61.2
Female 55.7

Imagga
created on 2022-01-22

adult 24.1
man 23.5
swing 23.1
person 21.4
sport 21.1
people 18.4
mechanical device 16.6
male 16.6
plaything 16.3
outdoor 16.1
posing 16
fashion 15.8
active 15.8
portrait 15.5
outdoors 15.3
brass 15.1
wind instrument 15.1
attractive 14
skateboard 13.8
street 13.8
lifestyle 13.7
exercise 13.6
human 13.5
pretty 13.3
leisure 13.3
model 13.2
action 13.1
sexy 12.9
one 12.7
dress 12.7
mechanism 12.5
world 12.4
black 12.2
women 11.9
musical instrument 11.8
sunset 11.7
city 11.6
fun 11.2
wheeled vehicle 11.1
beach 11.1
summer 10.9
elegance 10.9
athlete 10.7
guy 10.3
motion 10.3
trombone 10.2
cute 10.1
sensuality 10
leg 10
fitness 9.9
performer 9.6
standing 9.6
moving 9.5
board 9.4
happy 9.4
water 9.3
playing 9.1
recreation 9
activity 9
sky 8.9
sun 8.9
urban 8.7
jumping 8.7
running 8.6
play 8.6
performance 8.6
men 8.6
outside 8.6
walking 8.5
legs 8.5
relaxation 8.4
dark 8.4
device 8.3
runner 8.3
silhouette 8.3
style 8.2
music 8.1
lady 8.1
child 8.1
hair 7.9
life 7.9
cornet 7.9
vehicle 7.9
brunette 7.8
sitting 7.7
wall 7.7
health 7.6
dance 7.6
relax 7.6
energy 7.6
movement 7.5
slim 7.4
teenager 7.3
clothing 7.3
pose 7.3
body 7.2
sand 7.1
face 7.1
happiness 7.1
sea 7

Google
created on 2022-01-22

Clothing 98.7
Jeans 97.1
Shoe 96.2
Musical instrument 95.3
Photograph 94.1
White 92.2
Black 89.8
Infrastructure 89.1
Guitar 87.6
Black-and-white 86
Style 84.2
Musician 81.9
Music 79.4
Sneakers 78.9
Road 77.4
String instrument 77
Sidewalk 76
Hat 75.8
Monochrome 75.4
Plucked string instruments 75.2

Microsoft
created on 2022-01-22

outdoor 99.7
ground 97.6
black and white 92.7
person 91.8
text 86.5
clothing 86
street 82.2
monochrome 76.2
footwear 74.9
musical instrument 60.3
man 60.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 38.2%
Confused 13.8%
Disgusted 13.5%
Sad 12.7%
Happy 9%
Angry 5.7%
Fear 3.6%
Surprised 3.5%

AWS Rekognition

Age 18-26
Gender Male, 89%
Angry 96%
Fear 1%
Sad 0.6%
Happy 0.6%
Calm 0.5%
Disgusted 0.5%
Surprised 0.5%
Confused 0.4%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Guitar 97.5%
Shoe 77.3%

Captions

Microsoft

a man and a woman sitting on a bench 45.3%
a man and a woman sitting on a sidewalk 45.2%
a person sitting on a bench 45.1%