Human Generated Data

Title

Untitled (woman with little girl on snowy sidewalk)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17513

Human Generated Data

Title

Untitled (woman with little girl on snowy sidewalk)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 99.9
Clothing 99.9
Human 99.6
Person 99.6
Person 99.4
Person 98.8
Person 98.6
Footwear 90
Shoe 90
Transportation 87.9
Vehicle 87.9
Automobile 87.9
Car 87.9
Shorts 82.4
Person 73.9
Coat 73.1
Shoe 69.5
Helmet 66.8
Hat 65.6
Bonnet 63.1
Dress 62.2
Shoe 61.6
Girl 59.2
Female 59.2
Photography 58.8
Portrait 58.8
Face 58.8
Photo 58.8
Asphalt 55.5
Tarmac 55.5

Imagga
created on 2022-02-26

lab coat 43.6
coat 41.5
man 27.5
people 25.6
male 24.8
person 23.1
groom 20.7
professional 20.3
adult 19.8
garment 19.5
nurse 18.8
health 17.3
medical 16.8
worker 15.5
clothing 14.6
laboratory 14.4
lifestyle 14.4
research 14.3
holding 14
wedding 13.8
tennis 13.6
work 13.3
science 13.3
medicine 13.2
businessman 12.3
scientist 11.7
lab 11.6
chemistry 11.6
business 11.5
happy 11.3
looking 11.2
hospital 10.9
healthy 10.7
biology 10.4
men 10.3
clinic 10.1
racket 10.1
active 10
face 9.9
handsome 9.8
chemical 9.8
human 9.7
working 9.7
bride 9.7
scientific 9.7
indoors 9.7
technology 9.6
one person 9.4
smiling 9.4
happiness 9.4
doctor 9.4
equipment 9.3
sport 9.2
microscope 9.1
color 8.9
office 8.8
bouquet 8.7
standing 8.7
mask 8.6
instrument 8.5
fun 8.2
laptop 8.2
dress 8.1
computer 8
job 8
hair 7.9
love 7.9
couple 7.8
smile 7.8
court 7.8
summer 7.7
two 7.6
development 7.6
suit 7.4
fitness 7.2
surgeon 7.2
portrait 7.1
day 7.1
player 7

Google
created on 2022-02-26

Shoe 95.8
Black-and-white 85.7
Gesture 85.3
Style 83.8
Art 78
Monochrome photography 75.5
Monochrome 74.5
Vintage clothing 73.9
Hat 71.2
Sidewalk 65.5
Stock photography 63.6
Child 62.8
Room 62.7
Shadow 62.6
Street 59.7
Road 58.2
Asphalt 57.4
Road surface 56.1
Photo caption 55.8
Retro style 55.6

Microsoft
created on 2022-02-26

text 91.9
black and white 90.6
footwear 88.2
clothing 82.7
sport 79.4
street 65.5
dress 60.2
woman 53.5
monochrome 53.1
person 52.2

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 94.8%
Sad 75.4%
Happy 16.1%
Confused 3%
Disgusted 2.7%
Surprised 0.9%
Angry 0.8%
Fear 0.6%
Calm 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.3%
Calm 72.1%
Happy 17.9%
Sad 5.9%
Confused 2%
Angry 0.7%
Fear 0.6%
Surprised 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.6%
Shoe 90%
Car 87.9%
Helmet 66.8%

Captions

Microsoft

a person holding a racket 62%
a person is holding a racket 60.7%
a person holding a frisbee 34.3%

Text analysis

Amazon

4

Google

GON
MJIA-
MJIA- -YT3R2--A GON
-YT3R2--A