Human Generated Data

Title

Untitled (woman with little girl on snowy sidewalk)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17513

Human Generated Data

Title

Untitled (woman with little girl on snowy sidewalk)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17513

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 99.6
Human 99.6
Person 99.4
Person 98.8
Person 98.6
Shoe 90
Footwear 90
Car 87.9
Transportation 87.9
Vehicle 87.9
Automobile 87.9
Shorts 82.4
Person 73.9
Coat 73.1
Shoe 69.5
Helmet 66.8
Hat 65.6
Bonnet 63.1
Dress 62.2
Shoe 61.6
Girl 59.2
Female 59.2
Portrait 58.8
Photography 58.8
Face 58.8
Photo 58.8
Tarmac 55.5
Asphalt 55.5

Clarifai
created on 2023-10-29

street 99.9
people 99.8
monochrome 99.5
child 97.9
group together 97.2
two 96.5
woman 96
adult 94.7
man 94.3
pavement 92.6
girl 92.4
boy 92.3
wedding 91.9
one 91.3
many 91
couple 91
umbrella 90.9
wear 90.6
city 90.3
walk 90.1

Imagga
created on 2022-02-26

lab coat 43.6
coat 41.5
man 27.5
people 25.6
male 24.8
person 23.1
groom 20.7
professional 20.3
adult 19.8
garment 19.5
nurse 18.8
health 17.3
medical 16.8
worker 15.5
clothing 14.6
laboratory 14.4
lifestyle 14.4
research 14.3
holding 14
wedding 13.8
tennis 13.6
work 13.3
science 13.3
medicine 13.2
businessman 12.3
scientist 11.7
lab 11.6
chemistry 11.6
business 11.5
happy 11.3
looking 11.2
hospital 10.9
healthy 10.7
biology 10.4
men 10.3
clinic 10.1
racket 10.1
active 10
face 9.9
handsome 9.8
chemical 9.8
human 9.7
working 9.7
bride 9.7
scientific 9.7
indoors 9.7
technology 9.6
one person 9.4
smiling 9.4
happiness 9.4
doctor 9.4
equipment 9.3
sport 9.2
microscope 9.1
color 8.9
office 8.8
bouquet 8.7
standing 8.7
mask 8.6
instrument 8.5
fun 8.2
laptop 8.2
dress 8.1
computer 8
job 8
hair 7.9
love 7.9
couple 7.8
smile 7.8
court 7.8
summer 7.7
two 7.6
development 7.6
suit 7.4
fitness 7.2
surgeon 7.2
portrait 7.1
day 7.1
player 7

Google
created on 2022-02-26

Shoe 95.8
Black-and-white 85.7
Gesture 85.3
Style 83.8
Art 78
Monochrome photography 75.5
Monochrome 74.5
Vintage clothing 73.9
Hat 71.2
Sidewalk 65.5
Stock photography 63.6
Child 62.8
Room 62.7
Shadow 62.6
Street 59.7
Road 58.2
Asphalt 57.4
Road surface 56.1
Photo caption 55.8
Retro style 55.6

Microsoft
created on 2022-02-26

text 91.9
black and white 90.6
footwear 88.2
clothing 82.7
sport 79.4
street 65.5
dress 60.2
woman 53.5
monochrome 53.1
person 52.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 94.8%
Sad 75.4%
Happy 16.1%
Confused 3%
Disgusted 2.7%
Surprised 0.9%
Angry 0.8%
Fear 0.6%
Calm 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.3%
Calm 72.1%
Happy 17.9%
Sad 5.9%
Confused 2%
Angry 0.7%
Fear 0.6%
Surprised 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Shoe
Car
Helmet
Person 99.6%
Person 99.4%
Person 98.8%
Person 98.6%
Person 73.9%
Shoe 90%
Shoe 69.5%
Shoe 61.6%
Car 87.9%
Helmet 66.8%

Captions

Microsoft
created on 2022-02-26

a person holding a racket 62%
a person is holding a racket 60.7%
a person holding a frisbee 34.3%

Text analysis

Amazon

4

Google

MJIA- -YT3R2--A GON
MJIA-
-YT3R2--A
GON