Human Generated Data

Title

Untitled (mother and child)
Date

1930s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2981

Human Generated Data

Title

Untitled (mother and child)

People

Artist: Unidentified Artist,

Date

1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Apparel 99.9
Clothing 99.9
Person 99
Human 99
Footwear 98.9
Shoe 98.9
Person 98.6
Shoe 97.9
Overcoat 95.8
Coat 95.8
Road 68.4
Person 68.2
Person 61.9
Hat 61.2
Cap 60.3
Suit 58
Highway 55.9
Freeway 55.9
Asphalt 55.1
Tarmac 55.1

Imagga
created on 2022-01-08

kin 36.2
man 30.9
people 27.9
parent 25.5
male 25
person 21.9
love 21.3
child 21.2
outdoors 20.4
outdoor 19.9
happy 18.8
couple 18.3
portrait 18.1
adult 17.5
walk 17.1
walking 17
dad 16.8
lifestyle 16.6
silhouette 16.6
sunset 16.2
father 15.7
park 15.6
mother 15.5
beach 15.2
fun 15
smile 15
together 14
life 13.8
outside 13.7
women 13.4
active 12.6
day 12.6
grandma 12.5
family 12.5
summer 12.2
sky 12.1
black 12.1
sun 12.1
city 10.8
ocean 10.8
water 10.7
vacation 10.6
pretty 10.5
attractive 10.5
boy 10.4
two 10.2
smiling 10.1
son 10
joy 10
kid 9.7
health 9.7
business 9.7
urban 9.6
sport 9.5
world 9.5
sitting 9.4
happiness 9.4
sea 9.4
relationship 9.4
youth 9.4
winter 9.4
casual 9.3
holding 9.1
hands 8.7
men 8.6
shore 8.4
fashion 8.3
street 8.3
sand 8.1
looking 8
hair 7.9
autumn 7.9
sibling 7.8
model 7.8
corporate 7.7
dusk 7.6
relax 7.6
serene 7.5
relaxation 7.5
guy 7.5
brother 7.5
peaceful 7.3
lady 7.3
exercise 7.3
success 7.2
office 7.2
holiday 7.2
romance 7.1
handsome 7.1
romantic 7.1
snow 7.1
tourist 7

Google
created on 2022-01-08

Face 98.3
Black 89.7
Standing 86.4
Flash photography 85.8
Gesture 85.3
Sky 85.2
Black-and-white 84.7
Happy 84.3
Style 84
Jacket 83.2
Adaptation 79.4
Tints and shades 77.3
Tree 76.5
Beauty 74.9
Monochrome photography 73.1
Toddler 72.7
Monochrome 72.3
Plant 71.1
Vintage clothing 70.5
Room 66.4

Microsoft
created on 2022-01-08

sky 98.8
clothing 97.9
outdoor 97.4
text 96.3
smile 94.9
person 93.8
human face 89.2
woman 84.8
black and white 78
posing 58.6
man 54.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 100%
Sad 96.5%
Angry 1.9%
Calm 1.4%
Confused 0.1%
Disgusted 0%
Fear 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 37-45
Gender Female, 98.3%
Sad 47.8%
Confused 25.3%
Calm 24.8%
Angry 1.1%
Fear 0.4%
Surprised 0.3%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Shoe 98.9%

Captions

Microsoft

a person posing for a photo 92.4%
a person standing posing for the camera 92.2%
a girl posing for a photo 81.2%