Human Generated Data

Title

Untitled (two children in overalls standing outside)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16912

Human Generated Data

Title

Untitled (two children in overalls standing outside)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16912

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Shorts 99.8
Clothing 99.8
Apparel 99.8
Boy 99.8
Human 99.8
Person 99.4
Person 98.9
Shoe 95.9
Footwear 95.9
Face 94.6
Shoe 92.1
Nature 88.3
Outdoors 87.9
Kid 87.9
Child 87.9
Sea 85.5
Ocean 85.5
Water 85.5
Portrait 76.7
Photography 76.7
Photo 76.7
Play 74.6
Baby 72.8
People 72
Smile 71.4
Shoe 70.8
Rock 69.5
Sand 67
Coast 63.9
Shoreline 63.9
Beach 63.7
Hand 59.3
Shoe 55.6

Clarifai
created on 2023-10-29

child 100
people 99.9
son 99.4
boy 99.1
two 98.7
sibling 98.4
portrait 97.7
three 97
family 96.3
four 94.6
offspring 93.8
monochrome 93.3
wear 93
group together 91.2
man 91.2
recreation 90.5
facial expression 90.2
documentary 88.5
fun 86.9
group 86.9

Imagga
created on 2022-02-26

child 97.7
sibling 35.9
person 31.4
people 26.8
man 25.5
male 25
kid 23.9
boy 23.5
happy 21.9
beach 21.9
juvenile 21.7
kin 21.5
playing 21
fun 21
childhood 20.6
dad 20.6
family 20.5
little 19.4
parent 18.9
vacation 18.8
father 18.7
children 18.2
walk 18.1
outdoors 17.2
smiling 16.6
play 16.4
son 16.1
walking 16.1
sand 15.7
happiness 15.7
park 15.6
mother 15.5
adult 15.5
summer 15.4
lifestyle 15.2
love 14.2
couple 13.9
outdoor 13.8
girls 13.7
portrait 13.6
daughter 13.4
together 13.1
holiday 12.9
joy 12.5
sea 12.5
cheerful 12.2
youth 11.9
sport 11.2
outside 11.1
brother 11
water 10.7
running 10.6
cute 10
active 9.9
sun 9.7
kids 9.4
baby 9.4
smile 9.3
pretty 9.1
coast 9
women 8.7
toddler 8.6
enjoying 8.5
casual 8.5
two 8.5
sky 8.3
life 8.2
day 7.8
sunny 7.7
world 7.7
health 7.6
loving 7.6
playful 7.6
enjoy 7.5
senior 7.5
human 7.5
holding 7.4
air 7.4
dirty 7.2
black 7.2
sunset 7.2
activity 7.2
trees 7.1
autumn 7

Google
created on 2022-02-26

White 92.2
Standing 86.4
Gesture 85.3
Black-and-white 84.8
Style 83.8
Shorts 83.2
People in nature 83.1
Toddler 78.6
Monochrome 72.7
Monochrome photography 72.5
Child 71.9
Fun 71.2
Happy 70.8
Vintage clothing 67.7
Stock photography 62.3
Play 62.2
Baby 57.1
Shadow 56.6
Font 56
T-shirt 54.2

Microsoft
created on 2022-02-26

toddler 99.3
outdoor 97.6
person 97.5
baby 97.3
boy 97.1
clothing 95.3
human face 92.8
text 91.7
child 91.7
young 87.9
little 82
black and white 74.6
black 70.1
posing 45.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 64.8%
Happy 92.7%
Surprised 2.7%
Calm 1.9%
Sad 1.2%
Fear 0.8%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-31
Gender Male, 97.8%
Calm 67%
Happy 25%
Sad 2.6%
Surprised 1.9%
Disgusted 1.4%
Confused 0.9%
Angry 0.8%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.4%
Person 98.9%
Shoe 95.9%
Shoe 92.1%
Shoe 70.8%
Shoe 55.6%

Text analysis

Amazon

12

Google

MJI7--Y T 3RA°2-- AGO 12
MJI7--Y
T
3RA°2--
AGO
12