Human Generated Data

Title

Untitled (children outside with puppet and dog)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16953

Human Generated Data

Title

Untitled (children outside with puppet and dog)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16953

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.2
Shorts 98.3
Clothing 98.3
Apparel 98.3
Nature 92.3
Dress 90
Outdoors 89.3
Play 83.9
Chair 73.8
Furniture 73.8
Ice 71.3
Kid 71.1
Child 71.1
Portrait 63.5
Photography 63.5
Photo 63.5
Face 63.5
Female 63
Girl 60.6
People 59.7
Finger 58.6
Pants 58.1
Shoe 57.5
Footwear 57.5
Sand 57.1
Weather 56.7
Snow 56.2
Military 55.4

Clarifai
created on 2023-10-29

people 99.7
child 99.4
two 98.8
family 94.9
three 94.5
group 92.8
group together 91.8
boy 91.7
man 89.9
four 86.6
monochrome 85.7
sibling 84.9
wear 84.6
adult 83.7
offspring 83.4
fun 82.8
actor 82.6
canine 82.2
son 81
home 79.1

Imagga
created on 2022-02-26

kin 39.1
man 34.3
world 29.8
child 25.9
people 25.7
happy 21.3
couple 20.9
male 20.8
beach 20.2
person 20.1
love 19.7
adult 17.7
lifestyle 17.3
happiness 17.2
walking 17
outdoor 16.1
active 15.4
outdoors 14.9
summer 14.8
smiling 14.5
walk 14.3
fun 14.2
father 13.4
portrait 12.9
joy 12.5
sea 12.5
sand 12.4
dad 12.4
together 12.3
dress 11.7
family 11.6
bride 11.5
married 11.5
boy 11.3
day 11
sport 11
sky 10.8
city 10.8
park 10.7
smile 10.7
vacation 10.6
home plate 10.4
two 10.2
street 10.1
wedding 10.1
parent 10.1
playing 10
holding 9.9
romantic 9.8
pretty 9.8
black 9.6
groom 9.6
standing 9.6
hands 9.6
senior 9.4
romance 8.9
life 8.8
ball 8.5
relationship 8.4
action 8.3
leisure 8.3
human 8.2
freedom 8.2
soccer ball 8.1
sun 8
men 7.7
run 7.7
running 7.7
old 7.7
health 7.6
marriage 7.6
wife 7.6
base 7.5
sibling 7.4
water 7.3
danger 7.3
exercise 7.3
sexy 7.2
juvenile 7.2
sunset 7.2
women 7.1
businessman 7.1

Google
created on 2022-02-26

Photograph 94.2
White 92.2
Window 90.5
Black 90
Black-and-white 86.3
Mammal 85.5
Water 85.4
Gesture 85.2
Style 84
Line 82.2
Toddler 79.3
Child 77.3
Monochrome 76.4
Monochrome photography 76
Snapshot 74.3
Fun 71.1
Stock photography 65.8
Door 64
Building 63.1
Street 62.3

Microsoft
created on 2022-02-26

toddler 97.9
clothing 95.6
outdoor 95.2
person 91.6
black and white 89.9
baby 89.1
text 86.6
boy 85.4
footwear 80
child 78.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 88.6%
Calm 74.4%
Sad 22.3%
Confused 1.1%
Fear 1%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%

AWS Rekognition

Age 40-48
Gender Male, 96.7%
Calm 99.8%
Sad 0.1%
Happy 0%
Confused 0%
Fear 0%
Surprised 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.5%
Person 99.2%
Shoe 57.5%

Captions

Microsoft
created on 2022-02-26

a man standing next to a building 79.9%
a man standing in front of a building 79.8%
an old photo of a man 79.1%

Text analysis

Amazon

AGOY
TAAP.