Human Generated Data

Title

Untitled (three kids sitting on ground, legs of man behind them)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16350

Human Generated Data

Title

Untitled (three kids sitting on ground, legs of man behind them)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16350

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.5
Human 99.5
Person 99.4
Clothing 99.2
Apparel 99.2
Grass 98.6
Plant 98.6
Person 97.5
Pants 95.9
Face 95.7
Dress 94.8
Person 91.7
Outdoors 89.8
Yard 86.4
Nature 86.4
Tree 85.9
People 83.8
Play 79.8
Female 77.5
Kid 77
Child 77
Photography 77
Photo 77
Portrait 76.1
Sleeve 73.6
Baby 73
Furniture 70.9
Field 70.4
Ground 69.1
Road 68.9
Girl 67.8
Person 65.8
Suit 65.6
Coat 65.6
Overcoat 65.6
Jeans 65.3
Denim 65.3
Park 64.5
Lawn 64.5
Gravel 60.2
Dirt Road 60.2
Shorts 59.6
Boy 58
Leisure Activities 57.9
Sand 56.9
Shirt 56.8

Clarifai
created on 2023-10-28

people 99.9
child 99.6
boy 97.9
group together 96.2
monochrome 96.1
man 95
adult 92.7
two 92.5
fun 92.3
recreation 91.7
group 91.1
family 89.8
wear 88.9
son 88.7
athlete 86.2
enjoyment 86.2
several 85.2
sibling 84.9
three 84.7
sports equipment 83.6

Imagga
created on 2022-02-11

child 23.8
people 21.8
man 21.5
outdoors 19.5
happiness 17.2
male 16.6
love 15.8
person 15.7
outdoor 15.3
dress 14.5
groom 14.4
fun 14.2
newspaper 14
adult 13.7
world 13.5
couple 13.1
portrait 12.9
summer 12.9
two 12.7
negative 12.5
smiling 12.3
sport 12.1
happy 11.9
bride 11.8
parent 11.4
black 11.4
lifestyle 10.8
product 10.7
cheerful 10.6
married 10.5
mother 10.5
men 10.3
women 10.3
wedding 10.1
playing 10
joy 10
old 9.8
sand 9.3
beach 9.3
film 9.2
park 9.1
active 9
family 8.9
dad 8.9
play 8.6
outside 8.6
smile 8.6
face 8.5
creation 8.4
holding 8.3
vacation 8.2
danger 8.2
activity 8.1
sea 7.8
color 7.8
clothing 7.8
kin 7.7
sky 7.7
marriage 7.6
enjoy 7.5
free 7.5
leisure 7.5
water 7.3
life 7.3
girls 7.3
sun 7.2
player 7.2
art 7.2
father 7.2
romantic 7.1
day 7.1

Google
created on 2022-02-11

Photograph 94.2
Black-and-white 86.3
Gesture 85.3
Shorts 84.7
Style 83.9
Line 81.6
Grass 81.3
Adaptation 79.3
Monochrome photography 74.3
Snapshot 74.3
Monochrome 73.9
Font 73
Recreation 69.5
Photo caption 68.3
Player 67.9
Baseball 65.8
Vintage clothing 65.6
Fun 64.8
Personal protective equipment 63.7
Stock photography 62.2

Microsoft
created on 2022-02-11

outdoor 97.9
toddler 96.5
person 95.9
baby 95.4
clothing 93.2
boy 85.4
human face 79
child 62
black and white 57.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Female, 71.2%
Happy 68.4%
Sad 13.1%
Fear 9.8%
Calm 2.7%
Angry 2%
Surprised 1.6%
Disgusted 1.5%
Confused 1%

AWS Rekognition

Age 10-18
Gender Male, 78.2%
Calm 76.7%
Happy 16.3%
Sad 4.9%
Angry 0.8%
Disgusted 0.5%
Surprised 0.3%
Confused 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.4%
Person 97.5%
Person 91.7%
Person 65.8%

Categories

Imagga

paintings art 99.9%

Captions

Text analysis

Amazon

16.
AET
KODAKEELA

Google

16.
16.