Human Generated Data

Title

Untitled (three children sitting in grass)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17341

Human Generated Data

Title

Untitled (three children sitting in grass)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17341

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Face 99.9
Human 99.9
Smile 99.8
Person 99.6
Boy 99.4
Person 98.8
Play 95.9
Head 93
Person 91
Baby 90.2
Portrait 86.6
Photography 86.6
Photo 86.6
Clothing 86.3
Apparel 86.3
Kid 86.2
Child 86.2
Plant 85.1
Laughing 77.9
Outdoors 74.5
People 68.1
Tree 67.1
Selfie 63.8
Female 60.6
Chair 59
Furniture 59
Man 57.5
Urban 56.4
Rock 55.8
Aster 55.3
Flower 55.3
Blossom 55.3
Person 49.5

Clarifai
created on 2023-10-29

child 99.9
people 99.7
son 99.5
monochrome 99
portrait 99
group 98
family 97.3
baby 96.9
sibling 96.1
offspring 92.7
three 92.1
facial expression 92.1
sepia 91.6
interaction 89.4
girl 89.1
adult 87
two 85.5
affection 84.9
love 84.7
woman 84.4

Imagga
created on 2022-02-26

child 89.8
sibling 29.1
man 26.9
kin 25.5
people 24
portrait 23.9
juvenile 23.2
person 22.7
park 22.2
male 21.4
family 21.4
mother 21.1
outdoors 20.9
love 20.5
outdoor 19.9
happy 19.4
together 19.3
parent 17.9
youth 17.9
adult 16.8
couple 16.5
lifestyle 15.9
happiness 14.9
father 14.4
summer 14.1
daughter 13.5
fun 13.5
boy 13
smiling 13
black 12.6
leisure 12.5
kid 12.4
outside 12
world 11.8
joy 11.7
childhood 11.6
cute 10.8
smile 10.7
women 10.3
holding 9.9
casual 9.3
two 9.3
face 9.2
silhouette 9.1
pretty 9.1
autumn 8.8
day 8.6
son 8.6
men 8.6
brother 8.5
sport 8.5
relationship 8.4
girls 8.2
children 8.2
vacation 8.2
romantic 8
little 7.9
grass 7.9
dad 7.8
married 7.7
beach 7.6
baby 7.6
laughing 7.6
togetherness 7.6
friends 7.5
sunset 7.2

Google
created on 2022-02-26

Smile 97.3
Shorts 92.2
Black 89.6
Flash photography 87.7
Happy 87.2
Black-and-white 85.3
Style 84
Adaptation 79.4
T-shirt 78.8
Art 76.8
People in nature 76.1
Monochrome photography 74.2
Monochrome 73.3
Toddler 72.1
Tree 71.6
Font 69.7
Fun 68.5
Child 66.7
Grass 65.5
Stock photography 63.6

Microsoft
created on 2022-02-26

text 99.3
human face 97.9
toddler 96.3
baby 94
person 94
boy 88
child 86.8
clothing 76.3
smile 72.6
black and white 52.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 55.4%
Happy 74.7%
Surprised 17.9%
Calm 5.6%
Angry 0.8%
Disgusted 0.5%
Sad 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 1-7
Gender Male, 65.3%
Calm 79.7%
Surprised 19.9%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 2-8
Gender Male, 94.9%
Calm 98.2%
Surprised 1.3%
Happy 0.1%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 98.8%
Person 91%
Person 49.5%

Categories

Imagga

people portraits 51.2%
paintings art 37.7%
streetview architecture 6.6%
pets animals 2%

Captions

Microsoft
created on 2022-02-26

two people posing for a photo 57.8%
a person posing for a photo 57.7%
a couple of people posing for a photo 57.6%

Text analysis

Amazon

EM
RIDE EM
RIDE
as
KODAK-SL

Google

RIDE EM YT3AA2- A
RIDE
EM
YT3AA2-
A