Human Generated Data

Title

Untitled (woman and three boys on brick wall)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17565

Human Generated Data

Title

Untitled (woman and three boys on brick wall)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17565

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.6
Shoe 98.4
Footwear 98.4
Tree 97.9
Plant 97.9
Dress 97.7
Female 97.2
Person 95.8
Woman 89.8
Skirt 85.9
Chair 84.8
Furniture 84.8
Shoe 83
Face 82.7
Outdoors 75.6
Leisure Activities 71.5
Fir 68.9
Abies 68.9
Portrait 68.8
Photography 68.8
Photo 68.8
Shorts 67.6
Girl 67.2
People 65
Pants 64.9
Dance Pose 64
Smile 58.9
Nature 58.7
Costume 57.4
Conifer 56.4
Grass 55.2

Clarifai
created on 2023-10-28

people 99.6
adult 97.4
woman 97.2
man 96.6
child 92
wear 91.9
group together 91.3
group 90.8
monochrome 90.2
two 90
outfit 85.6
leader 85.5
recreation 84.8
elderly 83.4
veil 82.9
portrait 82.8
administration 78.1
lid 76.9
three 76.9
actor 74.7

Imagga
created on 2022-02-26

wind instrument 45.3
brass 44.2
sax 43.7
man 28.9
musical instrument 28.4
cornet 26.5
people 21.2
adult 20.1
male 19.9
sunset 19.8
beach 19.4
person 18
couple 17.4
silhouette 17.4
sky 15.9
active 15.4
outdoor 15.3
happy 15
park 14.8
love 14.2
summer 14.1
sport 13.3
lifestyle 13
happiness 12.5
walking 12.3
pedestrian 12.3
portrait 12.3
outdoors 11.4
black 11.4
fun 11.2
two 11
dark 10.9
ocean 10.8
water 10.7
together 10.5
dusk 10.5
sand 10.5
sea 10.2
joy 10
vacation 9.8
family 9.8
child 9.5
women 9.5
play 9.5
horn 9.4
device 9.3
evening 9.3
tree 9.2
leisure 9.1
attractive 9.1
dress 9
romance 8.9
sunlight 8.9
sexy 8.8
boy 8.7
walk 8.6
clothing 8.5
free 8.4
pretty 8.4
holding 8.3
danger 8.2
dirty 8.1
sun 8
world 7.9
fashion 7.5
friends 7.5
life 7.5
relationship 7.5
friendship 7.5
guy 7.5
landscape 7.4
lady 7.3
girls 7.3
protection 7.3
body 7.2
recreation 7.2
businessman 7.1
day 7.1

Google
created on 2022-02-26

Christmas tree 94.4
Plant 91.7
Gesture 85.3
Black-and-white 84.5
Tree 79.3
Adaptation 79.3
Flash photography 78.6
Art 76.5
Happy 76.3
Christmas decoration 75.7
Event 74.3
Monochrome 73.9
Monochrome photography 73.7
Vintage clothing 67.5
Conifer 67.2
Holiday 65
Room 64.3
Photo caption 64.1
Stock photography 63
Still life photography 61

Microsoft
created on 2022-02-26

text 99.4
outdoor 97.8
christmas tree 97.6
clothing 74.9
person 72
christmas 60.5
black and white 56.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Female, 58.6%
Happy 23.4%
Fear 17.4%
Angry 16%
Calm 9.7%
Confused 8.8%
Sad 8.8%
Disgusted 8.1%
Surprised 7.9%

AWS Rekognition

Age 37-45
Gender Male, 99%
Calm 99.3%
Disgusted 0.2%
Happy 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.7%
Person 99.6%
Person 95.8%
Shoe 98.4%
Shoe 83%

Captions

Microsoft
created on 2022-02-26

a person throwing a frisbee 29.2%
a person holding a sign 29.1%

Text analysis

Amazon

SEI

Google

SEI
SEI