Human Generated Data

Title

Untitled (little boy and girl with carved pumpkin on front steps)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16958

Human Generated Data

Title

Untitled (little boy and girl with carved pumpkin on front steps)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.3
Clothing 99.2
Apparel 99.2
Footwear 79.9
Shorts 71.1
Shoe 69
Sleeve 67.7
Floor 63.1
Child 62.8
Kid 62.8
Chair 62.1
Furniture 62.1
Photography 62
Face 62
Photo 62
Portrait 62
Sport 60.4
Sports 60.4
Female 59.3
Girl 59.3
Flooring 58.5

Imagga
created on 2022-02-26

person 32.8
people 29
man 29
adult 25.9
nurse 23.1
male 22.3
exercise 20
men 19.8
lifestyle 18.8
player 18.3
professional 17
happy 16.3
women 15.8
sport 15.3
active 14.7
teacher 14.7
fitness 14.5
ball 14.3
athlete 14.3
portrait 14.2
child 14.2
health 13.9
equipment 13.7
dumbbell 13.4
sitting 12.9
contestant 12.7
casual 12.7
two 12.7
holding 12.4
standing 12.2
body 12
activity 11.6
smiling 11.6
room 11.5
smile 11.4
clothing 11.2
looking 11.2
pretty 11.2
ballplayer 11.1
training 11.1
youth 11.1
happiness 11
weight 10.8
interior 10.6
fit 10.1
healthy 10.1
sports equipment 9.8
business 9.7
one 9.7
indoors 9.7
black 9.6
student 9.2
indoor 9.1
working 8.8
businessman 8.8
life 8.8
together 8.8
boy 8.7
play 8.6
school 8.6
knee pad 8.5
face 8.5
attractive 8.4
hand 8.4
camera 8.3
fun 8.2
alone 8.2
outdoors 8.2
educator 8.1
recreation 8.1
office 8
home 8
concentration 7.7
exercising 7.7
outdoor 7.6
uniform 7.6
golfer 7.6
legs 7.5
human 7.5
senior 7.5
strength 7.5
leisure 7.5
care 7.4
street 7.4
wellness 7.3
dress 7.2
building 7.2
hair 7.1
family 7.1
to 7.1
job 7.1
work 7.1
look 7

Google
created on 2022-02-26

Shoe 96.7
Black 89.7
Window 88.6
Black-and-white 86.3
Style 84.1
Sports equipment 81.9
Sneakers 79.8
Hat 79.5
Monochrome 78.8
Monochrome photography 77.7
Shorts 75
Suit 70.6
Street 68.6
Recreation 68.1
Sitting 67.2
Stock photography 64.3
Eyewear 62.3
Child 61.1
Sport venue 60.1
Road 60

Microsoft
created on 2022-02-26

person 98.8
outdoor 95.1
clothing 93.2
black and white 91.3
statue 83.7
human face 61.3

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Male, 85%
Calm 90%
Sad 8.1%
Confused 1.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 69%

Captions

Microsoft

a man riding a skateboard up the side of a building 28.4%
a man riding a skateboard down the side of a building 28.3%

Text analysis

Amazon

4