Human Generated Data

Title

Untitled (boy with rocking horse)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17394

Human Generated Data

Title

Untitled (boy with rocking horse)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.2
Person 99.2
Furniture 99
Flooring 97.8
Play 97.6
Chair 97.1
Floor 94.8
Shoe 92.3
Apparel 92.3
Footwear 92.3
Clothing 92.3
Transportation 91.4
Bike 91.4
Bicycle 91.4
Vehicle 91.4
Wood 87.3
Baby 85.3
Wheel 74.7
Machine 74.7
Face 70
Portrait 67.6
Photography 67.6
Photo 67.6
Child 67.3
Kid 67.3
Couch 61.4
Sport 58.4
Sports 58.4
Hardwood 56.7
Female 56.2
Girl 56.2

Imagga
created on 2022-02-26

man 37.6
wheeled vehicle 30
people 28.4
male 26.2
person 24.7
skateboard 22
active 19.8
vehicle 19
men 18.9
lifestyle 17.3
adult 16.3
cleaner 15.8
outdoors 15.7
exercise bike 15.6
conveyance 15.5
pedestrian 14.4
board 14.3
worker 14.2
wheelchair 14.2
equipment 13.5
snow 13.5
chair 13.4
city 13.3
indoors 13.2
device 13.2
urban 13.1
sport 12.9
street 12.9
exercise device 12.6
happy 12.5
newspaper 12.1
exercise 11.8
day 11.8
boy 11.3
action 11.1
health 11.1
youth 11.1
work 11
smiling 10.8
shopping cart 10.8
outdoor 10.7
job 10.6
working 10.6
handcart 10.5
professional 10.4
portrait 10.4
senior 10.3
motion 10.3
winter 10.2
product 10.2
tricycle 9.9
activity 9.9
women 9.5
cold 9.5
walking 9.5
leisure 9.1
recreation 9
color 8.9
home 8.8
happiness 8.6
smile 8.5
casual 8.5
mature 8.4
house 8.4
speed 8.2
one 8.2
fitness 8.1
looking 8
medical 7.9
patient 7.9
couple 7.8
high 7.8
retired 7.8
run 7.7
extreme 7.7
athletic 7.7
athlete 7.6
clothing 7.6
legs 7.5
fun 7.5
holding 7.4
seat 7.4
park 7.4
sports 7.4
child 7.4
creation 7.2
transportation 7.2
skate 7.2
family 7.1
hospital 7.1
businessman 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

skating 99.7
man 90.6
young 86.6
boy 85.7
text 83.3
black and white 78.1
footwear 77.7
furniture 66.4
chair 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Female, 83.7%
Surprised 70.6%
Calm 24.4%
Sad 1.5%
Fear 1.2%
Disgusted 0.8%
Confused 0.5%
Happy 0.5%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Chair 97.1%
Shoe 92.3%
Bicycle 91.4%
Wheel 74.7%

Captions

Microsoft

a young boy riding a skateboard up the side of a building 45.8%
a young man riding a skateboard up the side of a building 45.7%
a young boy riding a skateboard 45.6%

Text analysis

Amazon

16
arr
KODVK-2VEELA