Human Generated Data

Title

Untitled (one boy pulling another boy in wagon)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16374

Human Generated Data

Title

Untitled (one boy pulling another boy in wagon)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Grass 99.1
Plant 99.1
Human 98.4
Person 98.4
Yard 96.7
Outdoors 96.7
Nature 96.7
Building 95.7
Housing 95.7
Person 93.5
Neighborhood 80.9
Urban 80.9
House 80.1
Villa 72.9
Sport 67.8
Skateboard 67.8
Sports 67.8
Furniture 67.4
Countryside 64
Rural 64
Shelter 64
Toy 63.8
Lawn 62.9
Playground 57.9
Play Area 57.9

Imagga
created on 2022-02-11

sport 41.1
outdoor 26.8
swing 23.9
outdoors 22.7
child 22.2
grass 20.5
active 20.1
mechanical device 20
leisure 19.9
summer 19.3
activity 18.8
fun 18
playing 17.3
recreation 17
man 16.8
device 16.7
lifestyle 16.6
park 16.5
sports equipment 16.4
outside 16.3
people 16.2
happy 15.7
exercise 15.4
fitness 15.4
sprinkler 15.1
athlete 14.9
mechanism 14.9
play 14.6
kid 14.2
competition 13.7
cute 13.6
lawn mower 13.5
pretty 12.6
happiness 12.5
running 12.5
boy 12.2
day 11.8
ball 11.7
person 11.6
stick 11.6
childhood 11.6
garden tool 10.9
joy 10.9
male 10.7
tricycle 10.6
little 10.6
athletic 10.5
golf 10.5
weapon 10.5
adult 10.4
wheeled vehicle 10.3
action 10.2
sky 10.2
sports 10.2
relax 10.1
field 10
children 10
smile 10
vacation 9.8
game 9.8
leash 9.7
one 9.7
youth 9.4
street 9.2
healthy 8.8
run 8.7
course 8.6
hobby 8.5
free 8.4
portrait 8.4
energy 8.4
tool 8.3
teenager 8.2
player 8.1
smiling 8
equipment 7.9
women 7.9
spring 7.8
restraint 7.8
practice 7.7
men 7.7
health 7.6
drive 7.6
plaything 7.5
javelin 7.4
training 7.4
freedom 7.3
vehicle 7.3
runner 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

outdoor 98.6
child 97.3
toddler 96.7
baby 92
black and white 87.3
text 77.3
playground 77.3
house 69.1
person 67.6
boy 65.5

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 96.8%
Calm 85.5%
Happy 8.8%
Sad 2.1%
Fear 1.1%
Surprised 1%
Angry 0.7%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 4-10
Gender Female, 52.2%
Calm 89.5%
Happy 3.4%
Sad 2.9%
Fear 1.3%
Confused 1.1%
Surprised 0.7%
Angry 0.6%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Skateboard 67.8%

Captions

Microsoft

a little girl standing in front of a building 71.2%
a young girl standing in front of a building 71.1%
a person standing in front of a building 71%

Text analysis

Amazon

SUPER
YT37A°2
YT77A92-
VAGOY
YT77A92- VAGOY

Google

RADIS SUPER
RADIS
SUPER