Human Generated Data

Title

Untitled (two boys playing leapfrog)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15515

Human Generated Data

Title

Untitled (two boys playing leapfrog)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Shoe 98.7
Apparel 98.7
Footwear 98.7
Clothing 98.7
Human 97.7
Person 97.7
Person 97.4
Shoe 82.2
Pants 80.7
Tarmac 68.8
Asphalt 68.8
Leisure Activities 67.3
Person 66.3
Trampoline 55.6

Imagga
created on 2022-03-05

television 100
telecommunication system 88.7
sport 39.5
broadcasting 36.4
training 34.2
athlete 34.1
person 32.5
people 30.7
player 30.2
skill 29.8
monitor 29.7
stadium 29.2
match 28.9
muscular 28.7
cheering 28.4
competition 28.4
audience 28.3
championship 28.2
silhouette 28.1
park 28
crowd 27.8
lights 27.8
patriotic 27.8
event 27.7
flag 27.5
nation 27.4
nighttime 27.4
telecommunication 27.4
field 25.9
symbol 20.9
icon 20.6
versus 18.7
medium 17.6
happy 17.5
court 17.5
sky 17.2
glowing 16.6
active 16.2
lifestyle 15.9
ball 15.7
shorts 15.7
kick 15.6
male 15.6
activity 15.2
screen 15.2
vibrant 14.9
display 14.8
computer 14.6
shoot 14.5
jumping 14.5
soccer 14.4
team 14.3
equipment 14.2
playing 13.7
pass 13.6
bright 13.6
fun 13.5
goal 13.4
shiny 13.4
man 13.4
design 12.9
exercise 12.7
jump 12.5
leisure 12.5
adult 12.3
action 12
modern 11.9
technology 11.9
tennis 11.7
outdoor 11.5
boy 11.3
outdoors 11.2
racket 11.1
backhand 10.9
serve 10.7
flat 10.6
football 10.6
freedom 10.1
global 10
world 9.7
one 9.7
electronic equipment 9.4
teamwork 9.3
child 9.2
fitness 9
sun 8.9
body 8.8
smile 8.6
business 8.5
black 8.4
health 8.3
teenager 8.2
high 7.8
plasma 7.8
stars 7.5
electronic 7.5
billboard 7.3
office 7.2
copy space 7.2
recreation 7.2
summer 7.1

Google
created on 2022-03-05

Sky 97.1
Flash photography 88.6
Cloud 88.4
Happy 84.7
T-shirt 81.9
Tree 81.6
Rolling 78.9
Knee 78.2
Entertainment 77
Performing arts 76.8
Balance 74.8
Event 70.5
Human leg 70.4
Sportswear 69.6
Sports 69.5
Recreation 68.9
Elbow 68.4
Leisure 68.4
Thigh 68.4
Waist 64.7

Microsoft
created on 2022-03-05

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Female, 52.6%
Calm 33.2%
Confused 32.3%
Sad 12.6%
Angry 5.5%
Happy 4.7%
Fear 4%
Disgusted 3.9%
Surprised 3.8%

AWS Rekognition

Age 19-27
Gender Female, 69.4%
Fear 34.5%
Sad 27.4%
Calm 11.1%
Disgusted 8.8%
Angry 8.4%
Surprised 5.4%
Confused 2.4%
Happy 2.1%

Microsoft Cognitive Services

Age 13
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 98.7%
Person 97.7%

Captions

Microsoft

a man jumping in the air 85.7%
a screen shot of a man jumping in the air 79.6%
a man doing a trick on a skateboard 45.6%

Text analysis

Amazon

12
FRONT
#D
#D FRONT P-3 across
P-3
EIRN
OHLETA EIRN
OHLETA
across