Human Generated Data

Title

Untitled (boys lined up for football scrimmage, Friends School)

Date

1939

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22270

Human Generated Data

Title

Untitled (boys lined up for football scrimmage, Friends School)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Human 99.5
People 99.4
Person 99.4
Person 99.2
Person 99
Person 98.5
Person 98.4
Sport 97.9
Sports 97.9
Team Sport 97.8
Football 97.8
Team 97.8
Person 96.6
Apparel 90.3
Helmet 90.3
Clothing 90.3
Soccer 89.5
Building 81.9
Person 77.2
Field 77
Person 76.2
Person 72
Arena 56.6
Stadium 55.5

Imagga
created on 2022-03-11

athlete 97.3
ballplayer 69.3
contestant 66.4
player 64.6
runner 48.7
person 39.9
sport 38.6
beach 29.7
man 27.5
sunset 25.2
people 25.1
silhouette 24
sports equipment 21.2
male 19.9
outdoor 19.1
ocean 19.1
active 18.9
sand 18.5
lifestyle 18.1
sea 18
outdoors 17.9
adult 17.5
recreation 17
leisure 16.6
run 16.4
vacation 16.4
water 15.3
summer 14.8
sky 14.7
cricket equipment 14.7
exercise 14.5
sun 14.5
ball 14.5
action 13.9
competition 13.7
coast 13.5
athletic 13.4
couple 13.1
equipment 12.1
play 12.1
fun 12
grass 11.9
fitness 11.7
dusk 11.4
men 11.2
wicket 10.7
game 10.7
running 10.6
boy 10.4
walking 10.4
shore 10.2
health 9.7
outside 9.4
happy 9.4
waves 9.3
relax 9.3
travel 9.2
playing 9.1
horizon 9
family 8.9
track 8.8
practice 8.7
golf 8.6
sunrise 8.4
evening 8.4
field 8.4
together 7.9
happiness 7.8
child 7.8
retirement 7.7
race 7.6
hobby 7.6
cricket bat 7.6
legs 7.5
joy 7.5
dark 7.5
fast 7.5
landscape 7.4
course 7.4
sports 7.4
alone 7.3
black 7.2
body 7.2
activity 7.2
women 7.1

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

outdoor 98.4
sport 93.9
athletic game 91.5
person 91.2
text 90.3
footwear 80.6
black and white 80
field 75
baseball 69
white 66.8
football 26.6

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 94.1%
Calm 98.6%
Sad 1%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Male, 97.5%
Calm 70.6%
Happy 27.3%
Sad 0.9%
Surprised 0.8%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 39-47
Gender Male, 97.7%
Fear 43.6%
Calm 37.6%
Happy 6.7%
Sad 5.4%
Confused 2.6%
Disgusted 1.8%
Angry 1.4%
Surprised 0.8%

AWS Rekognition

Age 38-46
Gender Male, 85.2%
Calm 58.5%
Happy 29.1%
Sad 7.8%
Confused 1.7%
Surprised 1.3%
Disgusted 0.9%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 40-48
Gender Male, 98.8%
Happy 59.5%
Calm 22.7%
Confused 4.6%
Sad 4%
Surprised 3.1%
Disgusted 2.5%
Fear 2%
Angry 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 90.3%

Captions

Microsoft

a group of baseball players playing a football game 56%
a group of football players posing for a photo 55.9%
a group of people running on a field 55.8%

Text analysis

Amazon

Unto