Human Generated Data

Title

Untitled (cheerleaders, Pinkerton Academy)
Date

1959
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18869

Human Generated Data

Title

Untitled (cheerleaders, Pinkerton Academy)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 99.4
Person 99.4
Person 99.2
Person 99.1
Person 99.1
Person 98.9
Person 98.8
Person 97.8
Person 97.8
Person 97.7
Flooring 96
Chair 94.5
Furniture 94.5
Floor 89.4
Road 86.6
Asphalt 86
Tarmac 86
Footwear 84.7
Shoe 84.7
Clothing 84.7
Apparel 84.7
Female 83.3
Military Uniform 64.4
Military 64.4
Woman 63.5
People 62.4
Zebra Crossing 57.4
Officer 55.3
Dress 55.1

Imagga
created on 2022-02-25

people 32.3
men 26.6
man 26.1
person 24.3
male 22
adult 19.4
group 19.3
city 19.1
business 18.8
black 17.5
urban 17.5
kin 16.6
women 15
team 14.3
human 14.2
silhouette 14.1
sport 13.9
performer 12.7
businessman 12.4
legs 12.3
corporate 12
street 12
crowd 11.5
runner 11.4
walking 11.4
wind instrument 11.3
motion 11.1
musician 10.6
run 10.6
professional 10.5
attractive 10.5
musical instrument 10.4
athlete 10.4
active 10.1
life 10
happy 10
fashion 9.8
portrait 9.7
brass 9.5
sword 9.3
action 9.3
singer 9.2
speed 9.2
exercise 9.1
suit 9
success 8.8
couple 8.7
lifestyle 8.7
running 8.6
race 8.6
weapon 8.6
travel 8.4
classroom 8.4
building 8.4
pretty 8.4
dancer 8.2
fun 8.2
fitness 8.1
entertainer 8.1
body 8
child 7.9
work 7.8
school 7.8
boy 7.8
scene 7.8
model 7.8
room 7.7
walk 7.6
power 7.6
friends 7.5
holding 7.4
executive 7.4
occupation 7.3
competition 7.3
clothing 7.2
music 7.2
office 7.2
dress 7.2
world 7.2
cute 7.2
shadow 7.2
handsome 7.1

Google
created on 2022-02-25

Black-and-white 84.2
Style 83.8
Art 77.8
Vintage clothing 71.3
Event 69.5
Monochrome photography 69.4
Monochrome 68.9
Recreation 67.3
Chair 65.7
Uniform 65.1
Stock photography 61.9
Room 59.1
Recital 59
Crew 56.8
Team 54.9
Pattern 54.5
Visual arts 53.7
Musician 53.6
Child 52.7
Retro style 52.5

Microsoft
created on 2022-02-25

road 97.5
clothing 96.2
person 89.7
footwear 86.4
text 82.5
woman 62.7
cartoon 61.6
group 55.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-18
Gender Female, 100%
Calm 62.2%
Angry 13.4%
Surprised 10.9%
Happy 6.1%
Confused 2.5%
Sad 1.8%
Disgusted 1.6%
Fear 1.5%

AWS Rekognition

Age 12-20
Gender Male, 84.9%
Happy 88.6%
Calm 7.6%
Surprised 1.3%
Angry 0.7%
Fear 0.6%
Confused 0.6%
Disgusted 0.4%
Sad 0.3%

AWS Rekognition

Age 26-36
Gender Male, 93.5%
Happy 33.2%
Surprised 20.1%
Angry 18.1%
Calm 16.2%
Confused 5.7%
Fear 3.2%
Sad 1.8%
Disgusted 1.7%

AWS Rekognition

Age 18-24
Gender Male, 96.4%
Happy 43.6%
Calm 34.8%
Confused 8.8%
Surprised 7.2%
Angry 2.4%
Disgusted 1.2%
Sad 1.1%
Fear 0.9%

AWS Rekognition

Age 6-14
Gender Female, 94.5%
Happy 71.9%
Calm 8.4%
Disgusted 5.3%
Confused 4.6%
Surprised 3.7%
Sad 2.6%
Angry 2.5%
Fear 0.9%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 93.6%
Confused 2.5%
Calm 1.4%
Disgusted 0.8%
Angry 0.5%
Sad 0.4%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 18-24
Gender Female, 99.9%
Happy 98.7%
Calm 0.3%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 98.2%
Surprised 0.8%
Angry 0.3%
Fear 0.2%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 90.5%
Angry 3.8%
Surprised 2.3%
Calm 2.2%
Disgusted 0.4%
Confused 0.3%
Sad 0.3%
Fear 0.2%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 94.5%
Shoe 84.7%

Captions

Microsoft

a group of people posing for the camera 92.9%
a group of people posing for a picture 92.8%
a group of people walking down the street 92.7%

Text analysis

Amazon

A
PA
P/A
P A
P

Google

A PA
A
PA