Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Base Ball Team

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3271.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "University House": University House, Philadelphia, Pa.: Base Ball Team

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Person 99.6
Human 99.6
Person 99.4
Person 99.1
Person 99
Person 98.9
Person 98.5
Person 98.5
Person 98.1
Person 97.8
Person 97.4
Person 93.9
Person 93.2
People 92.3
Audience 88.5
Crowd 88.5
Person 86.4
Person 84.6
Face 67.6
Performer 64.8
Person 63.3
Person 62.9
Family 59
Porch 58.4

Imagga
created on 2022-07-02

ballplayer 45.1
kin 44.2
player 39.8
athlete 39.4
person 32.7
contestant 28.7
statue 21.9
people 19
sculpture 18.4
art 17.2
body 15.2
male 14.9
black 14.4
dancer 13.8
style 13.3
sport 13.3
portrait 12.9
man 12.8
adult 12.7
history 12.5
exercise 11.8
marble 11.6
human 11.2
sibling 11.1
pose 10.9
posing 10.7
studio 10.6
lady 10.5
attractive 10.5
dance 10.3
men 10.3
lifestyle 10.1
dark 10
fitness 9.9
performer 9.8
old 9.7
culture 9.4
architecture 9.4
monument 9.3
stone 9.3
city 9.1
sexy 8.8
decoration 8.7
love 8.7
motion 8.6
historical 8.5
head 8.4
fashion 8.3
tourism 8.2
figure 8.2
dress 8.1
aerobics 7.8
happiness 7.8
antique 7.8
ancient 7.8
model 7.8
travel 7.7
party 7.7
anatomy 7.7
pretty 7.7
jump 7.7
outdoor 7.6
casual 7.6
fun 7.5
one 7.5
famous 7.4
active 7.2
religion 7.2
women 7.1
family 7.1
face 7.1
cool 7.1

Google
created on 2022-07-02

Photograph 94.2
Crew 76.6
Snapshot 74.3
Vintage clothing 72.3
Team 72.2
Event 69.9
Room 66.4
Monochrome 65.1
Vest 65
History 64.7
Fun 63.6
Stock photography 62.7
Photo caption 60.6
Suit 58.1
Classic 54.8
Crowd 54.2
Retro style 53.3
Monochrome photography 53.2
Family 52
Uniform 50.9

Microsoft
created on 2022-07-02

person 99.8
clothing 99.3
outdoor 97.6
posing 95.8
group 95.3
man 93.6
human face 92.9
smile 90.6
old 88.7
baseball 77.2
black 77
player 67.9
text 67.7
white 63.3
people 62.2
team 36
crowd 1.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-43
Gender Male, 82.9%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 16-24
Gender Male, 99.2%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.8%
Confused 1%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 79.8%
Angry 9.7%
Confused 6.8%
Surprised 6.4%
Fear 6.2%
Sad 2.8%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 88.6%
Angry 6.8%
Surprised 6.6%
Fear 6.1%
Sad 2.4%
Disgusted 1.1%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 97.6%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 1.4%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Calm 96%
Surprised 6.3%
Fear 6%
Sad 2.2%
Angry 1.9%
Confused 1.1%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 59.9%
Calm 55.7%
Fear 7.4%
Surprised 7.1%
Angry 5.4%
Confused 2.5%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 90.3%
Confused 7.7%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 98.4%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.7%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 16-22
Gender Male, 82.4%
Calm 98.3%
Surprised 6.3%
Fear 6%
Sad 2.3%
Happy 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 7-17
Gender Female, 97.5%
Sad 99.3%
Confused 17%
Calm 8.5%
Surprised 7.3%
Fear 6.4%
Angry 4.2%
Disgusted 3.2%
Happy 1.9%

AWS Rekognition

Age 21-29
Gender Female, 91.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Confused 0.4%
Calm 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 79.1%
Sad 19.8%
Surprised 6.4%
Fear 6%
Confused 2.8%
Happy 0.3%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 97.1%
an old photo of a group of people posing for the camera 95.5%
a group of people posing for the camera 95.4%

Text analysis

Amazon

s
LSRK

Google

SRA &
&
SRA