Human Generated Data

Title

Untitled (baseball team portrait)

Date

c. 1930, restored 1970s

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1410

Human Generated Data

Title

Untitled (baseball team portrait)

People

Artist: Ken Whitmire Associates, American

Date

c. 1930, restored 1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99.4
Person 99.4
Person 99.3
Person 99.2
Person 98.9
Person 98.9
Person 98.8
Person 98.7
Person 96.6
Sailor Suit 94.5
Person 93.9
Clothing 85.6
Apparel 85.6
Crowd 65
People 64.2
Boy 59.8

Imagga
created on 2022-01-22

military uniform 74.7
uniform 69.8
clothing 51.5
people 30.6
consumer goods 30.5
covering 29.8
man 29.6
group 27.4
male 23.4
attendant 22.9
crowd 21.1
person 20.7
business 19.4
men 18.9
team 18.8
businessman 18.5
silhouette 17.4
adult 16.3
teamwork 15.7
commodity 14.9
work 14.1
soldier 11.7
worker 11.5
standing 11.3
women 11.1
army 10.7
job 10.6
travel 10.6
old 10.4
professional 10.4
pose 10
helmet 9.5
world 9.4
nurse 9
working 8.8
staff 8.8
military 8.7
corporate 8.6
art 8.5
portrait 8.4
city 8.3
occupation 8.2
businesswoman 8.2
happy 8.1
suit 8.1
religion 8.1
success 8
smiling 7.9
together 7.9
casual 7.6
tourism 7.4
competition 7.3
office 7.2
history 7.1
smile 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.9
posing 99.3
clothing 97.7
group 97.3
old 90.9
text 90.8
man 89.5
baseball 88.7
footwear 84
standing 81.9
team 80
black 72.5
white 68.1
dressed 31.6
clothes 26.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 100%
Surprised 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 98.5%
Disgusted 0.4%
Confused 0.4%
Sad 0.2%
Happy 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 100%
Surprised 0%
Angry 0%
Confused 0%
Sad 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 98.2%
Calm 100%
Surprised 0%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Happy 98.4%
Calm 0.7%
Surprised 0.2%
Sad 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 97.7%
Calm 57.4%
Happy 39.6%
Sad 1.1%
Angry 0.5%
Surprised 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 14-22
Gender Male, 83.1%
Calm 99.2%
Sad 0.2%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 98.5%
Confused 0.5%
Angry 0.3%
Sad 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 100%
Sad 0%
Angry 0%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 96.2%
Calm 99.8%
Happy 0.1%
Sad 0%
Surprised 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of men posing for a photo 95.7%
a group of people posing for a photo 95.6%
a group of young men posing for a photo 87.2%

Text analysis

Amazon

K
R